Computer is hanging on the Asrock splash screen

I recently built a new computer with the following components:

but for some reason it hangs at the ASROCK splash screen whenever I do a fresh boot and no inputs would work even though the peripherals are lit up (also no beeps from the mobo speakers). If I hit the reset button from the case, the computer will boot fine but now i have one wallpaper for two monitors (both of them display fine but I cant set wallpaper to each individual monitor) and if I replug one of the display inputs, then it will have two different wallpapers.

If I turn switched off the PSU and switch it back on then power the system, it works fine. It boots up from nvme and the wallpaper situation is also fixed.

Any help would be much appreciated.

Thanks.