X870 Pro rs Wifi not booting VGA light

I've just upgraded my pc moving from am4 to am5. The only parts carried over from the old build is the boot drive with windows 11 Pro and the gpu.

Specs:

Cpu: Ryzen 7 7700x
Motherboard: X870 Pro rs wifi
Ram: 32Gb Kingston DDR5 6000 CL30 2x16GB
gpu: MSI RTX 2070
PSU: MSI A850GL 80+ gold
Drive: samsung 980 pro 2TB pcie gen 4

When I first started the pc it booted into windows and prompted to install the drivers. Once complete it prompted me to restart and enable auto update in the bios. Rebooting with advanced start up options to get to the bios resulted in a solid white VGA light and a small white square on the screen.

I have cleared cmos, updated the bios to both 3.15 and 3.11. I removed the gpu and tried onboard graphics. When I tried 3.15 with onboard graphics and no boot drive installed and one stick of ram and a freshly cleared cmos the pc was able to boot into the bios. I exited out of the bios and then the pc went right back into solid VGA light and nothing but the white square on screen despite the fact I changed nothing at all. I have not been able to get anything other than the little white square since then.

The GPU was working perfectly just this morning in the old system so I am confident that is not the issue especially given that onboard graphics have the same issue.