ASRock.com Homepage
Forum Home Forum Home > Technical Support > AMD Motherboards
  New Posts New Posts RSS Feed - ASRock X370 Pro - Can't POST with 8 GPUs
  FAQ FAQ  Forum Search Search  Events   Register Register  Login Login

ASRock X370 Pro - Can't POST with 8 GPUs

 Post Reply Post Reply Page  123 4>
Author
Message
ASRickroll View Drop Down
Newbie
Newbie
Avatar

Joined: 28 Feb 2018
Location: Japan
Status: Offline
Points: 10
Post Options Post Options   Thanks (0) Thanks(0)   Quote ASRickroll Quote  Post ReplyReply Direct Link To This Post Topic: ASRock X370 Pro - Can't POST with 8 GPUs
    Posted: 28 Feb 2018 at 5:08pm
I am currently transforming my gaming PC into a mining rig by adding PCIe slots and GPUs, hence the X370 (unusual choice for mining)
The GPUs are 8xASUS RX 580 Dual 8GB

I get "0d" error on Dr. Debug and cannot even POST (blank screen, cannot enter BIOS) when I install 8 GPUs

Everything works fine with 7 GPUs (I can remove any one GPU) everything works fine.

However when adding 8th GPU, it can't POST and always displays "0d"

I have tried replacing 1-2 GPUs with 2 spare GTX 1050Ti, neither combination works.

Mix and matching my 10 GPUs works fine if there are only 7 GPUs total. Adding the 8th one, whichever it is, always results in no-POST.

I am using some kind of PCIe PLX card (not sure what to call it) to turn a single 16x PCIe to eight 1x PCIe (see pics below)

I have tried using combination of the PLX card and other PCIe slots to no avail (e.g.: 6 GPUs on PLX card, 2 GPUs on mobo's PCIe 1x slots)

I even have a second PLX card and have tried swapping them or even using them together (e.g.: 4 GPUs on the first PLX card, and the rest on the second PLX card)

Neither works if I install more than 7 GPUs
Again, everything works OK if I only use 7 GPUs max, regardless of which PLX card or PCIe slot I use.

I have tried replacing the PSU (I have two SilverStone 1500W and 1300W Ti), replacing PCIe riser (I have 20 of them), replacing the PCIe cables (total 16 PCIe 8pin cables from both PSUs), replacing PLX card (I have 2 of them), all to no avail.

I have started to suspect that I have either hit the processor or the mobo limit (Ryzen mining mobo from Biostar only supports 6 GPUs)

Is there a maximum GPU limitation on AMD Ryzen itself?

Or is this limitation on ASRock mobo?

Could someone experienced enlighten me?

Any help is appreciated!

My specs and pictures are below

Mobo: ASRock X370 Pro (BIOS v4.40)
CPU: Ryzen 1700
GPUs: 8xASUS RX 580 Dual 8GB, 2xGTX 1050Ti 4GB
RAM: 2x8GB Corsair Vengeance RGB DDR4 PC3000
SSD: WD Blue 1TB (M2 SATA)
PSU: SilverStone Strider 1500W Ti and 1300W Ti (using only one of them)
OS: Windows 10 Pro (should not be an issue since the system cannot even POST)

PLX 1->8 PCIE slot extender (see pics below) bought from Amazon
No brand PCIe 1x risers bought from Amazon

Pic of whole setup:

Pic of Dr. Debug error code "0d" when using 8 GPUs

The PLX card that I'm using to create extra PCIe x1 slots:

P.S.: After failing to POST with 8 GPUs, and I remove 1 of the GPU, the mobo seems to "remember" and I cannot POST unless I clear the CMOS
Clearing CMOS has no effect when 8 GPUs are installed

Will provide more information if requested

Back to Top
JohnM View Drop Down
Groupie
Groupie
Avatar

Joined: 20 Feb 2018
Location: UK
Status: Offline
Points: 267
Post Options Post Options   Thanks (0) Thanks(0)   Quote JohnM Quote  Post ReplyReply Direct Link To This Post Posted: 28 Feb 2018 at 8:41pm
I admit I know very little about what you're trying to do but one thought struck me. How much power does one of those GPUs take? Is 1.5 kW enough for your set up?

Edit: A quick Google suggests around 150 W each. So for eight of them, 1.2 kW. That leaves about 300 W for everything else. Personally, I'd allow a bit more headroom. Can you power four of your cards with your second PSU?


Edited by JohnM - 28 Feb 2018 at 9:00pm
ASRock Fatal1ty AB350 ITX P4.90, AMD Ryzen 5 2400G, 2x8GB Corsair CMK16GX4M2A2666C16, 250GB Samsung 960EVO, 500GB Samsung 850EVO, 4TB WD Blue, Windows 10 Pro 64, Corsair SF450, Cooler Master Elite 110
Back to Top
JohnM View Drop Down
Groupie
Groupie
Avatar

Joined: 20 Feb 2018
Location: UK
Status: Offline
Points: 267
Post Options Post Options   Thanks (1) Thanks(1)   Quote JohnM Quote  Post ReplyReply Direct Link To This Post Posted: 28 Feb 2018 at 9:02pm
Then again, I suppose they don't draw full power at start up. Their power requirements at idle are probably quite low.
ASRock Fatal1ty AB350 ITX P4.90, AMD Ryzen 5 2400G, 2x8GB Corsair CMK16GX4M2A2666C16, 250GB Samsung 960EVO, 500GB Samsung 850EVO, 4TB WD Blue, Windows 10 Pro 64, Corsair SF450, Cooler Master Elite 110
Back to Top
ASRickroll View Drop Down
Newbie
Newbie
Avatar

Joined: 28 Feb 2018
Location: Japan
Status: Offline
Points: 10
Post Options Post Options   Thanks (0) Thanks(0)   Quote ASRickroll Quote  Post ReplyReply Direct Link To This Post Posted: 28 Feb 2018 at 11:12pm
Hi JohnM Smile thanks for your reply.

Yes, you are right.

However I've tried replacing 2 of RX 580 (150W each, requires 8pin PCIE cable each) with 2 GTX 1050Ti (75W each, no PCIE cable required). Which supposedly should bring down the overall power requirement by 150W, but no luck.

I currently don't have dual PSU adapter so I cannot test dual PSU config. 
Back to Top
MisterJ View Drop Down
Senior Member
Senior Member


Joined: 19 Apr 2017
Status: Offline
Points: 1097
Post Options Post Options   Thanks (1) Thanks(1)   Quote MisterJ Quote  Post ReplyReply Direct Link To This Post Posted: 01 Mar 2018 at 12:18am
ASRickroll, perhaps you have just exceeded the limit of your processor/board.  Please open an AMD Support Ticket and ask them.  My post code list, which wardog ask me not to post a link to, gives this for the 0x0D code:
0x0C - 0x0D Reserved for future AMI SEC error codes
0x0E Microcode not found
I don't know what this all means and cannot get a handle on SEC.  Considering the 0x0E code perhaps the UEFI is looking beyond some limit.  In your discussion with AMD, please ask how many GPUs the X399 will support.  Please let us know their response.  Enjoy, John.
Fat1 X399 Pro Gaming, TR 1950X, RAID0 3xSamsung SSD 960 EVO, G.SKILL FlareX F4-3200C14Q-32GFX, Win 10 x64 Pro, Enermx Platimax 850, Enermx Liqtech TR4 CPU Cooler, Radeon RX580, BIOS 2.00, 2xHDDs WD
Back to Top
ASRickroll View Drop Down
Newbie
Newbie
Avatar

Joined: 28 Feb 2018
Location: Japan
Status: Offline
Points: 10
Post Options Post Options   Thanks (0) Thanks(0)   Quote ASRickroll Quote  Post ReplyReply Direct Link To This Post Posted: 01 Mar 2018 at 4:22am
Originally posted by MisterJ MisterJ wrote:

ASRickroll, perhaps you have just exceeded the limit of your processor/board.  Please open an AMD Support Ticket and ask them.  My post code list, which wardog ask me not to post a link to, gives this for the 0x0D code:
0x0C - 0x0D Reserved for future AMI SEC error codes
0x0E Microcode not found
I don't know what this all means and cannot get a handle on SEC.  Considering the 0x0E code perhaps the UEFI is looking beyond some limit.  In your discussion with AMD, please ask how many GPUs the X399 will support.  Please let us know their response.  Enjoy, John.

Thanks MisterJ.

I did what you suggested but I got an error when creating AMD Support ticket.
Tried twice. Getting the same error.
Seems like a bug in their ticketing system.

Back to Top
MisterJ View Drop Down
Senior Member
Senior Member


Joined: 19 Apr 2017
Status: Offline
Points: 1097
Post Options Post Options   Thanks (0) Thanks(0)   Quote MisterJ Quote  Post ReplyReply Direct Link To This Post Posted: 01 Mar 2018 at 4:30am
ASRickroll, I just submitted a ticket and it worked.  It took a long time, maybe more than a minute.  Please give it another go.  Are you in the US as I am?  Enjoy, John.
Fat1 X399 Pro Gaming, TR 1950X, RAID0 3xSamsung SSD 960 EVO, G.SKILL FlareX F4-3200C14Q-32GFX, Win 10 x64 Pro, Enermx Platimax 850, Enermx Liqtech TR4 CPU Cooler, Radeon RX580, BIOS 2.00, 2xHDDs WD
Back to Top
kerberos_20 View Drop Down
Senior Member
Senior Member
Avatar

Joined: 06 Dec 2017
Location: czech republic
Status: Offline
Points: 3687
Post Options Post Options   Thanks (1) Thanks(1)   Quote kerberos_20 Quote  Post ReplyReply Direct Link To This Post Posted: 01 Mar 2018 at 1:38pm
try to free some pci-e devices like usb, sata, soundcard, ... whatever u dont need and is connected o chipset
but dunno if it helps, my x370  has 7 hardware switches (4 free atm) on chipset and 2 useable from cpu
which is max 9 devices
Back to Top
JohnM View Drop Down
Groupie
Groupie
Avatar

Joined: 20 Feb 2018
Location: UK
Status: Offline
Points: 267
Post Options Post Options   Thanks (1) Thanks(1)   Quote JohnM Quote  Post ReplyReply Direct Link To This Post Posted: 01 Mar 2018 at 8:11pm
Have you tried putting the 8th GPU in the other motherboard slot?

I'm slightly puzzled by the spec:

    AMD Ryzen series CPUs
    - 2 x PCI Express 3.0 x16 Slots (single at x16 (PCIE2); dual at x16 (PCIE2) / x4 (PCIE4))*

Where does it get the four PCIe 3.0 lanes from for the PCIE4 slot?

    *Supports NVMe SSD as boot disks
    If M2_1 is occupied, PCIE4 will be disabled.

So it shares with the M.2 socket? I guess a mining rig doesn't need an NVMe boot SSD. Other X370 boards I've seen allow the primary set of 16 PCIe 3.0 lanes to be shared 8+8 with the secondary GPU slot, while B350 boards keep all 16 for the primary GPU slot and allocate four PCIe 2.0 lanes from the B350.


ASRock Fatal1ty AB350 ITX P4.90, AMD Ryzen 5 2400G, 2x8GB Corsair CMK16GX4M2A2666C16, 250GB Samsung 960EVO, 500GB Samsung 850EVO, 4TB WD Blue, Windows 10 Pro 64, Corsair SF450, Cooler Master Elite 110
Back to Top
ASRickroll View Drop Down
Newbie
Newbie
Avatar

Joined: 28 Feb 2018
Location: Japan
Status: Offline
Points: 10
Post Options Post Options   Thanks (0) Thanks(0)   Quote ASRickroll Quote  Post ReplyReply Direct Link To This Post Posted: 01 Mar 2018 at 8:49pm
Originally posted by kerberos_20 kerberos_20 wrote:

try to free some pci-e devices like usb, sata, soundcard, ... whatever u dont need and is connected o chipset
but dunno if it helps, my x370  has 7 hardware switches (4 free atm) on chipset and 2 useable from cpu
which is max 9 devices

Thanks for the suggestion.
I have tried disabling LAN, sound card, etc. but no luck.

Originally posted by JohnM JohnM wrote:

Have you tried putting the 8th GPU in the other motherboard slot?

I'm slightly puzzled by the spec:

    AMD Ryzen series CPUs
    - 2 x PCI Express 3.0 x16 Slots (single at x16 (PCIE2); dual at x16 (PCIE2) / x4 (PCIE4))*

Where does it get the four PCIe 3.0 lanes from for the PCIE4 slot?

    *Supports NVMe SSD as boot disks
    If M2_1 is occupied, PCIE4 will be disabled.

So it shares with the M.2 socket? I guess a mining rig doesn't need an NVMe boot SSD. Other X370 boards I've seen allow the primary set of 16 PCIe 3.0 lanes to be shared 8+8 with the secondary GPU slot, while B350 boards keep all 16 for the primary GPU slot and allocate four PCIe 2.0 lanes from the B350.



That will be the last 3 things I want to try before I give up (I'll go back to it tomorrow):
1. Install the 8th GPU directly into mobo PCIe slot
2. Set up a dual PSU (1500W + 1300W) to see if it's power issue
3. Use M2-to-PCIe adapter on that M2_1 slot and insert the 8th GPU into this adapter or directly insert the last GPU into PCIe4 (4x)

That's true, basically there are 2 M2 slots: one is M2 SATA (I'm using it for the WD Blue SSD) and the other one is M2 PCIe which, like the manual says, is sharing 4x PCIe lanes with PCIe4 slot. 

About the 8+8, that's also true for this mobo. I can set it in the BIOS (1x16 or 2x8 mode) but I think this is not necessary since the mobo automatically switches to 2x8 if you insert 2 devices into the SLI/CrossFire slots.
I have tried manually setting the mode to 2x8 and just connect everything into the PLX card. No luck though Ouch
Back to Top
 Post Reply Post Reply Page  123 4>
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.04
Copyright ©2001-2021 Web Wiz Ltd.

This page was generated in 0.094 seconds.