ASRock.com Homepage
Forum Home Forum Home > Technical Support > AMD Motherboards
  New Posts New Posts RSS Feed - ESXI SR-IOV & Passthrough not capable for all devi
  FAQ FAQ  Forum Search Search  Events   Register Register  Login Login

ESXI SR-IOV & Passthrough not capable for all devi

 Post Reply Post Reply
Author
Message
Radix View Drop Down
Newbie
Newbie
Avatar

Joined: 19 Apr 2023
Location: Earth
Status: Offline
Points: 50
Post Options Post Options   Thanks (0) Thanks(0)   Quote Radix Quote  Post ReplyReply Direct Link To This Post Topic: ESXI SR-IOV & Passthrough not capable for all devi
    Posted: 19 Apr 2023 at 9:08pm
A few years ago I set up ESXi 6.7 on my desktop - it had a few linux VM's and one Windows VM with the GPU passed through to it. Everything was working great until I decided to upgrade.

Original Specs:

Mainboard: X570 Phantom Gaming 4 (BIOS versoin 1.20)
CPU: AMD 3600X (6 core)
MEM: 32GB 3200 mhz
GPU 1: Quadro K4000
GPU 2 : RTX 2060 OC

Upgraded Specs:
Mainboard: X570 Phantom Gaming 4 (BIOS version L5.01)
CPU: AMD 3700G (8 core)
MEM: 64GB 3200 mhz
GPU 1 : RTX 3080 TI

A couple days ago I upgraded the GPU to a 3080 TI. Restarting, I could see it was available for passthrough.
As the 3600X did not have built in graphics, I had an old Quadro K4000 for the graphics which the ESXi was using.
The Quadro was very close and blocking airflow to the 3080 ti, so I opted to upgrade the GPU to a 5700G, to allow for integrated graphics. When I switched GPU, I got an error code, google informed me that because I had bought my mainboard before the 5000 series CPU's were released, it needed a BIOS update. I put back the old CPU, did the BIOS update and then reinstalled the new 5700G. Everything worked, but BIOS on factory settings - memory at 2100 mhz or something low - and SR-IOV disabled.

Besides the output of display port being a pain (it wont send out a signal unless a monitor is detected, monitor will autoswitch to other inputs if no signal detected....) and just spamming F2 to get to BIOS before I could see anything, it would work. If i just left it to boot up, I could see the ESXi mainscreen (had to switch primary output to integrated graphics in BIOS) and I can connect to the server over my LAN as usual. However it now said SR-IOV and Passthrough "Not capable" and greyed out, where before it was black and said "disabled" and could be changed to "passthrough active".

I went back into the BIOS, I set the memory speed to 3200, and enabled SR-IOV. Reboot and I am still met with SR-IOV and Passthrough "Not capable" and greyed out.

I am thinking there may be some other BIOS settings I need to change, but this mainboard has a seriously complicated BIOS.
https://download.asrock.com/Manual/X570%20Phantom%20Gaming%204.pdf

Looking at it it looks like I need to ensure SVM is enabled. When I get get a chance I will verify this, but it says it should be enabled by default.

Other BIOS settings I am not clear if I should enable:
Above 4G Decoding "Enable or disable 64bit capable Devices to be decoded in Above 4G Address Space
(only if the system supports 64 bit PCI decoding)."



I can't see any other BIOS options. Could it be the L5.01 BIOS doesnt support Passthrough?
Back to Top
Xaltar View Drop Down
Moderator Group
Moderator Group
Avatar

Joined: 16 May 2015
Location: Europe
Status: Offline
Points: 27593
Post Options Post Options   Thanks (0) Thanks(0)   Quote Xaltar Quote  Post ReplyReply Direct Link To This Post Posted: 19 Apr 2023 at 10:18pm
I would open up a support ticket with ASRock and inquire with them. If the issue
comes from the BIOS update/version they should be able to help you out. A quick
google search reveals that there shouldn't be an issue using passthrough with the
5700g's iGPU so it shouldn't be a compatibility issue with it or your 3080ti.

http://event.asrock.com/tsd.asp
Back to Top
Radix View Drop Down
Newbie
Newbie
Avatar

Joined: 19 Apr 2023
Location: Earth
Status: Offline
Points: 50
Post Options Post Options   Thanks (0) Thanks(0)   Quote Radix Quote  Post ReplyReply Direct Link To This Post Posted: 20 Apr 2023 at 4:18am
Awesome, will try that, ty!
Back to Top
Radix View Drop Down
Newbie
Newbie
Avatar

Joined: 19 Apr 2023
Location: Earth
Status: Offline
Points: 50
Post Options Post Options   Thanks (0) Thanks(0)   Quote Radix Quote  Post ReplyReply Direct Link To This Post Posted: 22 Apr 2023 at 8:02pm
Update:
Problem Resolved

had to go in BIOS to AMD CBS\NBIO and enable IOMMU.

Works flawlessly.
Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.04
Copyright ©2001-2021 Web Wiz Ltd.

This page was generated in 0.047 seconds.