https://forum.asrock.com/ Copyright (c) 2006-2013 Web Wiz Forums - All Rights Reserved. Sat, 15 Aug 2026 12:27:04 +0000 Thu, 17 Oct 2024 20:14:23 +0000 http://blogs.law.harvard.edu/tech/rss Web Wiz Forums 12.04 360 https://forum.asrock.com/RSS_post_feed.asp?TID=54722 https://forum.asrock.com/forum_images/web_wiz_forums_black.png https://forum.asrock.com/ https://forum.asrock.com/forum_posts.asp?TID=54722&PID=156727&title=high-vram-allocation-on-ryzen-apus-for-machine-lea#156727 Author: Skybuck
Subject: 54722
Posted: 17 Oct 2024 at 8:14pm

All I can tell you is I can run 70B models on my 7950X with 128 GB of ram with ollama.

I do have a rtx 4070 ti installed, with 12 gb ram.

However I believe ollama will simply use MAIN ram.... of the pc/cpu/ddr5.

The computation most likely happens on CPU cores, so the embedded gpu plays no role...]]> Thu, 17 Oct 2024 20:14:23 +0000 https://forum.asrock.com/forum_posts.asp?TID=54722&PID=156727&title=high-vram-allocation-on-ryzen-apus-for-machine-lea#156727 https://forum.asrock.com/forum_posts.asp?TID=54722&PID=137829&title=high-vram-allocation-on-ryzen-apus-for-machine-lea#137829 Author: AsRockML
Subject: 54722
Posted: 07 Aug 2024 at 11:26am

Hello ASRock Community,

I?™m currently exploring the potential of using Ryzen APUs (eg from the 5000 to 8000 series) for machine learning applications. Specifically, I am interested in configuring the VRAM allocation settings in the BIOS to support more than 16GB of VRAM. This capability would be beneficial for loading large models and datasets.

I have seen various discussions about increasing VRAM allocation using the ?œUMA Frame Buffer Size??setting in the BIOS. However, detailed user experiences about achieving allocations higher than 16GB are sparse.

My questions are:

     1.     Are there any documented cases where users have successfully set the VRAM allocation above 16GB on Ryzen APUs? Eg. 64GB.
     2.     Has this led to successful system boot and stable operation under such configurations?
     3.     Are there specific BIOS settings or configurations that need to be adjusted to achieve this?

Are there specific models of motherboard that are more flexible in this regard? The motherboards of particular interest for this inquiry include:

     ??ASRock X670E Steel Legend
     ??ASRock B650E Steel Legend
     ??ASRock B650 Pro RS

The goal is to understand the feasibility and potential performance benefits of such configurations for machine learning tasks.

Any insights or experiences from the community or ASRock support team would be greatly appreciated.

Thank you!
]]> Wed, 07 Aug 2024 11:26:19 +0000 https://forum.asrock.com/forum_posts.asp?TID=54722&PID=137829&title=high-vram-allocation-on-ryzen-apus-for-machine-lea#137829