Out of video memory trying to allocate a rendering resource

Development Programming & Scripting
, ,
1

Title: Fatal Error: Out of Video Memory on High-End PC with RTX 5080 and 96GB RAM

Hello, I recently built a new PC with the following specs:

  • CPU: 9950X3D
  • GPU: RTX 5080 16GB
  • RAM: 96GB

Previously, I was working on a laptop with only 4070 8GB of VRAM. Despite the limitations, I was able to run my Unreal Engine level after tweaking the TDR settings in regedit, which reduced the frequency of crashes.

However, when I opened the exact same Unreal Engine level on this new high-end desktop, the editor crashes immediately with the following error:

Fatal error: [File:D:\build\++UE5\Sync\Engine\Source\Runtime\D3D12RHI\Private\D3D12Util.cpp] [Line: 797] 
Out of video memory trying to allocate a rendering resource


Unhandled Exception: 0x0000c000

0x00007ff98a1c4a6a UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a1b28cd UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a1c726c UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a0a87ff UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a0fadce UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a096b52 UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a096a3e UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a16ed6c UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff98a0a0257 UnrealEditor-D3D12RHI.dll!UnknownFunction []
0x00007ff9bfa2e0ae UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9bfa2b288 UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9bfa5e673 UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9bfa10c7e UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9bfa2cc91 UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9bfa2f69a UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9bfa5f9c0 UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9bfa1ac34 UnrealEditor-RHI.dll!UnknownFunction []
0x00007ff9b51cdc55 UnrealEditor-Core.dll!UnknownFunction []
0x00007ff9b51cd9b6 UnrealEditor-Core.dll!UnknownFunction []
0x00007ff9b51f3db1 UnrealEditor-Core.dll!UnknownFunction []
0x00007ff9b51b5fe5 UnrealEditor-Core.dll!UnknownFunction []
0x00007ff9b53d1a23 UnrealEditor-Core.dll!UnknownFunction []
0x00007ff9b58737ad UnrealEditor-Core.dll!UnknownFunction []
0x00007ff9b586c8ff UnrealEditor-Core.dll!UnknownFunction []
0x00007ffab63be8d7 KERNEL32.DLL!UnknownFunction []

Crash in runnable thread Background Worker #2

Does anyone know how to resolve this issue?

I’ve already applied the same TDR registry tweaks I used before, but that didn’t help this time. I find it strange that a project which barely ran on a laptop is now crashing instantly on a much more powerful machine.

Is opening a previous work file on my new computer having a big impact?

Any advice or insights would be greatly appreciated. Thank you!

2

Hello there @4282775

Having also experienced the full new rig setup, only for weird issues to pop up, when the old equipment was doing just fine, I know it’s a very frustating scenario. Now, since you moved the project from the old rig, the most likely cause here is that some files tied to the previous enviroment are creating conflicts.

So, the first step would be to fully clear the projec’s cache, via deleting the following elements, from the main directory:

  • Delete “Intermediate” folder
  • Delete “Saved/ShaderDebugInfo” folder
  • Delete “DerivedDataCache” folder

Then, from Engine, go to Edit, Project Settings, Rendering, and find/delete all cached shaders.

After these steps, we also need to make sure that your current drivers are up to the task in the new system. For that, open nVidia manager (or Experience), download the “Developer” drivers, and pick the “Clean Install” option when making the setup.

This should clear your environment completely, now please test your project, in both DX11 and DX12. If more issues pop up, test one more thing, run your project without VSM:

  • Go to Project Settings, Rendering, Virtual Shadow Maps
  • Uncheck “Enable virtual shadow maps”
  • Restart the editor

Hope this helps!

1 Like
3

Thank you! Thanks to you, I solved the problem! Thank you so much for your response, and I hope you have a great day!

1 Like