GPU Hang/Crash

Seem to be getting a few GPU Hang/Crashes, i have posted a couple of logs and the system specs for the logs from our crash reports.

First crash (first attachment specs)

Operating System


Build
2538
Kernel Version
10.0.22000.2538
Name
Windows
Version
10.0.22000
Unreal Engine
Configuration
Shipping
Engine mode
Game
Engine version
5.7.0-7783
Game name
DominanceTOE
Is game
true
Is Marketplace version
false
Is standalone
true
Is unattended
false
Plugin version
1.1.1
Target Type
Game
Device
Architecture
x86_64
CPU Description
AMD Ryzen 7 5800H with Radeon Graphics
number_of_cores
8
number_of_cores_including_hyperthreads
16
physical_memory_size_gb
16

Second Attachment specs:

Operating System

Build
2538
Kernel Version
10.0.22000.2538
Name
Windows
Version
10.0.22000
Unreal Engine
Configuration
Shipping
Engine mode
Game
Engine version
5.7.0-7783
Game name
DominanceTOE
Is game
true
Is Marketplace version
false
Is standalone
true
Is unattended
false
Plugin version
1.1.1
Target Type
Game
Device
Architecture
x86_64
CPU Description
AMD Ryzen 7 5800H with Radeon Graphics
number_of_cores
8
number_of_cores_including_hyperthreads
16
physical_memory_size_gb
16
Graphics Processing Unit
Driver Version
Adrenalin 20.40.32.15
Name
AMD Radeon(TM) Graphics
Vendor Name
Advanced Micro Devices, Inc.
Trace Details
sample_rand
0.9761511411742668
Span ID
58a707d6bd134d8e
Status
unknown
Trace ID
4fe35cfd41a24579a411ba43e34572c3



[Attachment Removed]

Hi,

these crashes are likely caused by the GPU running out of memory or by faulty drivers. This [Content removed] contains a potential workaround to prevent the GPU from exceeding its memory budget while compiling shaders. Could you please try the following settings:

D3D12.PSOPrecache.KeepLowLevel=false
D3D12.PSO.KeepUsedPSOsInLowLevelCache=false
r.PSOPrecache.KeepInMemoryUntilUsed=0 (if UE 5.5 or UE 5.6) or 2 (UE 5.7+)

It would also be helpful if you could share the shader assembly that was dumped when the PSO compilation occurred, as mentioned [Content removed]

Can you provide more details on the type of GPU you are using? Do the crashes happen randomly or do you have reliable repro steps that trigger the crash?

Thanks,

Sam

[Attachment Removed]