Issue Related to Hardware Reboot During Pixel Streaming Setup

Development Pipeline & Plugins
, ,
1

Issue : Approximately once a month per server, during late night or early morning when there is minimal or no load, an event (such as a 4101 or 4109 error, GPU error, etc.) occurs, causing the server to reboot.

  1. I would like to understand how the program developed with Unreal Engine interacts with the hardware (PC) GPU. Specifically, I want to know how the GPU is allocated across different models (server, workstation, general desktop PC).

  2. A reboot issue has been occurring on the streaming server configured for pixel streaming.

  1. Could you provide insights into the probable causes of this rebooting issue and possible solutions?
    (1) Note: This issue does not occur during periodic reboots.

  2. If there are specific measures or solutions to resolve this, could you please provide them?

  1. I recognize that the provided information may be insufficient. If additional details are required, please inform me so that I can gather and include them in my inquiries.

============================================================

[Server Specifications and Info]

Task OS CPU (48Core) Memory GPU GPU GPU GPU CUDA GPU 3D Program Pixel Streaming Version
Model Allocation Driver Version Version Driver Unreal Engine Version
Task1 Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 100GB A40 48GB Passthrough 552.74 12.4 552.74_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.2 Pixel Streaming 5.2
Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 100GB A40 48GB Passthrough 552.74 12.4 552.74_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.2 Pixel Streaming 5.2
Task2 Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 100GB A40 48GB Passthrough 552.74 12.4 552.74_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.3 Pixel Streaming 5.3
Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 100GB A40 48GB GRID 552.74 12.4 552.74_grid_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.3 Pixel Streaming 5.3
(Use 24GB) Unreal Engine 5.3 Pixel Streaming 5.3
Task3 Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 200GB A40 48GB Passthrough 552.74 12.4 552.74_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.3 Pixel Streaming 5.3
Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 200GB A40 48GB Passthrough 552.74 12.4 552.74_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.3 Pixel Streaming 5.3
Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 200GB A40 48GB Passthrough 552.74 12.4 552.74_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.3 Pixel Streaming 5.3
Windows 2022 Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz 10Core 200GB A40 48GB Passthrough 552.74 12.4 552.74_win10_win11_server2022_dch_64bit_international.exe Unreal Engine 5.3 Pixel Streaming 5.3
Developer Desktop Environment Windows 10 12th Gen Intel® Core™ i9-12900K 64GB NVIDIA GeForce RTX 3090 556.12 12.5 Unreal Engine 5.2
Unreal Engine 5.3

==================================================================

[Date of Event]

Task Measures Taken Failure Failure Occurrence Date and Time Figure No.
Task3 Automatic reboot Unexpected server reboot 2024-10-31 1:43 1
Task2 Automatic reboot Unexpected server reboot 2024-10-20 10:28 2
Task1 Automatic reboot Unexpected server reboot 2024-10-15 22:52 3
Task1 Automatic reboot Unexpected server reboot 2024-10-10 2:21 4
Task1 Automatic reboot Unexpected server reboot 2024-09-08 1:12 5
Task2 Automatic reboot Unexpected BSOD 2024-09-03 8:30 6
Task1 Automatic reboot Unexpected reboot 2024-08-26 4:43 7
Task2 Automatic reboot Unexpected reboot 2024-08-23 3:51 8
Task2 Automatic reboot Unexpected server reboot 2024-08-14 10:00 9
Task1 Automatic reboot Unexpected BSOD 2024-08-05 23:00 -
Task1 Automatic reboot Unexpected server reboot 2024-07-06 21:56 -
Task1 Automatic reboot Unexpected server reboot 2024-06-19 6:51 -
Task1 Automatic reboot Unexpected server reboot 2024-05-27 2:50 -
Task1 Automatic reboot Unexpected server reboot 2024-05-04 15:32 -
Task1 Automatic reboot Unexpected server reboot 2024-04-22 1:50 -
Task1 Automatic reboot Unexpected server reboot 2024-03-30 9:15 -
2

Hey there!

That’s definitely an odd issue, if I could please trouble you for the following information:

  • The resource utilisation, particularly memory and vram usage at the time of the crashes
  • The UE logs at the time of crashes
  • The minidumps from the crashes

Additionally, could you please try updating your Nvidia drivers to 553.24? As of that version release they have fixed a number of crash related issues.

Thank you

1 Like