Linux build crashing, windows build working for pixel streaming

I keep getting the following error on my linux build:

1702483089269436268,2023-12-13T15:58:08.334905232Z stdout F Unhandled Exception: SIGSEGV: invalid attempt to write memory at address 0x0000000000000003
1702483089269421339,2023-12-13T15:58:08.334903842Z stdout F [2023.12.13-15.58.08:334][ 23]LogCore: === Critical error: ===
1702483089269354549,2023-12-13T15:58:08.334902692Z stdout F CommonUnixCrashHandler: Signal=11
1702483089269346879,2023-12-13T15:58:08.334901532Z stdout F 
1702483089269313080,2023-12-13T15:58:08.334900312Z stdout F 
1702483089269287710,2023-12-13T15:58:08.334898302Z stdout F 
1702483089269195861,2023-12-13T15:58:08.334894292Z stdout F 
1702483089269177991,2023-12-13T15:58:08.334893252Z stdout F 0x00007ff4bce36bb4 libc.so.6!clone(+0x43)
1702483089269153521,2023-12-13T15:58:08.334891292Z stdout F 0x00007ff4bcda5b43 libc.so.6!UnknownFunction(0x94b42)
1702483089269131031,2023-12-13T15:58:08.334890122Z stdout F 0x0000000004836212 HouseProject!FRunnableThreadPThread::_ThreadProc(void*)()
1702483089269109261,2023-12-13T15:58:08.334888972Z stdout F 0x00000000048c3f94 HouseProject!FRunnableThreadPThread::Run()()
1702483089269071292,2023-12-13T15:58:08.334887612Z stdout F 0x00000000089363b4 HouseProject!FRenderingThread::Run()()
1702483089269013472,2023-12-13T15:58:08.334886422Z stdout F 0x00000000089226bc HouseProject!RenderingThreadMain(FEvent*)()
1702483089268993213,2023-12-13T15:58:08.334885212Z stdout F 0x000000000473531f HouseProject!FNamedTaskThread::ProcessTasksUntilQuit(int)()
1702483089268963683,2023-12-13T15:58:08.334883262Z stdout F 0x0000000004736a42 HouseProject!FNamedTaskThread::ProcessTasksNamedThread(int, bool)()
1702483089268928423,2023-12-13T15:58:08.334879132Z stdout F 0x000000000870933b HouseProject!TGraphTask<TEnqueueUniqueRenderCommandType<FVulkanDynamicRHI::RHIResizeViewport(FRHIViewport*, unsigned int, unsigned int, bool, EPixelFormat)::ResizeViewportName, FVulkanDynamicRHI::RHIResizeViewport(FRHIViewport*, unsigned int, unsigned int, bool, EPixelFormat)::$_0> >::ExecuteTask(TArray<FBaseGraphTask*, TSizedDefaultAllocator<32> >&, ENamedThreads::Type, bool)()
1702483089268904823,2023-12-13T15:58:08.334870552Z stdout F 0x00000000086ec39b HouseProject!FVulkanViewport::RecreateSwapchainFromRT(EPixelFormat)()
1702483089268889094,2023-12-13T15:58:08.334868882Z stdout F 0x00000000086eb733 HouseProject!FVulkanViewport::DestroySwapchain(FVulkanSwapChainRecreateInfo*)()
1702483089268844474,2023-12-13T15:58:08.334866732Z stdout F 0x000000000861e8d7 HouseProject!FVulkanDevice::WaitUntilIdle()()
1702483089268814594,2023-12-13T15:58:08.334865232Z stdout F 0x00000000086dc4dc HouseProject!VulkanRHI::VerifyVulkanResult(VkResult, char const*, char const*, unsigned int)()
1702483089268802724,2023-12-13T15:58:08.334863242Z stdout F  with error VK_ERROR_DEVICE_LOST
1702483089268788384,2023-12-13T15:58:08.334861362Z stdout F  at .\Runtime/VulkanRHI/Private/VulkanDevice.cpp:1408 
1702483089268696045,2023-12-13T15:58:08.334858992Z stdout F VulkanRHI::vkDeviceWaitIdle(Device) failed, VkResult=-4
1702483089268670296,2023-12-13T15:58:08.334856232Z stdout F [2023.12.13-15.58.08:313][ 23]LogCore: Error: appError called: Fatal error: [File:.\Runtime/VulkanRHI/Private/VulkanUtil.cpp] [Line: 1131] 
1702483089268643986,2023-12-13T15:58:08.334851162Z stdout F  with error VK_ERROR_DEVICE_LOST
1702483089268543947,2023-12-13T15:58:08.334848352Z stdout F  at .\Runtime/VulkanRHI/Private/VulkanDevice.cpp:1408 
1702483089268499407,2023-12-13T15:58:08.334845612Z stdout F [2023.12.13-15.58.08:308][ 23]LogVulkanRHI: Error: VulkanRHI::vkDeviceWaitIdle(Device) failed, VkResult=-4
1702483089268485167,2023-12-13T15:58:08.334835482Z stdout F [2023.12.13-15.57.57:060][ 23]LogRHI: Display: Encountered a new graphics PSO: 4252614314
1702483089268409748,2023-12-13T15:58:08.334834052Z stdout F [2023.12.13-15.57.57:060][ 23]LogRHI: Display: Encountered a new graphics PSO: 354969453

When I do a windows build of the project, it works fine, but a linux build is ideal. I am pixel streaming the project with an RTX A6000 GPU.