It looks like currently Docker Desktop does not support many of the APIs required for Vulkan to run on Docker Desktop for windows. Windows only provides limited functionality (enough to get a good chunk of CUDA to work) of the GPU to the WSL2 VM causing this to crash. Same docker compose and docker image starts without crashing on a dedicated Linux VM with an NVIDIA GPU, NVIDIA Drivers, and NVIDIA Container Toolkit installed.