I have a project running on AWS. It runs on an EC2 instance of type g3s.xlarge, which includes a GPU. I launched it from ami-0aab79ae79858f789 Microsoft Windows Server 2016 with NVIDIA GPU driver for G3 Locale English AMI provided by Amazon, which includes the appropriate Nvidia drivers. Once the instance was running, I pretty much followed the pixel streaming Getting Started guide to get it working.
The g3s.xlarge instance is actually overpowered for running a single instance of my project at 60fps, but can only run 2 instances at 20-25 fps. My guess is that it’s not good at sharing the GPU.