How to add image as observation when using Learning Agents

It’s not currently supported because it’s something we want to discourage at the time being. Images pretty much need to be processed on the GPU and its not realistic to render a complex game on the GPU and do ML inference on the same GPU.

We will probably add it in the future but right now we want to encourage users to use ground truth information, i.e. game state directly.

Let me know what you think.

1 Like