Use of Machine learning and Deep Reinforcement Learning for Game Development

I’ll be releasing more documentation very soon but just wanted to point out that my tensorflow plugin has matured and there is an example repository: GitHub - getnamo/tensorflow-ue4-examples: Drag and drop Unreal Engine TensorFlow examples reposito with basic working mnist recognition samples (from a basic softmax implementation to a Keras CNN written in vanilla tensorflow python) which can train straight in your editor in the background with no game thread penalty.

Then, after your network has been trained, you can test them on any UTexture2D, or go to Drawing Trivia e.g. on your phone or desktop browser and draw to recognize 0-9 digits. For better recognition I recommend using the Keras CNN script, but this may take 18min to train on a cpu (vs ~30sec on a gpu).

The plugin has full nvidia cuDNN gpu support and is self contained, grab an early release of the example project at https://github.com/getnamo/tensorflow-ue4-examples/releases/ (don’t forget to download the plugin and drag it into your downloaded project).

My aim here is to do all the boring integration bits so you only have to concentrate on learning tensorflow and then later implement those cool new smart features in your games. That said @SaxonRah is correct in that it may take some time for smart people to take research papers and open source repositories to convert them for use in UE4 before advanced examples become fully plug and play, but this should make that much easier than before.

More detailed tutorials will come soon :slight_smile: