Learning Agents - Cube to Cross a Narrow Path

I am trying to use Learning Agents in Unreal Engine to teach a cube to cross a narrow path without falling off. Here’s what I’ve done so far:

I created the path and added collisions around it so the cube restarts if it falls off.
I created a Pawn for the cube and added movement functionality.
What should I do next? The tutorial video I found is about cars, but I don’t know enough to adapt it to my scenario. The example of what I want to achieve is shown in the image below.

I would appreciate any help or guidance on how to proceed. Thanks in advance!

1 Like

Anyone ?

It’s funny you created this gym because I have considered doing something similar at some point. You need to do the following:

  • Create the interactor BP - design the observation and actions that make sense (you should make your simple game playable by yourself as well)
    • Maybe do some downward angled raycasts to detect where the floor and the open areas are
  • Create the training environment BP - design the reward function
    • Reaching the goal is +1
    • Falling is -1
    • Timeout is -1

You really just need to copy the components of the racing environment and adjust the details to match, but overall the structure is the same.

Brendan

1 Like

If there is an example that I can examine, I would like to improve myself in this regard. I wonder if you have something like this available.

Sorry, not yet. It’s challenging to maintain a lot of examples while Learning Agents is still evolving. Once we switch to beta, I’m hoping we will have time to release more examples.