How to Animate a 3D Animal Model in Unreal Engine Using Predicted Actions and Durations from ML Model?

Development Programming & Scripting
, , , ,
1

I’m working on a project where I developed an ML model that predicts an animal’s next action (e.g., walking, running, idle) and the duration for that action. I’d like to use these predictions to animate my 3D animal model in Unreal Engine based on the action and duration outputs from the model.

I’m familiar with getting model predictions in Python, but I’m looking for guidance on:

  1. How to bring the output (action + duration) from my model into Unreal Engine.
  2. How to animate the animal model in Blueprints to perform the specified action for the given duration.

Any advice on the best approach or any tutorials for similar cases would be a huge help! Thanks in advance! :blush:

1 Like
2

If you have UE 5.4, then use the 5.4 tutorial to learn about learning agents first:

(I’m working on the 5.5 version of the tutorial which has some small breaking - UE 5.5 came out today!)