Learning Agents Project Doesn't Work as Expected

enesQwerty3
Sun, 23 Feb 2025 18:50:34 +0000
Blueprint

Hi, I’m working on a Learning Agents project in Unreal Engine 5.4 as my graduation project but I have a problem and I don’t know where I’m doing mistake. I need your help guys. I have to finish this project as soon as possible.

Case

There is an agent and my goal is make agent to follow the player until distance between agent and player is 2 meter. And rotate agent’s direction towards the player.

Problem

Rotating work fine after training for 15 mins but movement doesn’t work well even for 2 hours training.

Specify Agent Observation

1-Specify agent location and direction observation.

2-Specify player location and direction observation.

Gather Agent Observation

1-Gather agent location and direction observation

2- Gather player location and direction observation

This Player Pos and Player Direction (which is normalized player location - agent location vector) values are updating in agent’s tick function.

Specify Agent Action

These are the specified agent actions.

Perform Agent Action

This how I perform action values.

1-Direction

2-Movement

Gather Agent Reward

1- Direction reward

2-Movement reward
These bool variables are updating in agents tick function to determine if agent moving towards player or away from player.

Agent Tick Function

Beside this movement rewards I’ve tried make reward on location difference above threshold and make reward on location similarity functions separately but both didn’t work as expected. Even after 2 hours of training when I run inference agents were moving off from player to a no sense direction.

3 posts - 2 participants