Is there a way to determine when training starts in Learning Agents?

kromkh8
Sun, 15 Dec 2024 01:59:38 +0000
Blueprint

When using Learning Agents for training, is there a way to determine when training starts? I am conducting reinforcement learning using Learning Agents and have created a blueprint based on the ‘Learning to drive’ tutorial provided by Learning Agents. However, I feel that it is somewhat difficult and less flexible for my use case (I am redesigning the internal logic of the PPO model and plan to use multiple models simultaneously, which makes it challenging to achieve solely with Learning Agents). I aim to retain the structure of Learning Agents while performing training externally through a Python file.

In this setup, I use the Interactor to receive observation values, calculate action values in the Python file, and then pass the reward to the Python file to construct a buffer. Since the training framework itself remains based on Learning Agents, I want to trigger the Python file to start training as well when data training actually begins. However, even when using the IsTraining property of the trainer, it continuously returns true, making it impossible to detect when training starts.

I am working entirely with blueprints in version 5.3. Is there a way to determine when training starts?

2 posts - 2 participants