I used a simple move to actor which will allow the ghost to always follow the player on begin. This one works fine when I am using the default agent radius of 35 but that would lead to the ghosts getting stuck around corners.