Server Travel in Dedicated Server

I am currently working on a Dedicated Server system that when a player joins a server it puts them into a lobby level. Once enough players have joined it is set to transition to whatever level the server has set depending on the hopper data.
The issue I am having is if I use the ?listen command on server travel, when player move from the Lobby to the Gameplay map, I get errors and unexpected behavior, such as player not possessing their characters. However if I just do a standard Server Travel without a ?listen I also get errors.
Ultimately I need to be able to set it up so players load into the Dedicated Server lobby via IP (working) then the server opens the gameplay map and set Game Mode.

Issue appears to be related to my AI, not Server Travel, that is working as intended.