Problem with LAN multiplayer VR


I am having trouble with a joining player correctly possessing a pawn when joining the host. Right now the host can setup a server and a second player can join. The player who hosts the server have a fully working pawn (teleportation and grabbing objects etc). The joining player is able to see their hands and look around but cannot teleport anywhere. The joined player can see the host moving, but not vice versa.

Right now I think the problem is inside the join blueprint (See attached image 1).
I also have a custom GameMode which holds some of the player spawn information as well (See attached image 2).

Thankful for any type of help.