UE5.4 Source advanced sessions plugin-joining session does not throw player in the world

I’m making a game using ue5.4 source and I’m trying to set up the advanced session plugin with steam.
I can successfully join session of other players but i don’t get thrown in to their world.
I do have my own game on steam so I’m not using the default 480 id.
I’ve tried enabling and disabling the bInitServerOnClient in defaultengine.ini file but nothing changed.
Any help is appreciated