Right. I have the server gamemode calling a few functions on the player controller on post login. I needed this not to happen when the client is not connected to the server. Therefore I needed to disable the gamemode on the client in the editor but not the server by having two different game modes.
I basically found a workaround by using overrides in the world settings.