Just a wild guess, maybe you are accessing the wrong playercontroller somewhere on the Server? Keep in mind that the server has references to all playercontrollers of all clients, so always accessing the first one would be wrong.
Or maybe it is this one here, which is an issue I’m currently facing https://answers.unrealengine.com/questions/160332/whats-causing-a-pcswap-network-message.html