Free look not working correctly in multiplayer - play as client

So I’m currently trying to get a free look camera to work, I have got it working as it should for a single player type thing, but I can’t figure out how to get it to work for the multiplayer side.

The problem is that when I’m use the free look the player I’m controlling will stand in place and the camera rotates around said player, but the current possessed player is still turning on the second clients screen as if the use controller rotation function is not working.
I have tried to use a switch has authority and get the logic of controller rotation to only be used on the client, tried with all replications and still cant figure out what I’m missing.