Client freecam cannot be controlled

I have a freecam CameraCharacter in my game that has a movement component. This is the main viewpoint for a 3d puzzle game.

This works fine for single player however in multiplayer trying to move the camera with AddMovementInput does nothing on the client side. I’ve disabled Replicates and also tried calling TearOff in beginplay but not matter what the client can’t move the camera.

What needs to be done to just have this camera be local for all players?