Camera rig does not replicate rotation offset to server but to all clients

You mean, switching to one rig and then back to the other makes it work?

Could you post your setup please?