It’s probably because your arm uses controller rotation.
On the client side only their own controller exists, so for others rotation will be 0.
This should fix it: