Spectating from a client is jerky in multiplayer

Any fix on this? It happens to me on a third person character too.