You should use the provided enableSmoothSync method when turning Smooth Sync off and on. It does so in a networked way, as well as handling clearing the state buffer and some other clean up.
If you do want to enable and disable SmoothSync only locally, without using enableSmoothSync, then you should at least make sure to call clearBuffer after enabling.
Let me know if you still have issues after trying that.