Chaos Vehicle Replication, turning off "Replicate Physics to Autonomous Proxy" causes desync between client and server

Having “Replicate Physics to Autonomous Proxy” on the mesh component causes this desync. How can I fix this or is there any other way to replicate Chaos vehicles without having to replicate physics as its too jittery