Ok, solved. The issue was constant replication, I resolved this by using client-side prediction and update the location if the margin was great enough.
Here’s reference for those who need help making a custom movement system that’s multiplayer ready (kind of). Still not optimized, but I’ll try to keep this up to date.