Smooth Sync: Sync your Transforms Smoothly across the network

Hey I have a very simple cube pawn with movement forward and backward using set actor location in tick based on input * speed. Anyway anytime i change direction from forward to back smoothsync stops syncing until i stop moving. This happens on both server and client (only tested in pie). Any idea what would cause this?

Using 4.25.4 and latest plugin.