So I did not use Your variant, but after studying it, it gave me some ideas, so I just rewrote the code anew and I believe the key change was inverting the vector just as it was created, during backward motion. I am attaching the blueprint pictures that work for me. Also note, I am not using pawn movement component.
Regards!