For anyone who encounters this problem, this is the solution.
Before turning on Orient Rotation to Movement you set a new Control Rotation. For this you also need to enable and disable Use Controller Desired Rotation as shown.
Essentially when Orient Rotation is ON, your Controller Rotation doesn’t update, so you need to do so before using it again.