Character twitches when moving after using set actor rotation

Hey fellas! Im using simple inplace anim montage. Rotation goes great, but when character starts to move it turns a little at the beginning of the movement. Why is this happening? This only happens if im using set actor rotation.

I have a feeling its somehow related to actual character movement direction starting points which is not updated or something.

Basically its just:

  1. Set Actor Rotation
  2. PlayAnimMontage (without rootmotion in place)
  3. AI move To

Its same without point 2, so its just set actor rotation and ai move to.