Smooth transition when enabling use controller rotation yaw

I’m trying to have a little smooth transition between 2 modes with using the controller rotation yaw but whenever i activate it, the character snaps to the camera view


I tried taking the difference between the camera and the character yaw to try interpolating them but with no succes