Flying actor Rotates along Z axis as well as goes up on Z axis?

Using Add Movement Input is tricky. Have you tried using Add Force in the character movement? It allows you to go straight up, regardless of the orientations, both from the character and the controller.