Turning back to 0,0,0 whenever I move to fly?

I think your idea of turning off orientaton when flying is worth a try…