if you are having that issue look at the Mitch’s tutorial for Stereo Layers.
AT least I had to do a workaround where I use tracker locked with offset. I used world locked in an aircraft HUD and when the aircraft rotated there was odd float on the Stereo Layers (HUD). It was somewhere acknowledged to be a bug.
tutorial here:
at least on 4.24 I had to do this.