Since you also mention highlights, you can actually basically see what I’m talking about just in the VR preview on the desktop, because the shimmering from the scaled down preview is much like what you see in the headset (and this is while shaders were recalculating for forward, so there’s just the checkerboard material on everything):
https://i.imgur.com/yRksYHp.gif
I believe it’s the micro head movements that you constantly do that makes the problem way, way worse than if you use a smoothly controlled camera as in traditional desktop 3D applications.