Hi!
That’s right, the shift is not quite correct using this approach.
Tell me is it important for you to have realtime changing shadows or do you have projects related to archviz?
In fact, there is a good solution, you can bake light and shadows using GPU LightMass, and then use the correct OMNI mode for rendering.
But of course in this case we can’t talk about dynamically changing objects, but you will get fast rendering and correct stereo.
I’m still looking for a solution to implement realtime stereo raytracing, but I’m stuck on some complexities.