Parallax Shader question

Hi everyone,

from what I reckon there is no automatic support for parallax normal mapping, you need to roll your own shading (like the various bricks already in the starter content pack).

What I’d like to do is:
having a height map and two images (L-R stereo pair from a movie) is there any way to fake parallax and fill the holes behind foregroud parts with that additional information?
I’m thinking about some holographic display inside a room. Eventually I’d love to shoot the footage and have players interact with it.

Is there some paper or something that illustrates how it could be done?

Thanks in advance.


A little bump. Anyone got some literature?