LED Wall Portal / Window - Vive Tracker Head Tracking

Hi,

We have a large LED wall setup at our studio and I have an idea to be able to use this as a portal / window into the Unreal Engine environment.

My idea would be to attach a Vive tracker on the top of the persons head in order to track their head movement and orientation. With the head tracking information it must be possible to then produce a sense of depth into the LED wall by changing the camera POV and transform. Thus creating the sense of a portal / window into the Unreal environment.

This would obviously use the nDisplay and Virtual Production tools but struggling to find a starting point. Any help would be appreciated.

Thanks,
Chris