Virtual Camera + Green Screen + ARKit people occlusion?

Hi all,

We would like achieve ARKit people occlusion in ue4 with iPad/iPhone drove virtual camera. Our set has green screen with the human actors and we would like to add them to the Unreal environment with an iPad virtual camera. It would be the best if we could use the camera of the iPad for the input video feed too so we don’t have to attach an external camera to the iPad.

Is this possible at all?

If so then how can one access the camera feed of the iPad and use people occlusion without building a standalone iOS app?


Take a look at NDI Tools for importing video from iPhone/iPad into Unrela. I think this videos covers some of this. There are others.