Hi!
I’m trying to make some kind of an AR experience. I saw many interesting AR projects on UE (for example AR implemented with OpenCV webcam capture drawn to dynamic texture - VR and AR Development - Unreal Engine Forums), but i didn’t found any information about using 2 cameras for more realistic expereince. In the previous link, the author uses a plot to render image from one camera, then he lays on the “augment” part. Is there any way to implement 2 cameras to get more realistic image?
Thanks in advance
I’ve implemented passthrough camera for the leap motion plugin. This uses the leap’s raw image output (left and right infrared images 4cm apart) and it is warped in shader to account for distortions giving you a close to 1:1 stereoscopic passthrough experience at 8cm forward from your eyes with an IPD of 40mm.
The plugin is open source and thoroughly documented so you can look at both the c++ sources and blueprints on how to fetch images, push them to the engine, use a postprocess shader to undistort, crop to match HMD FOV and finally use horizontal screen position to send left image to the left eye and the right image to the right eye for your HMD.
Finally you can use e.g. custom depth to render things on top of your augmented view.