# Converting VR into AR - stereoscopic video inputs/rendering

**URL:** <https://forums.unrealengine.com/t/converting-vr-into-ar-stereoscopic-video-inputs-rendering/330463>\
**Category:** XR Development\
**Tags:** stereoscopic, stereo, unreal-engine, Augmented-Reality, Rendering, question\
**Created:** [August 31, 2015, 9:48am UTC](https://forums.unrealengine.com/t/converting-vr-into-ar-stereoscopic-video-inputs-rendering/330463 "2015-08-31T09:48:24Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ashray\_Malhotra](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@Ashray\_Malhotra](https://forums.unrealengine.com/u/Ashray_Malhotra)\
**Post date:** [August 31, 2015, 9:48am UTC](https://forums.unrealengine.com/t/converting-vr-into-ar-stereoscopic-video-inputs-rendering/330463/1 "2015-08-31T09:48:24Z")

</div>

Hello,

In my project I plan to convert DK2 into a AR device using stereo camera pair that I’ll stick in front of my HMD. Since this is my first time with VR and game engines, I have a basic question.

I cant seem to figure out **how to provide the input frames stream from the camera to the oculus display** (this sounds like such an easy thing to do but am facing troubles getting started). Note that I will have a stereo camera input, which means I am getting 2 video frames which I have to display on the left and right side of my HMD.

Thanks a lot for your help.

---

<div class="post-metadata">

**Author:** ![anonymous\_user\_c59986a6](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_c59986a6](https://forums.unrealengine.com/u/anonymous_user_c59986a6)\
**Post date:** [September 9, 2015, 11:22am UTC](https://forums.unrealengine.com/t/converting-vr-into-ar-stereoscopic-video-inputs-rendering/330463/2 "2015-09-09T11:22:55Z")

</div>

I’d recommend using OpenCV and write some C++ code to map the camera feed to a material/texture and use this to display each eyes image.  
Here is a sample project I found:

> **[AR implemented with OpenCV webcam capture drawn to dynamic texture](https://forums.unrealengine.com/showthread.php?61365-AR-implemented-with-OpenCV-webcam-capture-drawn-to-dynamic-texture)**
>
> Hi All, I’ve implemented a proof-of-concept of Augmented Reality in Unreal Engine using OpenCV webcam capture and drawing to a dynamic texture. You can see a screen capture of the example here: You can also see the source code on...

Hope this helps

---

<div class="post-metadata">

**Author:** ![anonymous\_user\_111c2c87](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_111c2c87](https://forums.unrealengine.com/u/anonymous_user_111c2c87)\
**Post date:** [January 16, 2017, 12:49pm UTC](https://forums.unrealengine.com/t/converting-vr-into-ar-stereoscopic-video-inputs-rendering/330463/3 "2017-01-16T12:49:01Z")

</div>

Hi,

I displayed 2 camera feeds on 2 cubes in UE4 using this tutorial about integrating OpenCV (it uses dynamic material) :

> **[A new, community-hosted Unreal Engine Wiki](https://forums.unrealengine.com/t/a-new-community-hosted-unreal-engine-wiki/141494)**
>
> After over a year in maintenance mode, the official Unreal Engine Wiki is now permanently offline. These resources now live on a new community-run Unreal Engine Community Wiki — https://unrealcommunity.wiki/! You will be able to find content from...

But still I don’t know how to display this camera feeds on oculus.

Any help would be appreciated.