# AR Occlusion with Webcam Input UE4-27

**URL:** <https://forums.unrealengine.com/t/ar-occlusion-with-webcam-input-ue4-27/510392>\
**Category:** Virtual Production\
**Tags:** unreal-engine, UE4-27, question\
**Created:** [March 28, 2022, 4:47pm UTC](https://forums.unrealengine.com/t/ar-occlusion-with-webcam-input-ue4-27/510392 "2022-03-28T16:47:11Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Anonymous\_Mascot](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@Anonymous\_Mascot](https://forums.unrealengine.com/u/Anonymous_Mascot)\
**Post date:** [March 28, 2022, 4:47pm UTC](https://forums.unrealengine.com/t/ar-occlusion-with-webcam-input-ue4-27/510392/1 "2022-03-28T16:47:11Z")

</div>

I am using a realsense camera to get a live feed to which I want to add cg elements which I can interact with. This includes occluding cg elements which may be behind the user.  
Is there any tutorial to achieve this?

Note: I don’t want to use green screens and need to achieve an interactive AR experience.

---

<div class="post-metadata">

**Author:** ![Nuitrack](https://d1ap1mz92jnks1.cloudfront.net/user_avatar/forums.unrealengine.com/nuitrack/32/1095757_2.png) [@Nuitrack](https://forums.unrealengine.com/u/Nuitrack)\
**Post date:** [October 19, 2023, 7:15am UTC](https://forums.unrealengine.com/t/ar-occlusion-with-webcam-input-ue4-27/510392/2 "2023-10-19T07:15:21Z")

</div>

It’s probably too late, but if someone is faced with a similar task, then there are AR examples in this plugin

> [@Full Body tracking for UE5 in real-time and 3D sensors support \[Nuitrack\]\[PLUGIN\]\[FAB\]](https://forums.unrealengine.com/t/tutorial-plugin-real-time-body-tracking-for-ue5-nuitrack/1331349):
>
> right_arrow [Information about the latest update](https://forums.unrealengine.com/t/ue-store-real-time-full-body-tracking-for-ue5-nuitrack-plugin/1331349/86) [Nuitrack\_ue\_plugin169] arrow_right Download plugin: [Information about the latest update](https://forums.unrealengine.com/t/ue-store-real-time-full-body-tracking-for-ue5-nuitrack-plugin/1331349/86)collision If problems occur, read the Troubleshooting section carefully We’re happy to present our real-time body tracking for Unreal Engine 5. It could be used without writing any code, simply connecting Nodes in Blueprints computer It’s perfect for developing games video_game, fitness apps basketball_man and other interactive projects with …

[![](https://d3kjluh73b9h9o.cloudfront.net/original/4X/d/4/b/d4bb9319d9a261650b5ebc1ae7303b0113c4159c.jpeg "Body Tracking Blueprints For Unreal Engine 5 | How to Start") ](https://www.youtube.com/watch?v=oGu3yIf6s9Q)

---

<div class="post-metadata">

**Author:** ![a\_flyin\_hobo](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@a\_flyin\_hobo](https://forums.unrealengine.com/u/a_flyin_hobo)\
**Post date:** [December 25, 2024, 12:31am UTC](https://forums.unrealengine.com/t/ar-occlusion-with-webcam-input-ue4-27/510392/3 "2024-12-25T00:31:32Z")

</div>

@Nuitrack are you able to elaborate on the specifics to set up AR Occlusion with the plugin? Thanks and happy holidays!

---

<div class="post-metadata">

**Author:** ![a\_flyin\_hobo](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@a\_flyin\_hobo](https://forums.unrealengine.com/u/a_flyin_hobo)\
**Post date:** [January 7, 2025, 9:04pm UTC](https://forums.unrealengine.com/t/ar-occlusion-with-webcam-input-ue4-27/510392/4 "2025-01-07T21:04:47Z")

</div>

@Nuitrack Hi, we are still unable to replicate the occluder effect of the users arms and face masking out the clothes like in your demo, and this does not seem to be part of the Fitting Room example.

Can you say how this was achieved? Thanks!

 ![image](https://d3kjluh73b9h9o.cloudfront.net/original/4X/b/7/b/b7b1c1804ccc4073296516f243c7adf21bae41f1.jpeg)

---

<div class="post-metadata">

**Author:** ![Nuitrack](https://d1ap1mz92jnks1.cloudfront.net/user_avatar/forums.unrealengine.com/nuitrack/32/1095757_2.png) [@Nuitrack](https://forums.unrealengine.com/u/Nuitrack)\
**Post date:** [January 24, 2025, 1:14pm UTC](https://forums.unrealengine.com/t/ar-occlusion-with-webcam-input-ue4-27/510392/5 "2025-01-24T13:14:50Z")

</div>

Hello @a_flyin_hobo

It is better to ask questions in our topic  
[https://forums.unrealengine.com/t/ue-store-real-time-full-body-tracking-for-ue5-nuitrack-plugin/1331349](https://forums.unrealengine.com/t/ue-store-real-time-full-body-tracking-for-ue5-nuitrack-plugin/1331349)

Based on the depth data, a mesh is built and colored based on RGB data.

Unfortunately, this is not part of the plugin yet, but we will definitely add it in the future.
