I am using a realsense camera to get a live feed to which I want to add cg elements which I can interact with. This includes occluding cg elements which may be behind the user.
Is there any tutorial to achieve this?
Note: I don’t want to use green screens and need to achieve an interactive AR experience.
It’s probably too late, but if someone is faced with a similar task, then there are AR examples in this plugin
@Nuitrack are you able to elaborate on the specifics to set up AR Occlusion with the plugin? Thanks and happy holidays!
@Nuitrack Hi, we are still unable to replicate the occluder effect of the users arms and face masking out the clothes like in your demo, and this does not seem to be part of the Fitting Room example.
Can you say how this was achieved? Thanks!
Hello @kotavy
It is better to ask questions in our topic
https://forums.unrealengine.com/t/ue-store-real-time-full-body-tracking-for-ue5-nuitrack-plugin/1331349
Based on the depth data, a mesh is built and colored based on RGB data.
Unfortunately, this is not part of the plugin yet, but we will definitely add it in the future.
