🔥 [UE-Store] Real-time Full Body tracking for UE5 [Nuitrack][PLUGIN]

@Noah.Norman
Plugin Updated :rocket: (fixed compatibility with the latest version of Nuitrack)

:fire: :fire: :fire:Nuitrack Kinect v2 :camera_flash: Update is available! (0.37.15) :fire: :fire: :fire:

Hey, thank you so much for this amazing plugin! Its just what I (and im sure a lot of other creative technologists) was looking for :slight_smile: I followed your tutorial for ‘How To Animate Avatar UE’ and for some reason custom avatars do not work with my Intel Real Sense D415 and I get thrown a load of Blueprint errors. Can we expect a video tutorial or a simpler version of this process?

Hello @CSVisuals
Yes, we plan to simplify the configuration of avatars and release tutorials, including video tutorials.
Do I understand correctly that the avatar from our example is working fine?

1 Like

:bangbang: If someone has problems with the visibility of samples and prefabs, try to do it as in the screenshot

Hey yep! Your default avatar example works fine and I even completed the first ‘AnimationBlueprint’ part with no issues. But all the errors seem to be from making a child of the ‘BP_AvatarMannequinBlueprint.’

Hey! Is there a way to use Facial Analysis age and emotion detection directly in Unreal or do we have to code it around?

The video feed and tracking always stops (with a still frame) after about 2 secs in Unreal samples. UE 5.2, Nuitrack 0.37.17. Tried run as admin, but the same.

Hello @Turbo_Papok

Are there any messages in the logs?
You probably don’t have any license activated.

If there is no license, the operating time is ~3 seconds
If the License is Trial, the working time is ~3 minutes
If the License is AI, the working time is unlimited

Open the Nuitrack Activation Tool (C:\Program Files\Nuitrack\nuitrack\nuitrack\activation_tool\Nuitrack.exe) and select your sensor, to see which license is currently in use

At the moment, you can get this data in JSON format through the code
https://github.com/3DiVi/nuitrack-sdk/blob/master/doc/Instance-based_API.md#getting-information-about-instances

I have a trial license activated for this sensor.

@Turbo_Papok
Do I understand correctly that the editor does NOT freeze completely and does not crash? It’s just that the sensor stops working after fiew seconds.
Which sensor are you using?
And

Are there any messages in the logs?

Ok, I get it now. It is a Trial time is over error. It appears I have a problem with activation of trial license: Activation error: C:\Program Files\Nuitrack\nuitrack\nuitrack/data/license.json: cannot open file

so the test mode in nuitrack app works good, but unreal not :confused:

I even bought a subscription license, but it doesn’t work too.

Screenshot 2024-05-17 194250

EDIT: OK, got it. Just had to run Nuitrack as admin to activate. Would be good to put it in FAQ.

1 Like

In the SkeletonJoints (In Engine Plugin Content folder) sample, you can see several skeletons at once :bangbang:

Note: The maximum number of people tracked is 6. But not all sensors and use cases can work effectively with so many people, so the recommended number of users is 2

:eyes: Check out our new demo. Nuitrack + Nextgen Graphics :bangbang:

:fire: :fire: :fire: Promo code inside :fire: :fire: :fire:

:tv: We also plan to upload videos to our TikTok :watch: channel. We will not publish videos there very often and rather it will be entertainment content (there are no plans to publish tutorials there yet)
If you like this format, then you can subscribe here
:arrow_right: https://www.tiktok.com/@nuitrack

There were a lot of questions about working with Azure Kinect. Nuitrack version 0.37.24 has improved operation with this sensor.

https://github.com/3DiVi/nuitrack-sdk/blob/v0.37.24/Platforms/nuitrack-windows-x64.exe

If you have any more questions about this sensor, do not hesitate to write here or to any other communication channel with Nuitrack

:fire: Nuitrack x Persee
Get Bundle

(at the start, only the Unity plugin is officially supported. UE is planned to be added in the near future)

Hey folks! Great plugin and app, first of all! Keep up the good work!
Couple of questions, though:

  1. Are there any settings I can edit inside the *.config file in order to use the Kinect 2 in a vertical position?
  2. Tried the fitting room demo and the t-shirt come out all wonky (please see attached photo). My best guess so far is that one of the bones is not properly translated from an older version of the plugin, but I thought I’d ask the experts prior to start fiddling with it.
  3. What’s a good practice to start importing new clothes items? Is there a simple way of adding rigid meshes for clothing? (like a sword attached to the hip bone, or a rigid cape)

Could this be the issue in my point 2 (t-shirt related), that in BP_ClothAvatar there are only 11 joints, while in AB_T-Shirt_Skeleton_AnimBlueprint there are 13 joints?