Facial tracking

[anonymous_user_6cc1e35a]

@BarisT;342566

https://unreal.facefx.com/

This is not facial tracking though, facial animation plug-in

Thank you for the link. But the demo of this plugin on youtube is quite useless… Is there anyone who understood what was going on in this video?

It is very strange that today there is only one NOT FREE BETA plugin for UE4.
There are at least 3 plugins for Unity3d. And they are all free and much more advanced.

@Nicolas3D;342572

We’re at least 2 years for that to be a reality.
Realtime facial tracking currently lacks proper cameras ( no 60fps to be seen around so goodbye proper lipsync, unless you use a GoPro with a proper usb/hdmi converter ) and technology, even if Faceware is about to release the tech for everyone to use.

Simply put you might want to record an animation and then import into UE4, because direct input ( without any proper tweaking/smoothing and so on ) will look like ****.

Also, facial movement are way too subtle and a 2d image wont capture all the expressions…when 4D scan will be processed in realtime then we can talk about something incredible

If you want achieve a good quality use depth cameras.
I said that I don’t want to record animation. I just want to transmitt tracking data from my kinect to UE and apply it to a 3d model in real-time. Direct input looks very nice in case of plugins for Unity3d. I recommend you to try microsoft kinect sdk.

It seems that there is no reason to move from Unity to UE4 just only to get best graphics.