Hi,
I tried out the Face AR Sample project and it worked beautifully with my iPhone. The hard part is to make 63+ morph targets / blendshapes for the 3D characters.
Is there a plugin or tool to automatically generate the blendshapes required for live link to work?
Currently, I’m making the blendshapes manually in Maya and some scripting helped. But it’s still pretty time consuming depending on the workload.
If you use blender, you can try faceit.
If you use Daz3d, you can use facemojo
https://www.daz3d.com/face-mojo--facial-mocap-retargeting-genesis-3-and-8-bundle
or facemotion
or faceshifter, which is free
Didn’t know about other dcc tools though.
Here’s a video and info how Kite and Lightning do it. iPhone X Facial Capture test PART 4 - GAME CHARACTERS - YouTube
Thank you, fengkan! These resources were very useful and the output is great.
I ended up buying FaceIt and FaceMojo! Worth the price!
Blender FaceIt
FaceMojo
I’m curious how FaceIt generated ARKit blend shapes can be imported into UE and used with Live Link, similar to Metahuman Animator. I found tutorials on how to import the animations and set them up inside Blender, but not within Unreal Engine, does anyone have any pointers?
Hi, just a heads-up! There’s a new page with high-quality references and a detailed guide on creating ARKit’s 52 facial blendshapes:
Hi everyone! Just wanted to let those interested know that we’ve made some updates to the
ARKit 52 facial blendshapes guide.
We’ve added a way to visually understand each muscle group that contributes to the face animation, along with a few other small improvements.
We hope you find it useful! Please share your feedback with us so we can continue improving the guide for you and everyone else.