Retargeting face data stream from Live link face app

Development Character & Animation
, , , , , ,
1

Hi everyone

For my thesis I decided to work with metahumans in Unreal engine and got stuck on an issue.
I am working in Unreal Engine 5.3 and have a metahuman (also 5.3) who I animate using Vicon Shogun livestreaming data to unreal and the Live Link Face App on iPhone.

In a specific level I want my metahuman to have all facial expressions shown whilst on another I want all facial expressions except for any eyebrow movements.

For this I already found the useful Blendshape data overlay in the app, showing me the keys used for eyebrow movements. I should just disable BrowDownLeft, BrowDownRight, BrowInnerUp, BrowOuterUpLeft, BrowOuterUpRight. I found online I might need to retarget the data coming in from the app to then put this retarget on the metahuman but this is were I get stuck.

How can I disable these specific parts of data and keep them 0? I cannot really seem to find any retarget option for the ARkit as there is for the LiveLink of the body.

Thanks you so much in advance!

  • Allys
2

You can do the following:

  • Modify the mh_arkit_mapping_pose asset and remove the eyebrow poses
  • Use Modify Curve node, right click on the node and at the very bottom you’ll see Add Curve Pin, search for your blenshape name, add it set the value to be 0.
3

Hi
Thank you so much for answering!

  • For the first option I am guessing this removes all eyebrow movement for all metahumans in the scene? I would like to be able to toggle it easily so in the worst case I’ll make 2 project with one having the eyebrows and the other one not having them.
  • Where can I add the Modify Curve node?
4

Hey, regarding the answers:

  • You can duplicate the mh_arkit asset and use a blend node with a boolean that allows you to toggle between the original version and the version without the eyebrows curves.
  • You can use the Modify Node in the Face_ABP AnimGraph.
1 Like