Metahuman to omniverse audio2face live link body animation

Development Character & Animation
, ,
1

Hi team ,
I am using Unreal engine 5.2 and omniverse audio2face 2023.1.1 live link connector .I will give the facial expression input from audio2face via connector ,the facial animation is working well in UE.
I want to add body animation while lip sync in unreal engine. Is there any way to add body animation in same time or documents ,videos available please guide me.

Thanks in advance.

2

The faical anims barely have anything to do with body anims except how the neck moves. I’ve noticed that audio2face will generate some little head moves while the character is talking. These anims should be additive, you can make AnimBP for metahuman body just like usual body AnimBP. But make sure to look over the Post Process AnimBP on body skeletal mesh.

3

Could you Please share, some reference video link or documents ? That will be more helpful.

4

have you found the answer? how to add body animation to metahuman, i use Audio2gesture, but can’t merge it to UE5 like Audio2Face, please help me please

6

hey there sorry for the late reply. I havent seen any good solution for generating body anims from audio. I think you might gonna do it in traditional way - prepare some anim seqs, build animbp on your own. or just record it with the help of metahuman. Audio2face have just developed livelink during this year afaik, maybe Audio2gesture can have livelink in the near future.