Combining body mocap with face animation sequence and maintain body movements

[joelmendez97]

Hey there!

I’m trying to combine body motion capture & separate facial motion capture together.
I am able to get the mocap in great.

Here’s my simple blueprint. I have a body mesh and a separate face mesh.

Here’s my event graph for getting my rotation switch from my head graph.

Here’s my event graph for getting my head rotation from Live-Link.

Here’s part 1 of my Anim Graph on my head animation blueprint. You ca see where I set up the blend mask. On my head skeletal mesh, I set up the head as 1 for its blend mask while the other bones are set to 0.

Here’s the second part of the graph.

2022-12-26 16-21-33_1|video

I took a capture. As you can see, the livelink works great, it’s playing off the mocap. Yet when I want to play the sequence, it doesn’t work. It leaves the parented part of the mesh. Yet if I leave it at blueprint mode, the head is correct but it doesn’t have any my face curves.

I have a metahuman and it works on the meta. I can slide the face anim track while the body is moving, but they don’t break.

Anyone could help?

I have tried these forums:

Metahuman: combining facial and body animation in sequencer without losing head rotation data

Hi there, could we please have documentation on the topic of combining facial and body animation of Metahumans in sequencer without losing head rotation data. It seems like a very trivial task which should be easy to accomplish, yet I’ve been stuck on it for weeks, and none of the Metahuman videos cover that specific topic. I have a facial animation from Live Link, WITH head rotation data, I have a walk cycle, I would simply like to combine it with the facial animation. If the head mesh uses t…

Body animation seq + Metahuman Facerig combining

Take a look at the Metahuman Face AnimBP. You’ll see that you have a Copy Pose from Mesh that, in short, copy the animation from the body, then a Layered blend per bone allows you to apply an animation ( or realtime animation ) on the neck joints and up ( so the entire facial rig ). [image] Follow this as an example and you’ll achieve what you want to do

As well as taken bits from these tutorials

Building Modular Characters in Unreal Engine | Unreal Fest 2022

(30 minutes they talk about faces)

Combining body and facial animations for Metahuman in Unreal Engine 5

Combine Face and Body Animations - Metahumans in Unreal Engine 5 .1

But I still have yet to find a solution. Been at this for a few days. I feel close but not sure… any help would be greatly, greatly appreciated. As I said. Live link face IOS works great, but when I add a separate animation track onto the sequencer it doesn’t have any data.
!

[Jeremiah3D (Jeremiah)]

Is the Face AnimBP assigned as a Post Process Anim BP?

[joelmendez97]

No it is not assigned as a postprocess bp. I assigned the head just now and changed the node to an input node instead of a copy pose from mesh node. I still see the same result where the animation track removes the head from the body. I feel like it is something to do with how my AnimGraph is set up. I want to be able to Livelink during a specific pose, and for the animation sequence track to move and stick to the rest of the body. I feel like every part the graph references the livelink and there needs to be some switch to tell it stick with copy pose from mesh.

also, thanks for the reply!

[joelmendez97]

I was looking at the face animation bp on the metahuman head, and I saw this mapping node on the face. Along with the curve data. I was going to try and create a map asset with this sequence.

When I make the pose-asset though I’m getting some funky stuff with the first poses, it looks like it’s moving the whole body.

But I was going to see if I could replicate that part of the Metahuman bp.

EDIT: it looks like it’s because it is making a pose for every frame. This animation sequence is 351.

[joelmendez97]

any info on where i could get more info on how the metahuman master pose is set-up?

i think this might help me

[joelmendez97]

@Jeremiah3D
Responding here because I figured it out!

My graph was missing a slot node!!!
Added that in and now my body is moving with the sequencer.