Main goal need Full body tracking in unreal Using mediapipe & able to setup up the character movement (unreal character / meta human )

Main goal need Full body tracking in unreal Using mediapipe & able to setup up the character movement (unreal character / meta human )

similar to this https://www.youtube.com/watch?v=fFsvNz0JJsg

1.we have setup in way that mediapipe is in the server we receive values in unreal via webrtc
2.we are trying to manipulate the unreal Skelton based on these values
3.but these are only location points & not the rotation points
4.here we are unable to set the proper character movements as we don’t have rotations / clarity on math calculations

we are receiving data from mediapipe to unreal & we need those values to set the character for character movement

Hi, it may not be exactly what you’re looking for, but we’ve developed a motion capture program based on MediaPipe. You can easily integrate it with any Unreal Engine character. You can see an example of it working with MetaHuman here.

1 Like