Hi!
Hopefully, I will post this in the right section. I’ve been using Mediapipe to record hand movements lately, and I want to translate those pre-recordings into Unreal Engine. From the recording I get a CSV file with 15 different Landmarks (points on the hand) with their respective x,y,z positions and every row is a different frame.
I created a struct that can read every row and retrieve every value. My problem is that the movement is incorrect when I want to bring it into my Hand skeleton (the default UE hand), and I can’t get the rotation to work .
This is what I have so far, but I would like to know if someone has a better approach to this problem:
- Getting the files into a script
- Normalizing the values to make some movement happen
- Bringing those values to an Animation Blueprint and using Transform Bone, applying a Transform that adds to the existing and a rotation that replaces it.
- The vectors are made from 2 landmark positions
- Applying that into a UE default hand skeleton
Hopefully, someone can shove me onto the right track. Thanks in advance!