Hey @MaximeDupart ,
How long do you think it would take to incorporate the missing machine learning steps?
I don’t have any time to do that in the near future tbh.
I tried to make a Pull Request for the changes we made to get Android Face Capture to work with UE5, but I do not have permissions to push a new branch. Github only gives me the options to either, 1. fork the repository, 2. skip pushing the branch, or 3. cancel.
Should I fork the repo, or are you able to grant me permission to push our branch? My Github username is
@rforman95 You will need to do a fork in GitHub and then do a Pull Request.
Hello, Can you add some human emxaple? thank
Hi folks, I’m really new to Unreal and just stared to learn the basics, but is currently doing some research work on face capture and virtual charactor platforms and solutions, thanks so much for creating this really cool demo!
Now I’ve been able to open the project with UE5, and have the dot face moving, but tried lots of things but couldn’t make the metahuman work like @VertexDesign (tried the following steps mentioned here Cannot drive metahuman face and head · Issue #3 · MaximeDup/FaceCaptureUnrealEngine · GitHub). Sadly I only have an android phone, and really wanted to make this work!!
@rforman95 I see that you have resolved the issues with the compaibility with UE5 and able to make it work, could you please share the updated code on you own repo so that I can take a look, really appreciated!!
1 Like
Hello. Great job! I’m currently trying to implement something similar, I want to add blendshapes for ARCoreFaceMeshComponent, like AppleARKitFaceMeshComponent, I ran into one problem, how do you solve the problem of distortion ? if you look directly at the camera, and turn your head or move away from the camera, the mesh is distorted, and it’s extremely problematic to check not only poses, even distances between vertices, but this problem seems to be solved in your plugin, can you briefly explain the method? or give me a tip, thanks in advance!
Please make software to connect Kinect Xbox to Metahuman
We have made an app based on MediaPipe to do facial and motion capture using a webcam or video files, here is the method to animate MetaHuman,
2 Likes