Does anyone had the chance to explore the new Rigmapper in 5.7 to retarget facial animations? Documentation on how it works and how to implement it seems to be non-existent at the moment.
All the best
I went through all UE resurces and also searched the web but couldn’t find anything either. It was marked as “experimental” anyway so I guess that either the quality wasn’t good enough yet for the 5.7 release or it wasn’t high enough on the priority list.
If you’re also anticipating this feature as much as I and my team do, please also vote for it here:
1 Like
Good idea! Submitted my vote.
I dug a bit deeper into this topic and activated the “RigMapper Op” Plugin (Experimental) in UE 5.7.2. Before, I had simply checked the latest GitHub Source Code of UE for ARKit mentions within the RigMapper folders, but that folder seems to contain different files then the Plugin folder after activating the Plugin in UE. So much about me saying I had checked all resources in my previous post ;).
I found a couple of “RigMapper Definition” Files which seem to have rules for converting MH Animation data (CTRL_expressions) into other blendshape data (from 0 to 1). But none of the RigMapper Definition files I found does a conversion into the 52 ARKit Blendshapes.
What I did:
- Activated the “RigMapper Op” Plugin (Experimental)
- Activated all MetaHuman Plugins
- Click the Settings gear icon in the top-right corner of the Content Drawer and check Show Engine Content.
- In the Content Drawer I navigated to All/Engine/Plugins/Rig Mapper Content
- There are a 2 folders containing “Rig Mapper Definitions”: “Baked” and “Raw”
- I opened each of those Definition files and checked their content.
Five of them use MetaHumanAnimator expressions as input (e.g. “CTRL_expressions_browRaiseInL”)
-
RM_CDL_FNL
-
RM_MHL_FNL
-
RM_MHI_CDL
-
RM_CDL_CDH
-
RM_MHI_MHH
Unfortunately, none of them give you the exact 52 blendshapes as output, that are used by ARKit (and thus could control ARKit based character models using MHAnimator). They sometimes have poses and phonemes as the output and I wasn’t able to make sense when trying to use the files as a starting point to match all of the outputs to corresponding ARKit Blendshapes. I also can not make sense of all of the abreviations used. RM = Rig Mapper. But not sure about the others (CDL, FNL, MHI, CDH, MHH)
Does anyone else have an idea on how to proceed or if there is an ARKit RigMapper Definition file?
Screenshot of the RM_CDL_FNL file:
