Metahuman Processing Depth Plugin for HMC Not Working

Summary

I’m unable to process HMC footage using the new depth plugin in unreal 5.6

Please select what you are reporting on:

Creative

What Type of Bug are you experiencing?

Other

Steps to Reproduce

Repro process.
Load HMC ID and performance footage using metahuman capture source (going though live link hub doesn’t bring though the audio). I did this again on another machine and had to enable ffmpeg. With and without ffmpeg the results were the same. → Create Metahuman ID → Create Metahuman Performance. When trying to select the performance file and ID I’m unable to process the data (it says “To enable this option set a valid Footage Capture Data property of this Performance in the Details panel. Sequence asset is invalid”). The start and end frame to process is locked to 0. It can’t be change.

Expected Result

Metahuman processes HMC footage.

Observed Result

Unreal crashes or the process button is greyed out

Platform(s)

windows

Additional Notes

Is there a guide how to use the new depth plugin (MetaHuman Animator Depth Processing Plugin | Fab) when using HMC footage?

Issues I’ve overcome:

  1. When uploading the footage using live link hub it got stuck on 75% and would then fail. Restarting my PC fixed the issue. However it was still missing the audio.

  2. When uploading the data using live link hub and then trying to create a metahuman ID it wouldn’t work. To get around this I ingested the data using the metahuman capture source.

  3. When ingesting the data into unreal. I would upload the top, bot and depth images. Doing all this at once would cause unreal to crash so I imported them one at a time.

Does anyone have any experience getting HMC to work with this new plugin? I’ve tried on 2 different PCs and still no luck.