Currently is it possible create a system that creates a realistic avatar from an image within UE5 ?

Development Character & Animation
, , , ,
1

This system is already implemented by Reallusion, Daz Studio, Ready Player Me, and I was wondering if it can be build within UE5.

2

Hey @BallchinMafia

I do not think that there is a one click feature for this in UE but what you can do:

  • Create a MetaHuman from reference photos
  • Create a MetaHuman from a 3D character mesh

First option requires some work by you in the MetaHuman editor, second option requires you to create a lot of photos of your head from different angles to create a mesh of your head (photogrammetry) and a “little bit” more work

1 Like
3

Feed it an image - generate a model?
Absolutely not in engine and not even on desktop.

Feed Meshroom 360 or so images and generate a somewhat OK textured model? Sure. But it wont be as perfect as taking a face scan with a simultaneous shot from specifically set up cameras.

Either way, there is no way to achieve this with any sort of detail within the engine - and particulalry not a runtime within an executable.

You’d have to design a mesh building system to achieve something like it…

4

Hey @BallchinMafia, welcome to the forums!
There is an iOS app that you can live link to unreal with:

That’s all I know about it other than using MetHuman.
I hope this can help,
-Zen

5

not from an image
from a mesh.

so you would have to use a image to mesh prog or photogrammetry first
then the mesh can be uploaded to adjust a base metahuman
its called mesh to metahuman

6

Hi,
Thanks for the reply, I want to create an Avatar Creator System within UE5 so people can create avatars from their IMAGE

7

Hi,
Thanks for the reply, I want to create an Avatar Creator System within UE5 so people can create avatars from their IMAGE

8

Hi,
Thanks for the reply, I want to create an Avatar Creator System within UE5 so people can create avatars from an IMAGE of their face.

9

there are some programs that do that
but metahumans require you to make a base head mesh
based on the metahuman head.
Metahuman uses cloud computing
for avatars to have face anim they need to have the custom head sculpted out of a base mesh that already has the face shapes
then you
“update the base mesh”
and should still have phonemes and face expressions
anyway
good luck