AI mocap + AI lip sync in UE5

Community Showcase Film, TV & Animation
, , , ,
1

eminem_bts1_instagram_ultrawide.00_00_32_09.Still001
eminem_bts1_instagram_ultrawide.00_00_32_09.Still0011920×810 81.7 KB

Hello everyone! :smiley:
This time I’m here to post a behind the scenes of my latest personal project (Eminem singing Lose Yourself) where I integrated AI motion capture from Plask AI, and AI lip sync from NVIDIA Omniverse Audio2Face inside UE 5 Preview 1 with Lumen.

PS: This is all raw data (there are some weird flickering). But the objective here was testing all these functionalities.

BTS:

Final clip:

Project here on my ArtStation

Hope you like it :slight_smile:
Thanks!

1 Like
2

Hey @andersonrohr,

Nice to you again!

As always your work impresses. Guess you really lose yourself in your projects. :sunglasses:

Amazing job and can’t wait for your next post!

1 Like
3

Hahah, that’s true! I get impressed about UE everytime I start and finish a project.
I’m very glad you liked my work, thank you!! :smiley: