3d version of me + unreal engine = virtual studio with multiple cameras. Is it possible ?

Development Cinematics & Media Virtual Production
,
1

Hi Everyone,

I have this idea, and I would like to know if it’s doable and if anyone can point me in the right direction.

I would like to shoot a video of me talking and create a 3d version me, then put this version in an environment in unreal engine, and then use multiple cameras in unreal engine to have a “virtual studio with multiple cameras”.

I don’t want to create a character, I want the real me inside the environment.

Is that possible ? If yes, how this can be done? Either for creating the 3d version of me and on adding it in unreal engine.

Thanks in advance,
Martin

2

I would like to shoot a video of me talking and create a 3d version me,
You’re describing volumetric capture. It requires a lot of cameras all synchronized around a person in a special room. This is being done but is very expensive and somewhat limited. End result is a 3D person talking and moving.

then put this version in an environment in unreal engine, and then use multiple cameras in unreal engine to have a “virtual studio with multiple cameras”.

For a home user the solution is a small greenscreen, composite that in Unreal. You can cheat cameras to look like you’re from different angles.

3

Thanks @scottunreal for the answer and for the video example! Really helpful.

yes volumetric capture is what I am looking for ! I already do the “normal” way with the green screen as you mention, I am looking to take this one step further now :slight_smile:

Do you have any information you can send me regarding volumetric capture, how it works, how to set this up, what gears to be used … ?

Thanks a lot again,
Martin

4

https://modtechlabs.com/volumetric-video-introduction/

https://www.microsoft.com/en-us/mixed-reality/capture-studios

5

You can put yourself in unreal with composure, this is a demo that I have made with blendartrack and Rvmmatting