How do you change light and other components realtime in Virtual Production?

Hello,

I have a few questions regarding the functionality of two scenes I made that have to run in an XR studio. I will provide pictures and list my questions and I really hope someone can provide some answers.

The first two Images are the scenes in Unreal Engine, and the last two images are their first version-counterparts made (by someone else) in Notch.

Questions:

1.) In both scenes I am working with some kind of light. The ‘XR-Stage’ Neon sign in scene 1 and the pillars and standing/hanging lights in scene 2. These lights are simply controlled by a texture or color input in the Emissive Color. How do I get to control the color and the intensity of that light while my scene is running in real time? How do I program this? Am I able to connect those controls to an external device like and Ipad or a phone?

2.) In scene 1 you can see I have white screens in the background saying ‘content’. How can I play the view of my second camera (as you can see in the notch version) that is being filmed in the studio, on those screens?

3.) In scene 2 you have the vertical screens. similar question to question 2 but just with media content or something that is streamed live?

4.) Say I want to move the pillars in scene 2 back and forth in a loop? How would I go about and program that? so they would have to move/change location in a loop the whole time when I press play.

5.) In scene 1 you have the railing on the edge of the building. Is it possible to have it always in the foregrounw? So that it can obscure the person in the studio?

Hopefully someone can answer these questions. I know it’s a lot, but I just thought it was best to ask all my questions at once.

Greetings,
Sam

hey there !
that makes a lot of questions :slight_smile:
so i will try to help the more i can :
for 1) to use texture to light a scene you have many options
first one : in your materials properties , check that box

313991-light.png

the you will be able to amplify the illum with a multiply node.
you can also use a lightfunction material and put rect lights in your scene to have more control

2) you need to use a scencapture component.
see here :
1.7 - Scene Capture 2D | Unreal Engine Documentation

what it will do, the scene capture component will capture the camera in a scene texture, and you can use that scene texture in your rectangles materials.

3) a) for fottages :
you can use the media player to display video textures
more infos here :
Play a Video File | Unreal Engine Documentation

b ) for streaming content, you will need to edit the media source and point it to your stream url.

4) you can simply do a level sequence, it s an animated sequence with keyframe (no need of code here) as you would do in any keyframe animation software
more infos here :
Sequencer Overview | Unreal Engine Documentation

5) for this, you ll need to use the custom depth buffer, and custom stencil, that will allow you to create a mask to apply to your character more infos here How to Create Masks With the Custom Depth Buffer | Tips & Tricks | Unreal Engine - YouTube
hope it helps

hey there !
there is an easier way to do this :
it s called material parameter collection. you can set a color in it, and it s used byt the mats you want. so you change it once, and it s updated every where .
more info here :

Hey!

thank you so much for reacting to my questions so quickly. This really helped me a lot and gave me the answers I was looking for and also propelled my further search into the right direction. In the studio scene I had a lot of objects that had emissive light, and I wanted to change them all at the same time together with my rectangular lights.

So I was able to make this blueprint that makes sure that all lights turn red when you press ‘R’, green when you press ‘G’, blue when you press ‘B’ and white when you press ‘W’. It also starts playing footage on the screens when you press ‘P’.

Thanks again for reacting to my questions!