Virtual Production and Virtual Set samples really needed!

Hi all - I use UE as a VP engine with streaming serial data from a camera system / givng position data to UE - Regarding incoming video to UE I found one very important issue is the synch and since there is normally no synch input or output on webcams and the sorts I can recommend using a capture card like the “cheap” BMDs - not crazy expensive and you can get a one way card for I think 150 dollars. This also helps keeping latenzy low since sourcing through serial can be a pain sometimes. UE have done a good job on the BMD plugin that is now native and latenzy can be controlled with a BP as far as I understands. Using VIVE trackers is kind of an economic tracker but look out for framedrops. Check out how MoSys and Stargate Studios use UE and a pro tracker to drive the parallax on a monitor /however when you want lens data like zoom and focus VIVE will fall short as there is no input for these parameters / regarding lensdistortion : its one of the areas that the pro virtual studio providers keep close to the body / to do it properly you will need a proper lensdistortion mapping and there is several ways to achieve this / for a “quick and dirty” way for fixed lenses you can shoot a square grid on medium range focus and distort the UE generated image (or you could undistort lens) before overlaying. Its not always necessary though / off course field of view is important / that is easy to calculate if you can measure the distance to a wall with a vertical line / make a pan to each edge / get the angles and then use the fov formula. Just my 2 cents on the subject. Cheers