Hi there,
I wanted to start utilizing UE5 into my video workflow, using the UnrealServer plugin from Foundry to read scenes directly into Nuke.
I have no prior experience with game development or game enginges; I tried to find tutorials and forum threads assisting me in this path, yet unfortunately I have not found solutions to my problems.
As I only work with live-action, I want to import a tracked camera from Nuke directly into UE, alongside reference geometry for things inside my scene; for example, a chimney so I can add smoke via Niagara.
So my starting point is Nuke, I have a camera (baked animation, no expression link) and some ref-geo connected to a Scene node, and then I WriteGeo from that; I exported FBX(2020) and Alembix (Ogawa), “geometries” and “cameras” is checked for output.
In the beginning I had issues importing FBX files in general as “import” was greyed out, re-trying this morning now this somehow started to work. So I can import the FBX or ABC, either through drag and drop or right click->Import to [folder], I keep all settings at default (because I know too little about these anyway). This will import the meshes of my reference geometry, but not the camera.
To import the camera, I can create a sequence, create a camera and import the very same FBX (not ABC though) directly to it. That works, scale is tiny but that is a 2nd step for another time 
So I have my geo inside the content browser and my camera inside the scene, but not the two together. When I drag the imported meshes in my scene, I can position them freely - but to work as reference, they should be placed in exact correlation to the camera.
And how do I do this?
(If this isn’t something I can achieve, is there alternatively a way to import my video clip and “placing” reference points according to my camera? In Nuke there’s the ModelBuilder where I look at footage through the tracked camera, then place a point or geo (e.g. the chimney), then move forward in time and adjust it. In the background, Nuke then properly moves it in 3D space so it is in the right position)
Thanks in advance
//edit - before I forget, I’m on Unreal Engine 5.2.1, running on macOS Monterey 12.6.7 (Intel CPU, AMD GPUs)