I have developed a simple object tracker in C++ and successfully send the rotation and translation vectors to a pawn class in UE4. I have connected both pieces of code using shared memory. All good so far . My next goal is to send the camera view of the camera I have in the UE4 scene to my other C++ application. For this purpose I’m planning to follow the same strategy and make use of shared memory. However, before worrying about the “video transfering stage” I’d like to understand how the camera system works.
So, instead of trying to solve my problem directly I’d like to first accomplish a simpler goal: gather a few frames from a camera object and save them to disk. This is the first two doubts I have:
- Where does the camera object live? GPU or CPU?
- I’ve been exploring the “SceneCapture2D” object and do some test inside the editor (displaying the camera feed on a plane). is this a path worth exploring?
- Is RHI (Rendering Hardware Interface) the way to go? RHI doc
Any ideas are very welcome.