I am investigating the possibility of using the frame buffer of a second DirectX process as a texture within Unreal.
The research I have done so far suggests it’s possible to hook into API calls to DirectX and leave me with a copy of the frame buffer as a D3D Surface.
However, once I have this I am not sure how I can turn it into a texture for within Unreal.
My thoughts were to extend the built-in texture class to handle this, but as Unreal behaves generically with no reference to DirectX,
it seems like I would be converting to a generic format and then the engine would convert it back again - all of which will cost valuable ticks.
I realise this is quite an ambitious thing to try and do, especially as I am new to Unreal (I have been looking at Unity too, but the sealed classes stop me doing something similar).
I doubt anyone has done this exact thing, but if anyone with any remotely relevant experience would be willing to give their advice, I could really use it.
I haven’t started implementing anything yet as I’m not sure it’s even possible, I’m just hoping to gather enough information to give me reasonable confidence this might work and formulate an executable plan.