Create Plugin Or Module using Camera data for Interaction


I introduce myself, I am a developer, I use the C # on unity and the BP on unreal in order to create experiences.

I would like to be interested in the various unreal solution that can lead me to the manipulation of image analysis, or more concerning the new elements concerning the camera, infrared or depth camera.

The kind of work that can lead to features that vuforia, which can analyze a video stream to interact with a specific reference image or as does ARcore, by manipulating depth data to remove a geometry. For setting up for example an image scan to detect high contrast.

I do not know where to start or how to go about it, can I have the wise advice of people already handling this kind of algorithm? Or links to tutorials that can guide me please.

Thank you in advance.