[PLUGIN] OpenCV plugin for UE 4.19

OpenCV integration with UE 4.19. In progress…

This is integration with all lib of OpenCV 3.40 and Cuda 8.0
For now this is UE4.19 plugin integration with libs without implementation of OpenCV libs and algorithms.
This is work in progress and we gonna to implement OpenCV implementation as Unreal Engine Actor components and Blueprint event interfaces


For now there is one simple UE4 Actor component for smile detection


Example youtube video


This is awesome. Does it also have face recognition?

Thanks for your response

It easy to add, OpenCV has this kind of algorithm Face Recognition in Videos with OpenCV — OpenCV documentation

I’ll continue to work on this plugin and I’ll add more openCV algorithms and make integration with Machine Learning OpenCV: Machine Learning Overview and Deep Neural Networks OpenCV: Deep Neural Networks (dnn module)

Yeah I once try to play with OpenCV but I’m not good with C++ or Java. I was trying to do it for mobile.

This is awesome though keep up the good work.

Thanks, I’ll post here my update soon

Fix some thread memory issues GitHub - Batname/UE4OpenCV

Hello, Here is new Update of OpenCV, where you can play around with cascade object detection, and Cuda GPU integration, new you can try to run algorithms execution on GPU, which is up to 30x faster Home - OpenCV.

Here is link to GitHub page GitHub - Batname/UE4OpenCV

For now frame rate it is stable, because algorithms run on GPU

is there anyway I can contact you? like a email or social media?

This is fantastic!
Any planned support for 4.20?

Not really a direct answer, so apologies, but I thought it might still help someone.

Lightact media server (LightAct for Real-Time | LightAct) has several openCV functionalities and it works with UE4, as shown in this tutorial:

The video shows how to use FindCircles, but there is a FindContours node as well.

DISCLAIMER: I’m the founder of Lightact.

Hey there, does it work on Unreal 4.21, and if not are there simple changes that can be made to make it work?
I tried using the wiki tutorial here A new, community-hosted Unreal Engine Wiki - Announcements and Releases - Unreal Engine Forums but it seems old…

Thank you a lot for this contribution! I’ll definetly give it a try!

Hello. Thank you for your awesome plugin!
But I can’t install it.

I renamed the folder to “OpenCV”, added “ThirdParty” directory in “OpenCV”, and added OpenCV directory into “MyProject/Plugins/”
Then launcheded MyProject, but it could not be rebuild. So, I tried to rebuild from souce code.
But rebuild fails with 108 errors, which are all of OpenCVSmileImpl.h and cpp.

Could you explain how I can fix this?

I’m using UE4.19