Hello guys, I’d like to share a wip of a gesture-based system I’m working on using Mediapipe + OpenCV + UE5 to dynamically control a character’s behavior via gesture rules and physical movement on real time. Tools I’m relying on are OSC, OpenCV + Mediapipe (for feature, hand extraction) and behavior tree inside UE5.
Just another alternative for visual storytelling!!
I develop similar architectures for real time systems. you can check them here: https://www.instagram.com/peruvianwizarddd/