Optical Character Recognition - Using VR to Trace Symbols

Would it be possible to setup optical character recognition in VR with blueprints? I would like to have the player press and hold a button and begin tracing a symbol using motion controllers and the Vive. Once they release the button, the engine finds the closest symbol based on what the player traced and executes some code.

Is this even possible or is it overly complicated? I’m leaning towards the latter.

What would even be the first place to start? I’m not sure of what tools in the engine I should even begin with. Any insight is appreciated :slight_smile:


OCR requires very complex algorithms that I don’t think would be wise or even possible in Blueprints. I do know that Google has their source out there for their Tesseract system, and it’s in C++!

Ah, this is the resource I need. Many thanks! If I get something going, I’ll report back here.

Thanks again!

I’m also working on a similar project. So far, I’ve been implementing this using OpenCV. Here is a tutorial : A new, community-hosted Unreal Engine Wiki - Announcements - Epic Developer Community Forums
I have not tried Tesseract though. Let me know if you figure it out :slight_smile:

I’d also be interested in knowing your results. I’m diving into that now as a way to determine if a wizard has cast a spell using the appropriate glyph pattern traced by his wand. It’s a fun challenge!