[Extending Editor] - Open Source Siri Plugin for Editor - Would like feedback from community

Our team is working to integrate Lucida, an Open Source Siri Library

What would you people, the UE4 Developer community like in such a Plugin? What things would be a deal breaker?

*We plan to release this for free, and run it as a web service, interfacing with UE4 via REST.

**IBM for example, doesn’t allow iPhones on the premises, because Siri may compromise their work.

Speech and Vision Based Intelligent Personal Assistant
https://github.com/claritylab/lucida*

Sirius is an open end-to-end standalone speech and vision based intelligent personal assistant (IPA) similar to Apple’s Siri, Google’s Google Now, Microsoft’s Cortana, and Amazon’s Echo. Sirius implements the core functionalities of an IPA including speech recognition, image matching, natural language processing and a question-and-answer system. Sirius is developed by Clarity Lab at the University of Michigan. Sirius is published at the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) 2015. Link to the publication [1].

http://sirius.clarity-lab.org/

Chatbot

I would be very interested in trying this for a simple dialogue to start with. Nothing fancy, get the speech-respond up and running.
How would it integrate with Unreal projects? A plugin?
If there is a beta tester list Maybe I should sign on…

How directable would the representation of the bot be?
How cuistomizable would the dialogue be?

my fav usecase(s) would be to use them in a game to command game elements like an army, people or robots etc…

I already kinda did that with a speech to keyboard tool and eve online… felt like spaceship boss. handsfree gaming is so real

Hello… I have developed a kid’s game in Mik’Mac language where you give a character a command and he does the action… sort of a R&D project… I was using the Pocket sphinx plugin but the issue is the dev doesn’t respond anymore to request, nor does he posts updates, and his mac plugin is stuck to 4.16 … So can’t use it anymore…

What was nice about it is that was able to create my own directory, based on the english one… Would love to see something like that…

  • Voice testing to get better results in the end.
  • Ability to check audio input sources
  • Ability to create our own words/dictionary.
  • Automatically recognize when words/phrases are spoken and use this to either make an action/start a animation, etc.

Those would definitely be good addons…

cheers!

Marc