How to call an event with voice keyword?

Hi there, anybody here know how to call a custom event, or activate a function, via voice?

I would like to do something like “alexa” and “siri”, I would like to open a connection on a websocket only when a specific word is pronounce.
For Example:
User says “hey chatbot” and then the chat with the chatbot is opened. Instead if not pronouned I don’t want to use to connecction.

In unity there is a native library to use voice recognition. Is there something similiar?
I’m using Unreal Engine 4.27

Thanks in advance for your help
Danilo

Hey there @danosarco! Welcome back to the community! While you could use Unreal’s internal audio capture and handle the speech recognition yourself, I actually use this plugin in my project. It’s not too heavy on performance with smaller models, and can get wildly accurate with the larger ones. It’s also open source so you can easily edit anything needed!

Thanks for your help.
I’m going to try and let you know.

Danilo

I’m just trying but I’m having trouble importing it properly.

When I download it from the UE Marketplace I can enable it but in the setting there are no Setup buttons: (Buttons in the image are missing)
immagine

And if I try to use it without caring about the language model setup, I got some node with missing input pin so I can not follow the guide from the developer.
I can’t even find where the plugin folder is located to change it with the github version.

Any suggest?

Tried to unistall from the engine and install in the project but it says “Unreal can’t build” and the project doesn’t open.

Thanks in advance

When you attempted to uninstall the plugin, did you do it from the launcher? Were there any assets left over inside the project? That should have automatically taken the targeting out of the uproject file. However you can do this manually. Head over to your project folder, open your uproject with a text editor of your choice, and see if there’s a reference to the plugin. If not, try and open a fresh project and verify the engine itself will open.

There is no assets left over inside the project, I checked the project file too.
But as I mentioned before, I don’t know if somewhere in the computer there are left overs because I can’t locate where the plugin is installed, I can’t find it in the Engine folder, don’t know why.

Additional informations:
I just reinstalled both “Runtime Audio Importer” and “Runtime Speech Recognizer” and after activating them, on the restart I got this message:
immagine

And as you can see buttons are missing in plugin setting page:

If I continue, and try to replicate this setup:


But when I arrive to the node “Start Speech Recognition” as you can see “OnStart” input pin is missing so I can’t continue:

Hi, It appears that you’re using the RuntimeSpeechRecognizer on UE 4.27 from the Marketplace, which is quite outdated and lacks many fixes and features. Unfortunately, I can’t update the Marketplace-specific plugin for UE versions older than three prior ones (which are 5.3, 5.2, and 5.1 at the moment), so I highly recommend downloading the plugin from GitHub into your project’s Plugins folder instead. I’ll add this information to the Marketplace to discourage its use on the outdated 4.27 engine version, and encourage to download from GitHub.

I just downloaded this version:

And placed it in my project plugins folder but I can’t open the project now:
I got 2 messages, the first one:
Immagine WhatsApp 2023-10-30 ore 10.31.44_b538106c

Then when I pressed “Si” (“Yes”)I got another error:
Immagine WhatsApp 2023-10-30 ore 10.33.44_2ca8351b

How can I solve this problem? What should I do?
Thanks

Danilo

Tried to rebuild manually from Visual Studio but got this error in Log: