Speech Recognition using oculus quest 2, any idea how to do it in Unreal Engine?

Development Audio
, , , ,
1

Does anyone have any ideas how to do speech recognition for vr with unreal engine?

Are there any plugins or tutorials?

2 Likes
2

You could take a look at the RuntimeSpeechRecognizer plugin, which is based on Whisper AI, namely whisper.cpp. It’s cross-platform and works offline, as well as completely free and open source.

GitHub link: GitHub - gtreshchev/RuntimeSpeechRecognizer: Cross-platform, real-time, offline speech recognition plugin for Unreal Engine. Based on Whisper OpenAI technology, whisper.cpp.

Marketplace link (But please prefer downloading from GitHub as we’ve noticed some issues with the Marketplace language model staging): Runtime Speech Recognizer in Code Plugins - UE Marketplace