Create Speech Recognition Virtual Assistant using ChatGPT in Ue5

[Graeme_VR]

Hi. I want to create a AI Virtual Assistant in Ue5.1 using ChatGPT API and using speech recognition. I’ve seen plugins like Convai, I want to create the same thing but using ChatGPT, is that possible? anybody want to help me build it? So if I approach the MPC and verbally ask it questions it will answer my questions verbally as well.

[Everynone]

Not sure how much it helps but this is very alive:

[FREE] HttpGPT: GPT Integration (ChatGPT and DALL-E)

[Banner1] HttpGPT is an Unreal Engine plugin that facilitates integration with OpenAI’s GPT based services (ChatGPT and DALL-E) through asynchronous REST requests, making it easy for developers to communicate with these services. HttpGPT also includes Editor Tools to integrate Chat GPT and DALL-E image generation directly in the Engine. Editor Tool: HttpGPT Chat [Editor1] Editor Tool: HttpGPT Image Generator [Editor2] Links HttpGPT Repository Documentation Unreal Engine Marketplace O…

And I run into this last night:

https://v.redd.it/s4acdexfnpqa1

Perhaps you can dig around there.

[Graeme_VR]

Thanks for the info, much appreciated

[gtreshchev (Georgy Treshchev)]

In terms of the speech recognition itself, you can also take a look at the RuntimeSpeechRecognizer plugin, which is based on Whisper AI, namely whisper.cpp. It’s cross-platform and works offline, as well as completely free and open source.

GitHub link: GitHub - gtreshchev/RuntimeSpeechRecognizer: Cross-platform, real-time, offline speech recognition plugin for Unreal Engine. Based on Whisper OpenAI technology, whisper.cpp.

Marketplace link (But please prefer downloading from GitHub as we’ve noticed some issues with the Marketplace language model staging): Runtime Speech Recognizer in Code Plugins - UE Marketplace