Create Speech Recognition Virtual Assistant using ChatGPT in Ue5

[Graeme_VR]

Hi. I want to create a AI Virtual Assistant in Ue5.1 using ChatGPT API and using speech recognition. I’ve seen plugins like Convai, I want to create the same thing but using ChatGPT, is that possible? anybody want to help me build it? So if I approach the MPC and verbally ask it questions it will answer my questions verbally as well.

[Everynone]

Not sure how much it helps but this is very alive:

[FREE] HttpGPT: GPT Integration (ChatGPT and DALL-E)

[Banner1] HttpGPT is an Unreal Engine plugin that facilitates integration with OpenAI’s GPT based services (ChatGPT and DALL-E) through asynchronous REST requests, making it easy for developers to communicate with these services. HttpGPT also includes Editor Tools to integrate Chat GPT and DALL-E image generation directly in the Engine. Editor Tool: HttpGPT Chat [Editor1] Editor Tool: HttpGPT Image Generator [Editor2] Links HttpGPT Repository Documentation Unreal Engine Marketplace O…

And I run into this last night:

https://v.redd.it/s4acdexfnpqa1

Perhaps you can dig around there.

[Graeme_VR]

Thanks for the info, much appreciated

[gtreshchev (Georgy Dev)]

In terms of the speech recognition itself, you can also take a look at the RuntimeSpeechRecognizer plugin, which is based on Whisper AI, namely whisper.cpp. It’s cross-platform and works offline, and has Vulkan GPU acceleration support.

Fab link: Runtime Speech Recognizer (Real-Time, Offline) | Fab