LLMAI is an AI solution that brings cutting-edge conversational AI directly into your Unreal Engine 5 projects. Whether you're building games, simulations, or interactive applications, LLMAI provides the tools you need to create intelligent, responsive AI characters and systems that can communicate through text, voice, function calling.
Required Unreal built-in Plugin Dependencies
AudioCapture Plugin
LiveLink Plugin
MetaHuman
Video Demo
Check out the Video Demo - Introduces the Terminal and Rocketeer game demos.
Key Features
💬 Streaming Text Communication
Real-time streaming responses with character-by-character display
Natural conversation flow with immediate, responsive AI interactions
Thread-safe implementation for reliable operation in complex scenarios
🎤 Realtime Voice Communication
Natural voice conversations with OpenAI's or LocalAI Realtime API
Automatic speech detection and interruptions with Voice Activity Detection (VAD)
Multiple AI voice personalities (8+ voices including Alloy, Echo, Shimmer)
Bidirectional audio streaming with noise reduction
Seamless voice/text switching during conversations
v2.0: Automatic mic gating functionality
🔧 Intelligent Function Calling
AI-controlled game systems - Let AI spawn objects, adjust settings, control gameplay
Blueprint-friendly function definitions created through the Content Browser
Real-time parameter handling with flexible argument support
Function profiles for grouping related AI capabilities
Complete game demonstration through included Rocketeer arcade game and LiveLink Metahuman demo
🎮 Complete Working Demos
LLMAI Terminal - Professional chat interface with text and voice controls
Rocketeer Game - AI-controlled retro arcade shooter showcasing 18+ AI functions
📚 Documentation
Quick-Start Guide - Get running in 5 minutes
Complete API Reference - Every function, parameter, and event documented
Installation Guide - Step-by-step setup with troubleshooting
Debug & Logging Guide - Advanced troubleshooting and optimization
Arcade Demo v2.0- Realtime terminal with learn by example function calling arcade demo
LiveLink Demo - Realtime lip-sync metahuman with function calling and terminal text and voice chat
Platform Support
- Unreal Engine 5.6
- Windows 64-bit (Win10/11 x64 required)
- Visual Studio 2022 (included .vsconfig for easy setup)
Requirements
OpenAI API Key (required for OpenAI functionality)
LocalAI install for hosting LLMs on local machine or local area network
Internet connection for AI service communication
Microphone and Headset (for voice input features)
----------------
Transform your Unreal Engine projects with professional AI integration. Download LLMAI today and start building the next generation of intelligent interactive experiences.
Engineered by [Reflective Simulations](https://www.ReflectiveSimulations.com.au)