Reflective Simulations - LLMAI Plugin

Distribution Product Discussion
1

LLMAI is an AI solution that brings cutting-edge conversational AI directly into your Unreal Engine 5 projects. Whether you're building games, simulations, or interactive applications, LLMAI provides the tools you need to create intelligent, responsive AI characters and systems that can communicate through text, voice, function calling.

Required Unreal built-in Plugin Dependencies

  • AudioCapture Plugin

  • LiveLink Plugin

  • MetaHuman

Video Demo

Check out the Video Demo - Introduces the Terminal and Rocketeer game demos.


Key Features

💬 Streaming Text Communication

  • Real-time streaming responses with character-by-character display

  • Natural conversation flow with immediate, responsive AI interactions

  • Thread-safe implementation for reliable operation in complex scenarios


🎤 Realtime Voice Communication

  • Natural voice conversations with OpenAI's or LocalAI Realtime API

  • Automatic speech detection and interruptions with Voice Activity Detection (VAD)

  • Multiple AI voice personalities (8+ voices including Alloy, Echo, Shimmer)

  • Bidirectional audio streaming with noise reduction

  • Seamless voice/text switching during conversations

  • v2.0: Automatic mic gating functionality

🔧 Intelligent Function Calling

  • AI-controlled game systems - Let AI spawn objects, adjust settings, control gameplay

  • Blueprint-friendly function definitions created through the Content Browser

  • Real-time parameter handling with flexible argument support

  • Function profiles for grouping related AI capabilities

  • Complete game demonstration through included Rocketeer arcade game and LiveLink Metahuman demo

🎮 Complete Working Demos

  • LLMAI Terminal - Professional chat interface with text and voice controls

  • Rocketeer Game - AI-controlled retro arcade shooter showcasing 18+ AI functions

📚 Documentation

Platform Support

- Unreal Engine 5.6

- Windows 64-bit (Win10/11 x64 required)

- Visual Studio 2022 (included .vsconfig for easy setup)

Requirements

  • OpenAI API Key (required for OpenAI functionality)

  • LocalAI install for hosting LLMs on local machine or local area network

  • Internet connection for AI service communication

  • Microphone and Headset (for voice input features)

----------------

Transform your Unreal Engine projects with professional AI integration. Download LLMAI today and start building the next generation of intelligent interactive experiences.

Engineered by [Reflective Simulations](https://www.ReflectiveSimulations.com.au)

2

Hi All!
We have released LLMAI Plugin v2.2 to bring it up to latest realtime API standards, addressed some issues and overhauled the Documentation portal.
Let us know what you would like to see in the next version!

Version 2.2 Changelog
OpenAI

  • Migrated OpenAI Realtime API from deprecated Beta to GA (removed OpenAI-Beta header; updated session JSON)

  • Removed session temperature (not supported on GA); updated provider profile and defaults

  • Added models gpt-realtime, gpt-realtime-mini, gpt-realtime-1.5, gpt-realtime-2 (default)

  • GA sessions use output_modalities as text or audio only—not both; plugin maps dual requests accordingly (transcripts still available in voice mode)

  • Fixed “Error committing input audio buffer: buffer too small” on voice sessions

  • Fixed empty voice dropdown on fresh projects without a project Config/ folder

Grok (xAI)

  • Added models grok-voice-think-fast-1.0 and grok-voice-latest

  • Moved Grok voices and models to plugin INI (consistent with OpenAI; no longer hard-coded in C++)

  • Fixed duplicate session update sent on both session.created and conversation.created

  • Known issue: complex tool-related requests may leak reasoning into voice output (x.ai server-side; reported)

General

  • Added GetProviderCapabilities / IsProviderFeatureSupported Blueprint API to query per-provider UI features (e.g. session temperature)

  • Runtime settings overlay: Blueprint SetDefault* calls apply for the session by default; optional bPersistToProjectConfig to write project INI

  • Breaking: removed unused legacy delegates OnAITranscript, OnAIResponse, OnAIFunctionCall (use current event delegates instead)

  • Cleaned and refined debug logging (quieter default Output Log)

  • Connect dialog: temperature slider disabled for OpenAI and other providers without session temperature support

Documentation

  • Rebuilt LLMAI documentation: corrected content, new theme, site search, index page, breadcrumbs, and refactored layout

Demos

  • Arcade demo: camera follows player; reduced SFX volume to avoid conflict with voice chat

  • Terminal demo: fixed chat UI artifacts when scrolling or on rapid transcript updates