Supercharge Your Unreal Project with ANY AI Model or Feature. Instantly. 🔥
GenAI for Unreal is the definitive, production-ready plugin that handles the integration layer for you. Focus on your gameplay, while we provide a stable, unified, and powerful interface to the world's leading AI models. The plugin supports all current cutting edge LLM APIs like the OpenAI's ChatGPT inlcuding the latest O3 and O4 mini, Anthrophic's Claude Sonnet/Opus 4, Google's Gemini 2.5 flash/pro, XAI's Grok 4, 3 and 2, Deepseek's R1 and so on. Full source code in included.
Now Supports XAI's Grok 4!
Product Website | Documentation | Example Project | Support
Disclaimer
This plugin requires an active API key from at least one of the supported AI providers to function. Please see our documentation for more information on how to obtain API keys.
Key features:
Real-time Text Streaming:⚡️
Bring your characters to life with dynamic, real-time responses. Our streaming support delivers text in chunks as it's generated, perfect for creating live-narrated dialogue, responsive AI companions, and interactive storytelling without the wait
Advanced Chat Completions: 🤖
Power your game with dynamic NPC dialogue, procedural quest generation, and real-time narrative adaptation using models from OpenAI, Anthropic, Google, XAI, and DeepSeek
Reasoning Models: 🧠
Leverage the unique "think before you speak" capabilities of models like Grok's grok-3-mini, deepseek's famous R1, OpenAI's O3 or O4-mini and other reasoning models which can be used to generate more core narrative parts of the project
Structured JSON Output: ❤️🔥
Reliably get complex JSON responses from any supported model. For example getting JSON responses of 100 AI generated NPCs each with their own stories, race, gender, name etc
Multi-Modal Vision/Text Input: 📸
Allow models to "see" your game. Provide screenshots or other images as direct input along with text, perfect for creating AI-powered spectator commentary, dynamic player guides, or environment-aware NPC interactions
High-Quality Image Generation: 🖼️
Supports OpenAI's Image generations including Dall-e and also the famous gpt4o's image generation capabilities which created the recent ghibhli trend
Text To Speech (TTS): 🔊
Generate dynamic, high-quality voice lines for in-game dialogue, narration, or live conversations with AI characters
Audio Transcriptions: 📝
Power in-game voice commands or create interactive conversations by converting player speech to text with OpenAI's Whisper API
Low-Latency Realtime API: 🎙️
Build truly responsive, low-latency conversational experiences. This API enables speech-to-speech interactions allowing players to speak to the AI
Effortless Server Proxying: ☁️
Need to route requests through your own backend for security, logging, or custom logic? Our server proxy feature allows you to override API endpoints for any provider with a single setting, giving you complete control over your data flow
Blueprint & C++ Ready: 🔗
Built from the ground up to provide a first-class experience for everyone. Enjoy simple, powerful Blueprint nodes for rapid iteration, and access the same robust, self-managing functions in C++ for maximum performance and control
Designed for Cross-Platform:
The plugin exclusively uses standard, high-level Unreal Engine modules for networking and file management, ensuring it works on all platforms supported by the engine, including Windows, Mac, Linux, iOS, and Android
Secure & Centralized Authentication:
Manage all your API keys in one secure, centralized settings panel. Our system uses a non-portable, encrypted files to keep your keys safe and separate from your source control
Why Choose This Plugin?
Constantly evolving: 🧬
We provide rapid updates to support new models and features from frontier AI companies as soon as they're released
Production-Ready and Tested: ⚔️
All the features included are tested with actual API keys regurelsly for different use cases and scale. The plugin was also out there for testing for over a year now and updated based on actual user feedbacks from Github
Generic & Adaptable by Design: 🌵
The codebase is built with a clean, generic approach, allowing for rapid adaptation to future models and unexpected API changes
Built by Developers, for Developers: 💻
With years of professional game development experience, we guarantee a stable, well-documented, and performant implementation that respects Unreal Engine's best practices
Dedicated Support 📧
Available Integrations & Models
A clean, unified API for the best models available today
OpenAI ChatGPT:
Chat: gpt-4.1, gpt-4o, gpt-4.1-mini, gpt-4.1-nano, gpt-4o-mini
Reasoning Models: o4-mini, o3, o3-pro, o3-mini, o1, o1-pro
Image Generation: gpt-image-1, dall-e-3, dall-e-2
Audio TTS: gpt-4o-mini-tts, tts-1, tts-1-hd
Audio Transcription: gpt-4o-transcribe, gpt-4o-mini-transcribe, whisper-1
Structured Output (JSON Mode) ✔
Text Streaming ✔
Multimodal Chat ✔
Realtime API (Beta) ✔
Anthropic Claude:
Chat: claude-opus-4, claude-sonnet-4, claude-3-7-sonnet
Multimodal Chat ✔
XAI Grok:
Chat: grok-3, grok-3-mini, grok-3-fast, grok-3-mini-fast, grok-2-vision-1212
Reasoning Models: grok-4, grok-3-mini, grok-3-mini-fast
Text Streaming ✔
Multimodal Chat ✔
Google Gemini:
Chat: Gemini 2.5 Flash, Gemini 2.5 Pro
Text Streaming ✔
Audio TTS: gemini-2.5-flash-preview-tts, gemini-2.5-pro-preview-tts
Audio Transcription: Gemini 2.5 Flash, Gemini 2.5 Pro
Image Generation: gemini & imagen (Preview/Beta*, unavailable in EU/UK)
DeepSeek:
Chat: deepseek-chat, v3
Reasoning: deepseek-reasoner, r1
Text Streaming ✔
Supported Formats
Audio:
Input: mp3, wav, mp4, mpeg, mpga, m4a, webm
Output: pcm
Use Cases:
Harness the power of generative AI to build next-generation gameplay mechanics that were previously impossible.
Truly Dynamic NPCs: Create characters whose dialogue is generated in real-time based on player actions, world events, and their own unique, AI-defined personalities.
Evals and AI Leaderboards: Setup a battle ground for LLMs to fight against each other to test their abilities
Procedural Content Create endless quests, item descriptions, character backstories, or even entire lore books on the fly
AI-Powered Game Masters: Use Vision and Reasoning models to create an AI director that can see what the player is doing and adapt the game world in real-time.
Interactive Voice-Driven Gameplay: Combine Text-to-Speech and Audio Transcription to allow players to have real, spoken conversations with in-game characters, cast spells with voice commands, or interact with their ship's computer