Bring state-of-the-art generative AI into Unreal Engine with a plugin designed for ease-of-use, flexibility, and production readiness.
This plugin makes LLMs/VLMs first-class citizens in Unreal Engine by leveraging UE’s Reflection system to automatically derive structured schemas and tool interfaces. Whether you want to prototype quickly or build robust AI-driven features, this plugin provides the foundation.
State-of-the-Art Generative AI
Integrate LLMs and VLMs at runtime and inside the Unreal Editor. Automate content pipelines, accelerate editor workflows, or drive gameplay systems with AI-powered features.
Complete* coverage of OpenAI’s Responses API, plus legacy Completions and Chat Completions API.
Works seamlessly with any OpenAI-compatible endpoint (e.g. Claude, Gemini, Grok, Deepseek, Qwen, Ollama, vLLM).
Supports the Full* AI Workflow
Session-based, strongly typed APIs for multi-turn chats.
Full multi-modality support: text, images, audio, and files.
Custom tool calling and structured generation with automatic parsing via the Unreal Engine reflection system
Support for OpenAI's hosted tools (File Search, Web Search, Image Generation, Code Interpreter).
Support for MCP servers for distributed tool hosting.
Full streaming support and reasoning tokens where available.
Agent Framework {coming soon}
A general-purpose and flexible agentic framework gets you started on building your own custom agentic toolset and enables quick prototyping.
Strongly-Typed Tools & Schemas
Define Tools and JSON Schemas directly as UClasses, integrated automatically via Reflection.
Operate on your own instances with type safety and structured output parsing.
Bonus: Utilities for parsing UEnums and JSON objects.
Runtime UObject ⇄ JSON conversion for qualified classes, enabling typed parsing of derived UObject classes both at runtime and in-editor.
Setup & Workflow
Obtain an OpenAI API key (or configure your local LLM endpoint).
Use your account login at OpenAI (or the provider of your choice) to manage your organization, enable features like reasoning token access, image generation, and handle file uploads, vector stores, and container management.
Start building with a clean, strongly-typed Unreal API that brings generative AI natively into your projects.
Planned Updates (based on demand)
Support for more text-to-speech and speech-to-text endpoints.
Additional helper methods for data and file parsing, in particular for parsing images and audio into assets and vice versa
Improved diagnostic tools and tracing for debugging.
Community & Resources
Disclaimer
While this plugin is quite mature, it is still considered BETA until we have confirmed the plugin works stable across platforms, engine build versions and configurations. The price will increase after adding new features and stabilizing the plugin.
*Everything except the Computer Use Tool