Hi all,
I’m releasing the demo build and documentation for Unreal AI Integration Platform (UAIP) ahead of the Fab listing. UAIP is a plugin that exposes the Editor and Runtime as a structured API for AI agents (Claude Code, Codex CLI, Cursor, Windsurf, GitHub Copilot) to drive via the Model Context Protocol (MCP).
Demo build (available now, free on GitHub Releases)
Covers the observation + automation + scenario surface. About 60 commands across:
- Observation (viewport / tab / graph captures, JSON dumps of editor / world / Slate / selection / logs)
- PIE control (start / stop / pause / resume / load map)
- UI automation (click widget, input text, press key, drag graph nodes, connect graph pins, menus, dialogs)
- Scenario execution with per-step timeout / retry / abort policy and value splicing
- Editor workspace control (tab focus, layout, save-all, undo/redo, graph framing)
- Assertions for self-verifying loops
Demo build is MCP-only (HTTP API disabled) and captured PNGs carry a “UAIP Demo” watermark.
Full edition (coming to Fab soon, Fab Standard License)
- 540+ native semantic commands adding direct editing for Blueprint / Material / Niagara / AnimBP / ControlRig / Sequencer / PCG / level actors / Property mutation / asset creation, Automation Test execution, and Python script execution
- 190+ bridges to UE 5.8’s official Toolset (~730+ total commands)
- HTTP / WebSocket transports in addition to MCP
Relationship to UE 5.8 Toolset
UE 5.8 introduced the official Toolset integration. The full edition includes 190+ bridges so anything Epic exposes through Toolset is callable from UAIP. On top of that, UAIP’s 540+ native commands cover ground Toolset doesn’t reach: cross-asset graph editing, structural dumps (Slate tree, world state), scenario execution, PIE lifecycle, and crash recovery. UAIP also supports UE 5.7, which Toolset doesn’t.
Supported
- UE 5.7 / 5.8
- Windows (Win64). 1.0 is Win64-only; Linux/macOS planned for future versions.
Links
- Demo Binary: Release 0.9.0 · Naotsun19B/UnrealAIIntegrationPlatform-Document · GitHub
- Documentation (EN / JA): GitHub - Naotsun19B/UnrealAIIntegrationPlatform-Document: A platform plugin that enables AI agents (Claude, ChatGPT, etc.) to drive, observe, execute, and verify the Unreal Engine Editor and Runtime through semantic commands via HTTP, WebSocket, and MCP transports. · GitHub
- Demo video: UnrealAIIntegrationPlatform-Document/README.md at master · Naotsun19B/UnrealAIIntegrationPlatform-Document · GitHub
- Fab listing: coming soon
Feedback, bug reports, and feature requests welcome via GitHub Issues. Happy to discuss design decisions or use cases here as well.