First UE5 AI Plugin that Implements AAA Quality Gameplay Features with Self-Play
Game Pilot is a powerful Unreal Engine 5 plugin that implement gameplay features for you across All Blueprint Types, Anim Blueprints, Widgets, Inputs, Materials, Data assets, Motion matching, Retargeting animation & IK rigs setup, StateTrees, Smart Objects, SFX with eleven labs and more with just a single prompt.
Example Prompt: “Add jetpack ability to the Mover Character, when Gamepad Face Button Left is held, slowly propels character 50 ft above ground. Use motion matching. Test it with Mover character. fly around and zig zig around for 20 seconds”
Its completely different from other plugins and tools. It has a built in harness that allows it to build systems to AAA quality. It is also the only plugin that can Development and Test at the same time until the feature is correctly implemented.
The agent also uses live Blueprint debugging to play test and inspect blueprints to find gameplay errors/issues. (It will also have access to Rewind Debugger in the next update).
All of this skills combined allows it to perform Automated PIE Playtesting. The agent autonomously launches Play-In-Editor (PIE), simulate player inputs, read Live Blueprint data, log and game state, giving it the ability to iteratively fix its own or any bugs before you can intervene, clicking and testing widgets in PIE, performing in game actions like running, flying to a location, going to a location and using the door, performing a series of actions. This closes the QA loop and allows you to test out your gameplay logic live at scale.
The agent can also creates AAA quality UI from a screenshot. This is not just creating a primitive widget like other plugins. The agent creates a fully functioning abstracted and animated UI following the best practices of Page > Large Component > Small Components.
This means the agent can create any UI with only a single image. The agent creates fully functioning VFX, Buttons, Layouts, Recreating Fonts, Icons, SFX, etc from a single image.
Here the Agent fully creates a AAA UI Menu.
Here the Agent creates a jet pack gameplay system using motion matching.
Here the Agent creates an Iconic Loading Spinner with a single prompt.
Here the Agent is performing PIE QA Test aka Self Play
How does Game Pilot do it? its not just a collection of MCP Tools to UE5, its a AI first purpose built harness.
Step 1 - Install UGP and connect Unreal
Get the plugin on Fab, add it to your Unreal Engine project, and launch UGP (Universal Game Pilot). It uses your existing OpenAI subscription. In seconds, It connects to your editor & understands your live project context.
Step 2 - Ask for what you want
Describe a feature, fix, or test. Whether you’re working on Blueprints, input, animation, motion matching, materials, widgets, or gameplay systems, UGP turns your request into real project changes completely handsfree.
Step 3 - Review, Apply, Playtest
See exactly what’s changing before anything is committed with UGP's built in node graph & material render preview, it can even playtest in editor to validate the result with gameplay playback, bp debugging, end-to-end testing.
From sophisticated AI using state trees to extending motion matching animations to your game character to gameplay abilities & feature to high quality ui & menus. Let Game Pilot handle all the hard work. All you have to do is Ask UGP To Implement a Gameplay Feature or Material and to test for verification, it will recursively self improve until the feature is fully functional. This is a first.
With the User-friendly Agent First Workflow desktop app you can have dozens of agents working on dozens of different features simultaneously across numerous projects, while you keep track of them.
This plugin requires you to use the Universal Game Pilot Desktop App & uses your existing OpenAI subscription.
Documentation Link: Full Installation & Setup Documentation
Various Usage Examples & Tutorials Are Here: App Usage Examples / Tutorial
Video Setup of the required Desktop App Video Intro Tutorial
Powerful features built for developers
Pay once, use forever
One-time purchase. Lifetime access. No subscriptions.
All Blueprints Types
Editor Utility & UMG Widget
AAA Quality Material UIs
Materials
Motion Matching (Database, Normalization Set, Schema, Chooser Table, etc)
Input Assets
AI StateTree, Env Query & Smart Objects
Curve Assets, Spline Component
Data Assets, Data Tables, Enums, Struct..
Retargeting animation & IK rigs setup
Render Target
Automated QA - Actual Self Play including interacting with UI/Main Menu and Game Level & Gameplay
Generate SFX, Fonts from Image
Project inspection and Live BP debugging
Animation Sequence / Montage / Modifier
EnhancedInput, EditorScripting, PropertyBinding, ControlRig, IKRig, RigVM, GameplayInteractions, WorldConditions
and many more..
Some advanced Universal Game Pilot features depend on optional built-in Unreal Engine plugins. Enhanced Input support requires EnhancedInput; IK/retargeting requires IKRig; Control Rig support requires ControlRig and RigVM; EQS support requires EnvironmentQueryEditor; Smart Object/State Tree support requires SmartObjects, GameplayInteractions, StateTree, StructUtils, PropertyBindingUtils, and WorldConditions. Core bridge/editor automation features remain usable independently, but these optional feature families require their corresponding Unreal Engine plugins to be enabled.
Projects that do not use these optional feature families can still use the core Universal Game Pilot editor automation features. Optional feature modules are intended only for projects where the corresponding Unreal Engine plugins are enabled.
Universal Game Pilot v1.3 is out now!