[Open Source] Gemini 3 + UMG: An AI Assistant Dedicated to UI Editing (MCP)

Hi everyone,

I wanted to share an open-source project I’ve been working on, specifically designed to tackle one of the most time-consuming parts of Unreal Engine development: UMG (Unreal Motion Graphics).

Like many of you, I’ve seen various AI plugins popping up. However, my philosophy is “Do one thing and do it well” . Instead of a generalist AI that tries to do everything, I wanted to create a specialized tool that strictly focuses on the UMG Editor workflow.

:rocket: The Project: Gemini UMG Architect (MCP)
This is a Model Context Protocol (MCP) server that connects Unreal Engine to Google’s Gemini models.

:robot: Why Gemini 3?
I recently got the chance to test the new Gemini 3 model, and honestly, I was surprised by its performance in frontend logic and design reasoning. It handles hierarchy and layout adjustments much better than I expected.

:television: See it in action
I’ve recorded a video showing Gemini 3 step-by-step editing a UMG widget.
Watch the Demo Video Here

(Note: In the video, you can see it understanding the widget tree and making logical changes requested in natural language.)

:light_bulb: Current Status & Transparency
I want to be completely honest with the community:

  1. It’s Open Source: You can find the CLI/Python version on my GitHub here:https://github.com/winyunq/UnrealMotionGraphicsMCP

  2. A “Fab” Version is coming: I know setting up Python environments/CLI isn’t for everyone. I am working on a plugin version for Fab (Unreal Marketplace) that installs directly into the engine with a GUI, designed for those who just want “plug-and-play.”

  3. The Demo Limitations: I currently don’t have a high-tier Gemini 3 API Key or a massive art library to generate a AAA-looking “Cyberpunk Interface” from scratch in one go. The demo above focuses on the functionality and the workflow rather than flashy visuals. I hope you can see the potential despite the simple UI assets!

:handshake: I need your help!
I am inviting you to try this out. Since this is an open-source project, I would love to see:

  • Feedback: Does it actually save you time?

  • Issues: Did it break your complex widget hierarchy? (Likely, but let’s fix it!)

  • Contributions: If you are good with Python or the MCP standard, Pull Requests are incredibly welcome.

I’ve seen other MCP implementations, but I haven’t seen one that goes this deep into UMG specifics. I hope this tool can help us all spend less time on padding/anchors and more time on gameplay.

Thanks for reading, and let me know what you think!

Cheers,
winyunq
(Feel free to reach out via GitHub Issues or PM me here)