Unreal AI Agent

Lately I have been experimenting with using AI inside unreal engine. Here are 2 proof of concept videos of generating materials and blueprint logic with AI.

Materials
In the video below I already entered the prompt and trimmed the first part. It takes roughly 30 seconds to start generating the nodes. This could be improved in the future. I had to tweak the output manually to get the material to compile (it’s a proof of concept after all).

Blueprints
I also experimented with generting blueprints. In the video I prompt it to make the turret component look towards the player and it actually manages to do it. I switched over to a proof of concept for Materials since they are more confined compared to Blueprints.

Let me know what you think. How would you like to use AI to improve your workflow?

3 Likes

Maybe I will create Web assembly with WebGPU support for 5.5

What do you say ?!

BTW how can make AI agent for UE ? Can you provide any beginners course ? It

This is actually amazing! And could help a lot of people new to the Engine! I hope you continue to iterate on it. Are you using a local LLM or Online with MCP?