Lately I have been experimenting with using AI inside unreal engine. Here are 2 proof of concept videos of generating materials and blueprint logic with AI.
Materials
In the video below I already entered the prompt and trimmed the first part. It takes roughly 30 seconds to start generating the nodes. This could be improved in the future. I had to tweak the output manually to get the material to compile (it’s a proof of concept after all).
Blueprints
I also experimented with generting blueprints. In the video I prompt it to make the turret component look towards the player and it actually manages to do it. I switched over to a proof of concept for Materials since they are more confined compared to Blueprints.
Let me know what you think. How would you like to use AI to improve your workflow?
This is actually amazing! And could help a lot of people new to the Engine! I hope you continue to iterate on it. Are you using a local LLM or Online with MCP?
It was so amazing to see the little step on the AI autionmation workflow with material system. I am currently working on this field too. I want to make an agent to help atrist to get into unreal material system qiuckly. Would you leave a contact for me to discuss together. My email tedsong97atgmail.com
Hey this is very interesting!!! Let me be your BETA-Tester please. I’m currently working on a project where I could really use this. Lots of little things that I could create using AI. That would be fantastic. Kind Regards, Andi