Suggestion related to LLM AI and Blueprints

With the onset of web based generative AI, I have a suggestion for the Unreal Platform most likely specific to the editor itself and certainly what will become an important design feature in the very near future.

The feature would operate from within the Unreal Editor, possibly while editing a blueprint or allowing for as an import option. The idea is that at some point very soon if not already, AI will be able to create blueprints, learning about them from blueprint screenshots of the complete diagrams that encompass them.

To avoid problems with version changes between different versions of Unreal Engine, I see that this technology will likely take place through the same technology (different implementation) as image based generative AI.

Therefore, I believe that in the very near future, that full blueprint diagrams or schematics will be created by AI and output as an image that will look exactly like the images produced by exporting your blueprint diagram from the editor.

There should be a way to import from a blueprint schematic diagram image directly into Unreal Engine, without embedded metadata. As much so as code generators will likely change the way that C++ projects are coded in Unreal Engine, these sorts of tools will quickly transform the way that blueprint projects are created. Not only that, but it would facilitate a quick way for Unreal Engine users to exchange diagrams between one another, in addition to generating them with image based AI generators that have been trained on Unreal Engine blueprints.

The missing link in this tool chain would be an importer in the Unreal Engine editor that could import blueprint diagrams from .png or .jpg or .xxx image format.

I imagine some visual standardization would be needed to indicate node types within graph images themselves, which would be a small development cost considering the advantages it would offer to future developers adding AI to their development arsenal.

The alternative being AI that produces .uasset files of complete blueprint classes, however that doesn’t address sharing only specific diagrams or facilitates their creation with AI in much the same way that C++ projects benefit from that currently.

These blueprint diagram images could then be shared (or sold) on FAB as well as likely as they’ll permeate the Unreal Engine community sites globablly. Just a suggestion.

Happy Halloween!

Shhhh!

As revolutionary as this sounds it’s coming off as an nightmare from an QA perspective

1 Like

Epic Games just needs to add a production ready version of the new Verse scripting language to Unreal Engine. Along with fixing the main APIs that still have plenty of reported serious issues like Chaos.
Adding more convoluted stuff leads to nothing useful. Any visual programming language which includes UE BluePrints is text driven under the hood. Wasting time and resources having LLM to recognize, mix and create BP code visually doesn’t make any sense.
The Verse scripting language is what UE needs.