I have a project where I am trying to automate the process of modifying modular components in the unreal engine and virtual environments. Specifically, I am trying to develop a system that allows users to dynamically alter the dimensions of virtual structures, such as houses using AI-driven commands rather than manual adjustments. The AI interprets these instructions and applies the corresponding modifications to the virtual objects in real-time within the Unreal Engine environment. How feasible is this project? Note I am a beginner in unreal engine so if anyone have any tips on how to get started with this project, please feel free to share.
I don’t think this is a task for a beginner, and I’m even more skeptical about the idea of ​​integrating AI into it… But nevertheless, it looks more or less feasible.
You want to do something like Promethean AI?
What specific features do you want to implement? PCG may be what you need, and it’s ready to go.
I want it to be able to modify the dimensions of the house just using AI instead of manually doing it. How does a complete beginner like me get started on a project like this? Should I just study Unreal PCG? Do you reckon a 6 months timeframe is enough to complete the project?
Do you mean that you just write in the command line “build a house with 3 floors and a bench on the porch”?
Well, for this YOU need to already have models of the house elements from which you can assemble a house with 3 floors, models for the fencing on the porch, and of course a model of the bench.
Then YOU need to write an algorithm (using, for example, PCG), which can assemble a ready-made house from models of walls, windows, doors, roof (you need to write that the walls need to be placed at a distance of “X” from each other, in the corners they must be turned 90 degrees, if there are several floors, then the roof must be placed on the last one, etc.).
Then YOU need to TRAIN the AI ​​into which settings of YOUR generator it should convert user requests.
This is what a rough plan for implementing such an idea looks like in my head (or am I just not understanding the capabilities of AI today?).
I seriously doubt that one person, especially a newbie, will be able to do this in such a short time…
You might be able to generate one type of house from 10 parts, but it seems far from what you initially imagined.