Using LLMs to learn Blueprints

I would like to use a LLM to learn Blueprints. So far, some of them (ChatGPT, Llama) could explain the steps quite nicely, however they couldn’t form diagrams. Have any of you tried such method on another model or software which may visually form blueprint diagrams?

I don’t need any software to make “actual” blueprints for me. I just want to study with them. So, the diagrams doesn’t need to be Unreal Engine compatible or anything like that.

Thank you.

2 Likes

You’d be way better off just learning it the normal way…

Blueprints are not complicated, and LLMs aren’t reliable, they’ll often give you bad or wrong information so they aren’t a good way to learn anything really.

You can pick it up in a day assuming you have absolutely any prior coding experience. I mean you won’t master it that fast, but the basics it’s just so easy…

2 Likes

I’m 46 years old. My profession is game environment modeling and level design. I have been using Unreal Engine since UE3. I have studied bleprints hundrets of hours in total over years. I read all official documentation, watched countless tutorial videos and followed them. Each time, I forgot the usage afterwards and I have failed (I’m autistic). I still try to learn it. I try to find different methods. Maybe this method can help me.

1 Like

You forget it most likely for 2 reasons.

  • You do not enjoy it
  • You aren’t using it frequently

Fix one of those, or employ proper mnemonic techniques (spaced repetition might work for you, this would also partially solve the second issue since you’d be using it every now and then for the express purpose of remembering it) as an alternative, and you’ll start remembering it.

You don’t really need to remember all that much though, a lot of blueprint use is just right clicking and searching for the right node and you only need very vague recall or a bit of google help to succeed on that.

1 Like

I’m a visual person and sadly, I really don’t enjoy any kind of programming. However, I’ll learn it.

a lot of people just follow and copy what a tutorial says, without ever knowing why something was done the way it was. Try to make a project from scratch, a unique idea that doesn’t have a tutorial, and what is available can be close enough to be used as a reference point at best. That way there is no cheat sheet where the answer can be looked up, you make the answer. Best way to learn. When I was teaching unreal in a class, each student got a unique task every now and then xD

2 Likes

This is how I learned too, in a matter of days, it was just sorta natural, I fired up the engine for the first time and went “Ok, i want the camera to be able to zoom” then achieved that and “ok, want first person too” and “now I want crouching” and so on, just one little step at a time and before I knew it I was entirely comfortable with BP.

Also when I follow a tutorial, it’s very rare that I just follow it verbatim, it happens occasionally (when people are really good coders, they’re really good coders!) but I always try to find a better way, or a way to optimize it, I use the tutorials mostly to help me find the nodes I need, or help me find “a” way to get me started on “my” way.

It wasn’t the fastest I picked up a language, and I’m certainly no master of it (I only just learned how to use event dispatchers and pure functions for instance); that would go to python which I picked up in a day following a very good online tutorial that covered the basics of it, and gdscript was a close second;

But blueprint is the most non-programmer accessible coding language I’ve ever worked with (if anything it was more intimidating for me at the start because I’m used to coding in text, not in nodes). There are even people who actually believe it isn’t programming :laughing:

But as I said, and OP confirmed, the real problem for him is that he doesn’t enjoy it. We’re wired to remember things we enjoy more easily than things we don’t, it’s why some middle schoolers are gonna get 10/10 in all their favorite subjects like little geniuses, but might be so bad that they could even fail in their least favorite ones. If you ask them about it they’ll just tell you that they can’t remember, I cracked the code of ‘why’ we can’t remember it back in middle school and had it confirmed by an expert too.

But I aced my country’s written drivers exam (Which is notoriously hard) on first try, it was not a subject I enjoyed at all. Mnemonic techniques, namely spaced repitition was how I did it. If the enjoyment you get out of learning something is a multiplier for it’s quality, you can make up for that lack of quality for things you don’t enjoy with quantity instead; it’s the most simple and also one of the most powerful mnemonic techniques known to man. There is a formula for how frequently you have to space things out but I forgot it (the more time passes the larger the gaps get, you start with 12 hours, then after that you go 24 hours, after that maybe something like 72 hours, then a whole week, 2 weeks, a month, 3 months, and so on) it’s a bit debated but it’s somewhere in that range roughly.

This also ties into why skills ‘rust’ if we do not use them, and the longer we’ve been using them the longer it takes for us to not use them for them to start ‘rusting’, all it takes to maintain that skill might be to use it once a year (maybe even less!) if you’re already very good at it and already had everything memorized.

All he has to do to do this is give himself like an hour one night in blueprints where he works on something that teaches him everything he needs to know. Then do it again (but preferably not exactly the same, something similar that still covers all bases) next morning, then again the morning after that, then again 2-3 days later and again a week later.

Just pound the problem at ever increasing intervals and it’ll stick, which is what I advised him to do; but he ignored that.

There are also other mnemonic techniques such as loci which are very powerful he could use, there are a lot of options, LLMs aren’t one of them though.

1 Like

b/c LLM’s are trained by us

Even if we all answer honestly, with what we believe to be true when we generate-content for LLMs to consume, we can still be honestly mistaken, let alone what humans can obviously pin as fantasy/fiction, machines cannot. Then there are those of us that just-lie (poison the well).

And to reply to OP, I’m with the others, LLMs are poor way to go. Practice, practice, practice.

To the point of the person above who replied about repeating skills over time, loci-training, there IS a strong body of evidence to suggest an irregular and extending series of visit-the-skill keeps it fresh in one’s mind. Follow the Fibancci-sequence: practice something, then practice the next-day, then take a couple days off, practice the next week, skip a week, practice, skip a month, practice, skip 6months, practice.

Next year when you need to just whip out that skill, you’ll remember…

2 Likes

I find it frustrating that none of the replies actually answered or helped the OP. If you don’t know, just don’t reply. Don’t get me wrong, additional suggestions are always good and I acknowledge that you’re trying to help, but I see this happen every time in this forum. The OP had always gone unanswered.

That said, I think you can look into Ollama which helps you run Llama locally: https://ollama.com/
and use this for a web interface if you haven’t already: GitHub - open-webui/open-webui: User-friendly WebUI for LLMs (Formerly Ollama WebUI)

About visualizing blueprint diagrams, I think that is such a cool idea but I have no idea how it can be done so let’s wait for a REAL answer.

2 Likes

I have to say, I find this to be an incredibly short sighted take. Not every question can be answered as a matter of fact nor should it. Other vantage points can be helpful for those who come through in the future and are at times helpful to the OP. Maybe the OP has limited experience or perspective. Maybe not in this case but others. Please don’t use your voice to shutdown conversation on the forums. Nothing said so far was with ill-intent or misinformed and is rather good advice for learning in general. Allow people to use their earned experience to guide/suggest to others a potential path forward that they may not have been considered previously.

2 Likes

I understand your other points, but don’t expect me to understand this:
“nor should it.”

Why? They want to use LLMs to learn and visualize blueprints. :slight_smile: That’s it, that’s the question.

2 Likes

I want to fly using feathers and wax. Everyone else telling me it just won’t work out well, pshhhh. Gimmie the answer I want to hear.

LLMs SURELY could work, but I don’t know if it’s in the ability of anyone here to make one that will perform well, which is what the OP is really asking for.

Sometimes the difficulty-curve is just too steep, sometimes, it’s just not a good idea to marry two things.

"LLMs SURELY could work, but I don’t know if it’s in the ability of anyone here to make one that will perform well, which is what the OP is really asking for.

Sometimes the difficulty-curve is just too steep, sometimes, it’s just not a good idea to marry two things."

No, the OP is asking for existing software or models. You or others may not know, we should maybe just wait for someone that can answer the question.

The OP has stated that they don’t enjoy programming, cannot remember nodes or concepts (you only really remember such things if you do enjoy it) - and are primarily an artist/level designer.

I think the real answer to the real question is that LLM is nowhere near the point of creating Blueprints for you.

1 Like

No, ChatGPT and Llama indeed can. it so the only thing left is how to visualize them I guess.

Given more time they in theory will be able to create “non-bizzare” code/blueprints - but atm any coder will tell you that their output is in no way going to produce fully working results - even for learning they can send people down random rabbit-holes.

no matter where you get your information from learning has a time cost

a few hundred hours spread over years is basically nothing

you need to work at programming daily for many years before you’ll be proficient enough to do much of anything useful.

LLM’s can be a big shortcut because it is a reliable (mostly) mentor with infinite time and patience. but with all of the shortcuts you’ll still need months/years of daily practice before you’d be able to make a basic game on your own

Blueprints are code under the hood, you can copy and paste them in plaintext and there are online blueprint readers that understand it’s format, such as blueprintsue.

an llm would need to be trained to output code compatible with such a reader and then output it into a webui that contains such a reader.

If you can get an LLM to output usable blueprint code that you could copy and paste into UE, then you would just need a webui that auto detects such code via it’s headers and displays it as nodes.

Essentially blueprints tend to begin and end like this in text form, which can be used for auto-detection:

Begin Object Class
...
End Object Class

No idea if anyone’s done it, it shouldn’t really be that hart, the tricky part is teaching an llm to write blueprint code. Or any code for that matter, i’ve tried to use things like chatgpt as programming aids in the past, and I found that unless you’re asking it things of the level of “how to make a for loop in langauge x” it’s useless.