Hello! Does anyone used Developer assistant? I have no success at all to the scripts that it produced. And hen it make mistakes the corrections are leading to other mistakes and their correction to the initial mistakes. Your experiences about that?
Hey akind1010,
Yeah it’s still early days, might be coming out like an AI generated photo, with mutated stuffies and a table leg in the umbrella stand.
Your experience sounds similar to what @Hicsy posted, he also mentioned hallucinations…
actually is not that. its just bad code. full of mistakes that it cannot correct. so in my opinion its useless t this stage at least
I agree, totally useless. I’m scared to think how many hours I have lost while trying to generate something with this thing. It is maybe a bit better than chat GPT but overall performance is the same - none of the codes work.
It is doing the same mistakes over and over again, mistakes generate next mistakes, which give even more errors and it’s impossible to fix the code.
I noticed that when it is correcting its own mistakes for like 10th time, it will never produce working code. At some point it’s better to start new chat, and either start over with a prompt, focus on stuff which was wrong last time, or paste last working code and start working from there.
I’ve had some luck generating some basic codes, but really nothing too complicated. Whenever harder stuff comes in, assistant just can’t handle it.
At some point it told me to remove all 30 teleporters because what I want can’t be done with them, change all the settings, told me to put 30 spawners instead, and after setting them all up, after 5 hours of incorrect codes it told me to delete them and put teleporters instead…
I will maybe return in few months to check its state, but currently - it’s just waste of time.
this is exactly what happened to me. I wasted 2 days, trying to do some simple basic stuff. Mistakes that leads to new mistakes and at the end everything must be deleted and start all over. I really cannot understand how Epic did this at this stage of a useless very slow llm that doesn’t even know their own user interface commands. Unbelievable…
I use developer assistant a lot. Normal days: probably about 10-20 session per day.
TBH Half of this is because *something crashes my verse VM in VSCode, which means all clickable links stop working until I reload… I think it’s because I often have 1-2 other VSCode windows open.
This chat assistant can answer quick questions that a ctrl+click would have answered more concisely, but has stopped… so like:
“show me a function which takes (agent, float). Draw a debug arrow in front of the input player, starting 2m in front of agent and ending at float distance from agent”.
I know how to do it, but in this hypothetical maybe I was trying to work out which inputs have “Named Parameters” (need the silly question marks) - a trivial question which VSCode is pathetic at answering, but ctrl-click
would normally show at a moment’s glance, then alt + left_arrow
to jump back to where I was.
Normally when coding, developers use Claude. In the back-end, it’s narrow-scope means it’s natually good at reasoning, and then that means that computation-wise, it can often accept more context for a similar cost.
Epic Assistant makes a lot of common GPT mistakes, so my guess is they are doing a hardware-sharing deal with oAI or something to use a chat-bot instead of a developer bot.
If you treat it as such, you can limit the madness… oh, and check your manifests - if anything is newer than May, the Dev Assistant Tool is too out-of-date and will just Hallucinate like mad (another GPT trait). Generally scene graph or physics will cause it to have a melt-down.
For a while it used to say that it was on the latest version, I dont know if Epic perhaps tweaked something on the back-end, or maybe RNGesus is being nicer lately, but it now (usually) correctly states it’s codebase (35.20/May2025). I find things from v32.00 often work, and occasionally v33.00 does too. Much later than that and you are better just having a conceptual “chat”.
ill post some examples of “chats” I had which seemed to work. (rather than code-requests, which can hallucinate if not limited to a single concept)
i use claude also, but I assumed this as more specialized due to Epic. I also try for general developing gemini cli which i think its much better at this moment. I didnt asked for something special just a weapon rotator with a timer. i am in my 3rd day now trying to make it work
yeah, it took me a week or so arguing with it before I could get a feel of it’s limits. I wish it held all the official templates+tutorials higher in it’s context window, as im sure they did that example already (actually, maybe it was in an official youtube livestream).
This is certainly the best assistant option for Verse/UEFN, and once Epic start dogfooding, it will RAPIDLY get more clever once they work out which contexts work best, etc. (it’s currently just the snippets folder + the digests AFAIK).
a simpler example:
how can i join 2 strings, in a Print() statement?
# Using + operator for string concatenation
JoinStringsWithPlus():void =
Print("Hello, " + "world!")
#Using string interpolation
JoinStringsWithInterpolation():void =
Name := "Alice"
Print("Hello, {Name}!")
how do i do this with a localized string
# Helper to convert string to message
StringToMessage<localizes>(InString : string) : message = "{InString}"
# Example of using string interpolation with localized strings
JoinLocalizedStringsWithInterpolation():void =
Name := "Alice"
LocalizedHello := StringToMessage("Hello")
Print("{Localize(LocalizedHello)}, {Name}!")
A more complex example went for a couple days and were trying to find ways to do a raycast. It hallucinated a LOT, and sometimes that sent me on a goosechase until i proved it wrong… other times I knew better… eventually we got there though.
Might not be the best example, but i’m happy to share to anyone the chat window if they want it.
Thank you for sharing your experience. right now i am working on very simple things as i mention before. But i hope someone from epic sees this post and do something about their AI. Even the free Gemini is building much better code. Much faster and the logic is more deep and detailed.
I had a quick look for the livestream, I couldnt find it… but I think from memory this example has the code you need. plus it’s pretty good just for reference on how to format code etc:
@akind1010 i think it was in this one: