Plugin "UELlama" doesn't load on Windows

[matiasgql]

I recompiled this plugin and updated the library with the .lib version for work in windows, but the plugin still not working, I also tried another cmake flags, or another versions of llama.cpp, but I’m still having the following error when I start Unreal:

I have CUDA 9.0, 11.6, 11.8 and 12.2
also I tried deleting binaries and intermediate folders and i cannot load the plugin

The plugin comes from mika314 / UELlama
and seems to work for the author in Linux

[matiasgql]

In the end I managed to find the solution thanks to the same author of the plugin, it turns out that in Binaries/Win64 I needed to put the llama.dll file that I compiled previously (it is located in llamacpp/build/bin, in case it helps anyone)

[asd8923h]

Do you know of any flows that use Blueprints to run? I’m trying to run them in Unreal Engine, but I’m not sure how to put them together. Do you know of any samples I can use as a reference?

[matiasgql]

To use UELlama you will need to add the “Llama” component inside an actor, like the “ActorMovement” component, and then set the first prompt and the model location in the details section of the component.

[asd8923h]

Thanks for the help, but I’m a newbie and I’m not sure about one thing.

1. do I need to leave the .bin file inside the plugin for the modelpath?
2. if possible, could you show me how you have configured your blueprint?

Thanks.

[matiasgql]

1. No, but the path is absolute even in the packaged version of your game, so that’s something to keep in mind.
2. You can follow this video

Also I want to add that you need to use CUDA 12.2 for the Windows version or you can recompile the llama.cpp binaries (follow the github readme to do that) with another version of CUDA.