I recompiled this plugin and updated the library with the .lib version for work in windows, but the plugin still not working, I also tried another cmake flags, or another versions of llama.cpp, but I’m still having the following error when I start Unreal:
In the end I managed to find the solution thanks to the same author of the plugin, it turns out that in Binaries/Win64 I needed to put the llama.dll file that I compiled previously (it is located in llamacpp/build/bin, in case it helps anyone)
Do you know of any flows that use Blueprints to run? I’m trying to run them in Unreal Engine, but I’m not sure how to put them together. Do you know of any samples I can use as a reference?
To use UELlama you will need to add the “Llama” component inside an actor, like the “ActorMovement” component, and then set the first prompt and the model location in the details section of the component.
Also I want to add that you need to use CUDA 12.2 for the Windows version or you can recompile the llama.cpp binaries (follow the github readme to do that) with another version of CUDA.