Developing a new Ai chat plugin for NPCs in Unreal Engine. Super Dynamic and with a ton of Ai model options and personas for your NPC.

Thought of another possible option, instead of loading directly in UE5, could use Oobabooga’s API, still lets you run locally.