Integrating local LLaMA 1B into UE5.4

Development Programming & Scripting
,
1

Hi everyone,

we’re working on a mobile project using Unreal Engine 5.4.
We’d like to integrate a small LLM (e.g. LLaMA 1B) directly into the engine (not cloud-based) to manage:

  • local character memory (short- and long-term)
  • emotional development (e.g. based on sentiment in text)
  • internal decision-making (personality traits, growth)

The big models (e.g. for chat) will remain cloud-based – this local AI is meant to handle the emotional and behavioral side of the character only.

Any ideas or examples on how to embed such a model into UE5 for Android/iOS?

Thanks in advance!