So i Created a fast Api bridge to a locally hosted LLM with guardrails and protocols. It connects to unreal when the simulation starts and sends across “spatial” telemetry which is defined by my Universal Save, interaction and possession system.
On start the Ai gets to possess 1 actor and has a chat window, with a text input it also ingests the “world manifest” so its gets the basic data to make a decision. I prove this with a simple move to order which is defined as a Directive, but it can also be used for narrative purposes which uses a “chat” protocol.
The goal is to make an AI agent in the game world which acts as a story teller and a companion to help the mystical garden grow.
Core interaction, Save and Possession system. (with a touch of dynamically nested UI)
Ai Spatial Sense Video
Let me know what you think.
Best wishes and open to collaboration
Dan/memeseco