Anyone Creating A Mistral 7B Dolphin 2.0 Plugin to be Run Locally in Unreal?

Development Programming & Scripting
,
1

I’m seeing Mistral 7B can be run locally even on smart phones. This might be an excellent way to have chatbots not rely on API calls.

2

Was wondering the same, should be a good model to plug in locally In unreal and train it.