Here’s a video demonstrating the ExLlama2 binding of the plugin:
(in the video above) In our recent showcase, you might’ve seen the prowess of the exllama2 binding, churning out an impressive 106 words per second with any GPTQ model – that’s lightning fast! At its core, this plugin is powered by Lollms, an advanced backend system known for its versatility. If you’re acquainted with ParisNeo, you’d know the sheer breadth of AI customization at your fingertips, right down to unique personas for your AI.
Imagine transforming any GGML or GPTQ model into a dynamic NPC within your Unreal environment.
We’re gearing up for an official launch in a few days, but for now, here’s a sneak peek for our Unreal enthusiasts. Dive in and let the future of AI in gaming amaze you!
This just in, Paris and I have implemented the chunked text feature which enables you to generate text word by word into the plugin to your widget editable textbox. This plugin is almost perfect and we’re getting very close to release!
Update: Included a new video demonstrating the chunked output too.
I’m using a 1b model for this demonstration, which provides very detailed replies, but not always in context. The 1b model works the best on my particular crappy machine, however, you can choose any model for this plugin with any type of parameter limit for your NPC’s. Including Fine-Tuned models from up to 70b. They’ll work fine if your machine can handle them that is. Haha! Personally, I’m super into ai chatbots, and this project was super fun to build with my friend/partner ParisNeo. I’m excited to revolutionize the way we use ai in Unreal Engine.
Release date: Soon. (Perhaps a couple of days…)
Check back later friends!
Next video coming soon to demonstrate the many available personas in Lollms, and we decided to show off a brand new feature that was already present in ParisNeo’s webui.
He has included a persona building feature that can be applied to any model too. Meaning you can build any NPC persona as part of your Ai model. For example if you want an NPC to appear as and talk like Joel or Ellie from the ‘Last of Us’. It’s now possible with this beautiful back-end system and plugin. Get ready to witness the persona shifts with a new 7b model demonstration coming soon. I feel game developers require these features to accurately reflect their NPCs using advanced Ai too… I really hope some of you are interested in this plugin, I’ve spent months writing it for this amazing community.
Thanks friend! We’re going to demonstrate a new video later today showing off the persona feature of Lollms too to enable NPCs to be given any persona imaginable. So stay tuned. This plugin will be available in the store very soon too. I hope you enjoy seeing super intelligent NPCs within Unreal engine capable of planning and fantastic generated conversation.
For anyone wondering about TTS: That’ll be demonstrated too when the plugin is released.
Quick update. We’ve achieved perfect Ai text to speech with this plugin using an open-sourced plugin on Github that enables TTS using ElevenLabs API. I’m super excited for the next presentation video using our new TTS setup too from within our plugin! Thanks for being patient friends! This’ll be worth it in the end as we’re making our technology perfect for users in the marketplace…
I just wanted to demo the TTS feature in our plugin on a recently generated-text. This speech ai voice model is powered by ElevenLabs model called ‘Rachel’.
This is just a sample of this amazing plugin. You’re going to love the infinite capabilities using any model known to man within the beautiful Lollms back-end crafted perfectly by ParisNeo.
Chunked text output fixed. This is a conversation between me and a 1b roleplaying generating model. I plan to demonstrate a conversation between me and a much more advanced model too very soon such as Vicuna 13b or Alpaca. So stay tuned! The plugin’s progress is building each day!
Thank you, friend. There’s no issue in the delay between messages as long as you use the Exllama2 binding and a 3b model. Then the replies are instant like in my recorded videos. Sorry for the delay on release. I’m struggling to enable lip-syncing with my models… I’ve been working on it all night using multiple plugins. I hope I have it ready in a couple of days… Very sorry for the wait to you and everyone else… I personally would have released it already, but my partner in this project ParisNeo is quite perfectionist… Haha!
There’s no need for any apology! I would rather you take your time and make it to your liking through testing until you’re ready for release! The work you’re doing here is very impressive and I’m excited to see when the product finally releases of course.
Both you and your partner are doing a great job and I support you both all the way!
Thanks a million for your interest in our plugin friend! I realize there’s a ton of Ai chatbot Unreal plugins available for Unreal already, but Paris and I wanted to build and present the simplest solution for easily downloading an applying your very own Ai models from HuggingFace (and perhaps built and trained from openai too, with a costly API key though as a side effect…) with infinite text output with no additional charges and fees (from using the plugin alone, you can easily download a Vicuna model for your NPC too [with no additional charges]). I was very shocked to witness you’re not just some developer on Unreal, but you’re in fact a moderator! That’s epic. I’m willing to send you the plugin where it’s standing right now, the lip-syncing issue is mainly a presentation purpose, it’s not exactly connected to the plugin. Therefore, I can send you the full plugin any-time if you’d like to test it yourself too. Feel free to email me at wayne@wayne.cool and I’ll send it your way if you’re interested in trying it out.
I think what you’re doing is very noble and interesting! While I would like to test the plug-in, I do not want my being a moderator to make me stand out more in that regard. I will excitedly await the release like many others because I like watching the progress as you continue to grow through your projects!
I very much thank you for the offer! You are so kind, and it is a little hard to turn down, haha.
I’m very interested in this as well, in my own testing outside of Unreal, GPTQ is just so much faster than GGUF models and would be far more ideal that being stuck with a paid service. Hoping to find something that has features like SillyTavern but works in Unreal. Although my use case goes beyond conversational AI with individual NPCs.
True. I’m working hard on this project still, my only issue right now is adapting the code I’ve written for 5.2 to 5.3, as it seems UBT has different compilation conditions… I’m still trying to push this project to the marketplace. Whenever I have a successful compilation ready for 5.3, I’ll announce it here probably. Then, I’ll attempt to release it in the marketplace. I think it may be quite difficult to work with Unreal on this project though, and if all else fails. I’ll open source release the project. Thanks friends!
That is another possible solution too. I realize for my plugin, I’ve chosen to use Lollms, but I’m certain it’s also possible using Oogabooga! The only reason I favor Lollms, is that it has all the beautiful bindings pre-installed… But, Oogabooga is quite good too…
Just wanted to throw this out there. Here’s my plugin’s official webserver.
You can use this simulated Linux console on the bottom to check the remote server status of my current ai loaded in my framework. And you easily buy the local framework setup buy clicking the buy button. Also, within the responsive website, type ‘help’ to learn more about the product and gain the list of the commands to the website’s command line. Thanks to everyone who was initially interested in my plugin project! I’m now building another remote demo using WebGL and Unreal engine too for any easier testing interface for the users of Unreal engine. That way you can test the plugin without having to download a 2gb file. And there will be more plugin functionality within the WebGL version too. Thanks everyone! ^^
Hi @MugenMan , amazing work with the plugin. I just bumped into it now. I wanted to know if it’s compatiable with the 5.3 / 5.4 versions of UE? I’d love to purchase it and use it for a project. Cheers!
