I’m working on a project to create a digital double that people can actually interact with using AI, but I’m not sure what the next steps are, so I thought I’d ask here for guidance.
So far, I’ve done the photogrammetry, cleaned up the mesh, textured it, and even added the hair. The character looks great, but now I’m stuck. I’ve been researching, and I came across NVIDIA’s ACE, which seems to be this amazing tool to bring virtual characters to life with generative AI. The thing is, I have no idea how to integrate something like that into my project.
Honestly, this feels like a really ambitious idea for me, and I’m not even sure if I’m heading in the right direction. But I’m excited to learn, and I want to make it happen. If anyone has experience with something similar or knows how I can start working towards connecting my character to AI for real-time interaction, I’d love your advice. Even just understanding how to approach this would be super helpful.
Thanks in advance to anyone who can share some tips or point me in the right direction! I really appreciate it.
Your project is impressive! To add AI, define your goals—whether it’s conversation or gestures. NVIDIA’s ACE, Unreal’s MetaHuman, or Unity’s tools can help. Use Unreal or Unity for real-time rendering and integrate AI like OpenAI’s GPT or NeMo for interaction. Rig your character for facial animations with Blender or Maya, then test and refine. Check out forums for guidance. You’re on the right track—good luck!
Thank you so much for your advice— The main idea for my project is to create a character that people can talk to as if it were a real person. I want to load it with important parts of its life story so it can respond naturally to questions about itself.
So far, I’ve worked on the character in MetaHuman. I did the photogrammetry, cleaned up the mesh, and integrated it into MetaHuman through Unreal to get a rigged version. The character looks great, but I’m stuck on how to make it truly interactive.
I found this NVIDIA blueprint diagram, but I’m not sure how to proceed with integrating it into Unreal.
If you have any advice on how to link AI for conversations or what steps I should take next, I’d really appreciate it. Thanks again for pointing me in the right direction!
