I’m fans of Japanese anime since a long time ago, still beginner in UE but wanna try some projects to remake some 2D anime to 3D with Unreal Engine 5.
I was discussing about this idea with my friend and they suggest some title and also i must start from easy difficulty first before going to hardcore/pro quality. The animation will be related to samurai/katana/guns and dueling… some good title likes Rurouni Kenshin, Naruto and Also Bleach for superpower vfx animations.
The hardest part for me is the custom animation and the lipsync part. Software will be used around Blender, Unreal Engine 5, VRoid Studio for anime characters https://vroid.com/en/studio , Cascadeur for AI animation https://cascadeur.com/ , yes i know the hard part is finding the simplest/fastest workflow for final result and tackle all problem within these softwares.
Lipsync in UE manually is kinda hard, mostly tutorial in youtube for UE5 is around Metahuman using Iphone X or above and also using Audio2Face omniverse using RTX (which i dont hab these 2 hardware). I also tried lipsync with Maya using Advanced Skeleton Face Rigging but sadly its not support japanese audio. Luckily i found the simplest workflow for lipsync using built in Vroid Shape Keys, Blender then using Papagayo https://lostmarble.com/papagayo/ with semi manual keyframing, then import in Unreal, and the result is not that bad (considering its all free), eye blink and more emotion later can be added in UE. Sample with UE5 can be seen here
next step is compiling all reference, preparing 2 anime characters, animating then finally render in UE5.
If anyone have reference for good duel in anime series especially Guns/katana it will be helpful let me know by replying this message.