I’m actually trying to make a videoclip (cinematic) where a character plays the piano.
Here is my plan :
Make a blueprint that manages midi info from my keyboard and moves the keys according to the pressed keys. This can be recorded in a DAW and played back later on (So that I don’t need to have UE opened during performance capture) (This is done in 4.27.2)
Capture the actual performance, I’m going with a visual AI app (This one seems to have better results than actual gloves/suits)
Merge the two animations. (In UE5)
#1 : The piano mesh and keys has to be the exact size of my real piano.
#2 : The character needs to have the same finger size than me.
#3 : The fingers have to land perfectly on the key.
Is it gonna work ? Is it an actual workflow that makes sense or am I going in the wrong direction ?
I feel like I might be going the wrong way, but at the same time it looks like something that is being done a lot in the actual film animation industry.
Thanks a lot for your help