This thought is from my curiosity.
We have “Learned Motion Match (MM)” paper few years ago.
I want to know whether UE will produce official plugin or any 3rd party has already worked on this.
# For who is not familiar with this.
# It's just 3 shallow Neral Network (NN), in order to replace Proj/Stepping/Dec processes in basic MM.
- Allow Learned MM in engine. So we might have some big motion capture database and related trained NN. Some Orgs. just release NN for us to use without expose their real database.
- Then on the top of several Learned MM. We can have another trained NN. I might call it Controller NN. And it is a tree-like NN structure in the end. So the controller can manage input NN and blend their latent code to produce blended animation. Say input RUN+FIRE, and controller NN will give you animation of shooting when player run, like in an urgent case. You can imagine the scene from movie or even documentary of war. I think Naughty Dog has this, or not?
- And yes. Other Orgs. will have some DNNs to extract motion from video.
I think the Game with common movement + non-cut-in-edge graphics can handle this in stable 1080p+60fps.
Nowaday game like Death Stranding can definitly use this to have great walking and climb movement. I mean the hands and feet are exactly contacting with rocks.
They just need capture many-many motions and compress them by NN.