Announcement

Collapse
No announcement yet.

Mixamo Animation Retargeting

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    #16
    Originally posted by Konflict View Post
    There are many small differences between the mixamo and the epic skeletons, and while manually you can bring them very close, the retarget will be off in the end. I'm not sure if this can be fixed without reskinning the model. The arms will penetrate the chest and such errors will appear.
    [...]
    Hi Konflict,

    the plugin uses an analytical approach to perfectly match the poses of the skeletons and we do few adjustments to compensate some "structural" differences (e.g. the Head bones are oriented differently, if you align them the resulting UE4 skeleton will face-up too much). Note that small errors in the retarget base pose produce big errors in the final animations (e.g. your fingers, in our tests we have better results).

    But the problem you pointed out is mostly due to the different meshes of the models: e.g. the chest and arm dimensions of your source Mixamo model are smaller that the UE4 mannequin one, so when you apply the "Mixamo" rotation to the arm it will inevitably intersecate the bigger chest of the UE4 mannequin. This is a problem inherent to all animations retargeting when the meshes are different, not only with Mixamo. The proper solution would require modifications to the animation, not only the skeleton.

    Anyway the end result of our plugin can be manually tuned to help minimizing this sort of issues: you can tune the analytically computed "retarget base pose" to counteract the differences between the meshes if/when needed. E.g. slightly rotating "backward" the arms could avoid the intersection with the chest (well, not having tested it it's only an opinion ).

    Cheers.
    Mixamo Animation Retargeting - Stereo Panoramic Player

    Comment


      #17
      A little update about the question from Konflict: we did a quick test and the result of running the plugin (without further manual tuning) is quite good. Here two screenshots for comparison:

      Click image for larger version

Name:	Bframe1.png
Views:	1
Size:	833.3 KB
ID:	1126077

      Click image for larger version

Name:	Bframe1-hand.png
Views:	1
Size:	744.1 KB
ID:	1126078
      Mixamo Animation Retargeting - Stereo Panoramic Player

      Comment


        #18
        Looks good, when is release date?

        Comment


          #19
          Originally posted by BarisT View Post
          Looks good, when is release date?
          Unfortunately we don't have a date, we are still waiting for Epic testing the plugin. We wrote to them few days ago but we didn't receive a response yet.
          Mixamo Animation Retargeting - Stereo Panoramic Player

          Comment


            #20
            Thank you for developing this! 35 is an amazing deal for a plugin which will save so much time. Hope Epic approves it soon.

            Comment


              #21
              Thank you! I'll definitely pick this up.

              Comment


                #22
                Thanks guys

                A quick update: Epic sent us the "marketplace identifier". So we are a step closer to the release! I'll keep you updated as soon as we'll have further information to share.
                Mixamo Animation Retargeting - Stereo Panoramic Player

                Comment


                  #23
                  Any chance of using this tech on Daz models? Just curious -

                  Comment


                    #24
                    Originally posted by PixelForge View Post
                    Any chance of using this tech on Daz models? Just curious -
                    Do you mean https://www.daz3d.com/ ? I think it should be possible, like for the Unity models discussed above. We could look at them after the publishing of this plugin.
                    Mixamo Animation Retargeting - Stereo Panoramic Player

                    Comment


                      #25
                      Wow, this is amazing! I'll buy it as soon as it is released. It'll be a huge time saver.

                      Comment


                        #26
                        Yup! As of right now, you can scrap the rig Daz exports and try to run with Mixamo with a little less cleanup or you can try to bring the fbx into Blender or something similar and recreate everything based off of the UE4 Mannequin reference. Anything and everything to speed up the iterative process is welcomed. Keep up the awesome work!

                        Comment


                          #27
                          I'm buying this as soon as it's released, FYI. Great job and great idea.

                          Comment


                            #28
                            Epic, Whats taking so long?????

                            Comment


                              #29
                              Oh man thats amazing! this is rly cool! i need it!!

                              Comment


                                #30
                                Originally posted by PixelForge View Post
                                Any chance of using this tech on Daz models? Just curious -
                                It should work. You can already import Daz characters into Mixamo and then into UE4 (with needed adjustments). Make sure whatever you're using from Daz, you also have the gaming license or you cannot use in your game.

                                Instant buy upon release though. ESPECIALLY for $35!!
                                Artstation

                                Comment

                                Working...
                                X