For the mannequin, a little advice if you need. You can remove the mesh from the skeleton this way it will load only the skeletal hierarchy needed for animation. This will reduce the weight of it to a few kb. You still can use another mannequin while working on animations and use it as preview.
If you see the metahuman solution, they do a similar strategy for retargeting by using only the mannequins hierarchy.