The more I experiment with VRAM consuming reducing - the more it increases

Try playing with r.SkeletalMeshLODBias

Perhaps your lods are too detailed at the lowest level