I've got a really bad physical asset and I'm not sure where to start fixing it

Disable all linear limits. If you have some scaled bones (that are not 1.0 at export) it could make issues at the physical asset as well.