You can enable Update Rate Optimizations in the skeletal mesh, to further optimize you can set tick to be enabled only when rendered (if needed).
You can also use AnimUpdateRateTick