I noticed that the problem is directly related to the Bound of the skeletal mesh. If the bound of the skeletal mesh is static, then problems with VSM caching arise.
To prevent this from happening, you need to make sure that the skeletal mesh has the “Component Use Fixed Skel Bounds” checkbox disabled and a physical asset is assigned that contains shapes that have the “Considerfor Bounds” checkbox enabled.