Figured it out. It’s the baked shadowmap of the directional light that’s determining the shape of the light shafts. Since I’m using VSMs it means I don’t actually see the baked shadows, but they affect the volumetric fog anyway.
So I fixed this by increasing the shadow resolution scale on the directional light. This seems to only affect the baked shadows and not VSMs.