Cloth simulation seems to be breaking randomly at the transition region, so how to avoid this and make the transition soother?

How to make the transition between high paint influence to lower paint influence not break like shown in the images.