Destructible Mesh (Vertex Colour Issue)

Hi all i currently have a problem where i am using vertex colours as a mask to animate flowers in a material shader for a flower pot. How ever these are baked into the model rather than a pixel map as it is cheaper.

The problem is when i convert my mesh to a destructible it doesn’t seem to bring over the vertex colours baked in on the model therefore the plant pot itself is animating when it should be static ?

Is there a fix for this ?

Many Thanks