Modify speedtree material without losing animation, is it possible ?

I don’t know if this will help but here is a gif of the problem:


at first the model performs perfectly but then after I tweak the vertex colors it goes all wonky on me. As you can see the other tree is completely unaffected.
Thank you for your time in advance !