So - I cant tell precisely off the gif, but I think the leaves and the branch arent moving at the same pace?
That could be a thing if you have the WPO running on the UV localized.
Or if the tree mesh is somehow disconnected - generally have vertex at the attachment of the leaf branch to prevent movement divergence.
So yea, models can be the problem too…