i hope you have found your answer…
anyway let me just add what i did here for someone looking to sway the branches and trunk instead of just leaves (well you can combine both)… by adding vertex colors to the tree…
you could use simple grass wind and do like the above but i used a sine node (didn’t know how to control simple grass wind lol) and vector 3 colors…
i painted the entire top half of the trunk in red color so it only moves in one way but you could add different colors to different branches and give them different intensities and made the branches move differently from the trunk…
you can give different speeds and made the branches swaying as secondary motion to the trunk… (i am trying to say you can experiment it and make it better and let me know if you did something cool with the tree swaying… ignore the yap 
)
