Trees are very bright if Visible in Ray Tracing is turned off

If you are using HWRT for Lumen you are removing the trees from the Lumen scene. Its possible that is contributing to this as well.