Refraction(Opacity) not showing in reflective objects

Hello,

I have an issue with ray traced refractions. I just realized that my high reflective objects in the scene are not calculating the opacity or refraction of my windows. I brought in some spheres to showcase it a bit better. I changed the reflection settings to Raster and back to Ray Tracing. I also made sure that I have enough reflection and translucancy bounces in my post process volume but couldnt see any change in the reflections. I double checked the glass shader if there are any settings I can mess with but without luck. Is there any global option in the project settings that I am missing? Please see the images attached. Any help on this would be great! Thank you.