Strange translucent reflection artifacting when out of focus

Converted a project from non-raytraced to raytraced, and the glass materials are giving me this strange artifact when the objects are out of focus. Firstly, they don’t defocus like everything else in the scene, they stay in focus, and secondly, their reflections are super noisy.

This happens when Translucency is set to Raster. It goes away if I change Translucency to Ray Traced but then all the windows go super saturated. Anyone run into this before?

(first image is Raster, second is Ray Traced)