Can one exclude Reflections from the Refraction input in a material? (for making view-deforming glass)

When creating a glass pane I am using a NORMAL map to create deformities in the glass. When forwarding the NORMAL map to the refractions I get the desired effect quite nicely BUT at the same time, along with Normal map deformation, I get reflection which are not desired in this particular glass. Can one still get the effect of glass material view deformation VIA normal map (or equivalent) without getting reflections?