Update: Using the binormal as the axis in AxisAlignedFresnel seemed to do the trick. All these hours spent reading and testing trigonometry for it to be that simple…