Specular occlusion doesn’t appear to work on certain materials when using ray traced shadows. Perhaps there is a CVAR to fix it, but the easiest thing is to simply switch to virtual shadow maps for your sun instead of ray traced shadows.
Raytraced:
VSM:
