Maybe a stupid question. Any chance you have been using a gloss map in place of a roughness map for your metallic materials? That is known to cause a lot of jittering highlights. If this is the case, just invert the gloss map with a 1-x node to obtain a roughness map.