Use Skylight with Sphere Reflection Capture?

I am using a Skylight with my own HDRI to illuminate a scene. If I add a Sphere Reflection Capture it blows out the whole scene. Is there a way to adjust this or should I not use a reflection probe with a Skylight?

If adding a reflection capture changes things, it would naturally follow that all your materials are incorrect and cannot properly handle reflection…

Base settings for specular is .5, usually just just change the Roughness around. When the material still apears to bright you take the specularity down.

Having a reflective landscape does cause the scene to appear to blow out.