Muzzle flash Spec problem

In the images & gif you can see the muzzle flash has a crazy dissolve effect happening due to the ground being high specular. When not coveriung the ground it looks fine.
Is there a way to fix this other than taking the spec off the ground?