That did it! I made a post process volume and turned the intensity off screen space reflection down, and now the shininess is consistent.
Is there some global post process settings available? Or must I use this volume over my entire scene?
Thanks a lot for the help! 