So try this. Nothing in the scene apart from your background the object, directional light, skylight.
Make sure the roughness in the materials is on 1.
Set both lights to dynamic, and cast shadows off.
