I have been looking for information and tried a couple of things and there doesn’t seem to be an easy way to make an asset to not “stain” other objects.
But I can tell you that this is happening because the material of the dirt.
So, if you open the dirt material, try increasing the roughness or decreasing the Specular.