How to clear material slots in static mesh but not from the actors using that SM

Also, I tried to make copies of the static mesh but when I replace the geometry in the actor by the one has no material assigned to them inside, that also removes material from the actor.