You can do it for each of your maps by selecting the “World Override” option under the Blueprints tab in the editor viewport.