Crash in ULevel::RemoveLoadedActors when renaming/moving newly duplicated level

Steps to Reproduce
Crash on removing WorldDataLayers (Outer is not a level but a package). Only occurred while the editor is connected to source control (perforce).

Repro steps:

  1. From the content browser, duplicate a Level.
  2. Rename the new level

or

  1. From the content browser, drag and drop Level to new folder.