Sounds like your splash widget is caused by the BeginPlay or Constructor of another class that always gets created when a level opens, such as a GameState, Playercontroller, or player Pawn class. Something listed in your Game Mode probably creates the widget on beginplay or constructor.