World Partition - Cannot delete unloaded actors

In my case, if nothing other works - select non loaded actor and replace (remove is not active, replace should) - with Target actor for example.

After replacing you can easy remove it or leave.