For anyone who hits this bug again: it is possible that it’s the temporary LandscapeStreamingSomething that blocks the process.
I closed the editor, reopened it.
Found this object (it wasn’t visible before), and deleted it.
After that, the landscape could be deleted.
Again I’m just a noob here in UE so this could have been just a coincidence, but anyway.