Three guesses at what this might be:
1)You might learn something about this by looking at the actual files on your computer this could be an issue with them not getting properly deleted the file level.
2)Are you using source control - issues with that could cause this
3) Is the thing that won’t go away actually part of a blueprint so restored to the scene when the blueprint constructs