I’ve been having this problem since updating to 5.4. The process for cleaning up redirectors has changed and sometimes they don’t delete after they’ve been ‘cleaned up’.
Looking in the output log I can see the delete failed but no indication of why.