How do I replace a reference that no longer exists?

Did you try Update Reference ? and if possible to go file explorer to manually delete the asset if it present.