How do I remove one UI widget without removing all of them?

you can drag from the Widget return pin and use RemoveFromParent after the delay.

you could also put that logic directly in the widget so it removes itself after X seconds