Not really. It’s a fire & forget node - that’s what it’s for. You could try:
But you must start referencing your widgets so you can access them when needed later on. There are more ways of doing the above but all revolve around using proper communication. Spamming Remove All does what it says on the tin. 
If you are truly desperate, you can always:
It will work providing there is only 1 widget of that class instantiated - the widget in the upper left will be spared removal. But this is, by far, the worst possible way to do it. 