Upon unloading the widget with “Remove from parent” you need to clear all references to it in the blueprint variables and call Collect Garbage.
It will be cleaned up and stop taking inputs. If any references to it will not be set to nothing (like my set node at the bottom) it will remain in memory and take further inputs.