Last Widget Button Event Clicked is fired when pressing Enter


like the title says: I have a widget with a button. When I press it, the widget moves mostly out of screen, but still exist. Now, after I have clicked on the button, when I press enter, the last button I pressed fires again the event clicked (event pressed is the same). Set visibility to hit test invisible doesn’t solve the problem, also set Is Focusable to false does not help.
So, how I can disable this keyobard event which fires the button again? Thank you all.

Disable the button would work, but is no good solution, because I want them to look normal in this case (an in some other cases I want to diasble them so that they look differently).