Pressing widget button with mouse click lose keyboard Enhanced input.

Try calling this right after removing it:

image