How do I use the eye-dropper tool without selecting the object I clicked

I’m using this one in the widget blueprint.

If I want to pick a green off this button instead of orange, it’ll set it to green alright, but it’ll also select that button, making me have to click back on what I was editing.