Managed to fix it. Not really a bug, It’s just how widgets work. https://forums.unrealengine.com/development-discussion/blueprint-visual-scripting/83520-how-to-make-umg-block-left-and-right-clicks
I just put an invisible button under skill buttons. A bit hacky but it works.