Expandable Area Blocks Button from Gamepad

I have a UI driven experience and clicking a button expands information about that part.

No problems when using keyboard and mouse, but I want to add gamepad support.

Got it set up to focus in the menu, but when you think you’re gonna push the button it only expands the expandable area.

The Button is the Header of the expandable and the Body contains a scrollbox of more expandable areas.

It also skips the scrollbox buttons and only selects the Header buttons.

How do I set it up so the controller ignores the expandable area and only look at the buttons?