Common UI - Why doesn't my PS4 controller work when I open a menu?

Title is basically it. I’m using a PS4 controller to test my game in Unreal. I set everything up using Raw Input and the Windows dualshock plugin. All of my in-game inputs work (I’m using Enhanced Input) for the controller, but when I open the very basic menu I made using Common UI, the controller stops being recognized completely. Nothing fires, even when I set up Input Actions to work when the game is paused. All of these input Actions also have mouse/keyboard and xbox controller inputs mapped to them and they all work when I open the menu, but the PS4 controller just completely stops working. I can’t find anything similar to this topic, so I thought I’d ask the question here.

TLDR: I press start and open a pause menu I built using Common UI and my controller stops working. I can switch to an xbox controller and mouse/keyboard and everything works fine.

I can post more information if this isn’t enough to go on.