Twin stick shooter issue after adding ability to move on Z axis

I’m using the twin stick shooter template as a starting point for a project. The first thing I did was give the ship pawn the ability to fly up and down but while the pawn collides fine when hitting an object from the side, the pawn will move through things when going up/down in elevation. I’ve tried every combination of collision detection and hit boxes and I can’t figure out why it ignores when moving on the Z axis.