Thanks everyone for the help, I figured out the problem and it is of my own making. I have a Move Component To node on event tick, to update the target position of my pawn, but the default target position is 0, 0, 0. So every time I spawned it set my pawn at that location.
Figured this out thanks to your advice on doing some print statements and seeing it be called on startup.