Preview window height changes every time I click play

Happens on UE 4.26.1

I started a project from a 2d template and every time I click the “play” button, the window gets a bit taller, regardless if it’s a new editor window (PIE) or a standalone game window. It doesn’t happen if I click “launch”, but of course that’s not ideal.

Any ideas how to fix it?