Player snapping onto physics bodies

I’ve tried adding some physics bodies to my world, turned on the physics interaction on my character (which, as expected, lets me interact with physics bodies), the problem is that whenever I stand on a physics body and apply force to it, the player moves with it, leading to some unpredictable results (for example, flying by standing on a piece of physics body geometry)

Any idea what’s going on? Appreciate any help.