Weird behaviour when activating -> deactivating simulate physics

I need to activate physics simulation for my character to bounce while the key is pressed. But when I deactivate it again my character regains the movement he had just before activating the simulation, do anyone have any idea why this is happening?

I would also accept another way of creating this effect, since I’m new to UE4 and this may not be the best way to do what I want.