AddForce is preserved even after I stop applying it

It simulates physics, so it keeps its momentum. If you want it to stop, you have to explicitly tell it to stop.