Problem with adding impulse

I move far from the world origin

How far? Could be floating point error.


Also, could you test it by holding still rather than while moving (in case you were) - see if that makes any difference?