It seems the cause is the Surface. Because the touch screen has absolute pointer positioning like a Wacom pad. If you touch the lower left corner and then touch the top right corner for example, the pointer jumps to the new position instead of staying in place like with mouse or track pad.
Still looking for a solution.