Are you also using the mouse scroll wheel (right click + scroll forwards to speed up) to increase camera speed?