Extrude polygon tool snaps to itself

Has anyone found a solution? The enforced snapping within the yellow box is really annoying. No snap setting seem to have an effect on this!