Avoid blurry images if you can, but keep them in spots where you otherwise don’t have enough coverage.
Blurry images are a source of (sometimes much) less accurate alignment and bad/blurry texture since the algorithms have to guess a lot more where the features are.