Update
I fixed the you described where you’d end up selecting different source vertices while holding down the v key over different target vertices.
Now you can only select a single vertex per press of the snap key!
and while you hold down v, you can select as many target vertices as you want, and even if mouse cursor overlaps other source vertices, while the source actor is moving around, they will not be selected!
!