It appears the drag event itself is stopping other inputs, so maybe there is something I need to change there.