Click and Drag to Pan

I’ve created a blueprint that allows me to click and drag to pan through a level. It works great except for one problem. When I’m dragging to move and the cursor overlaps another object it glitches out a bit. I understand why it is doing it, but I can’t figure out a better way to accomplish this or a way to work around the glitch.