I don’t know if this will work, but maybe setting a lock on your mouse events will keep the hijack from happening. Use a boolean and branch to set the lock during these pans.
If the mouse still works after that, then I don’t know what’s going on and you may want to bring it up to Epic.