Physics interupting input, help

I have a pawn that recieves mouse and touch input, and it works perfectly fine as long as I do not have physics enabled. As soon as I turn it on the input goes wonky, the pawn doesn’t move, it disappears, and it doesn’t release. Turning physics off on touch input doesn’t help, so I ask for some help.