IK Tick delay issue

I placed a box in front of me that I could push or pull with my physics arm, placed the arrows in the right places, and connected my hand bones to these arrows with two IK bones. It works fine when I’m not moving, but when I do, my hands shift slightly. I think IK is lagging. Slowing down time (the physics arm’s interpolation speed is 10,000) fixed this problem. How can I fix this?