Aim offset with rifle causes left arm to float away

Here’s a video showing the solution i have so far. It’s still not perfect, since the left hand lags behind the movement. Hope someone can explain how to fix this.