Never mind, I figured it out. It was me just not thinking straight.
The solution was very simple. I just had to put the upper body stuff before the root animation.
