Push/Pull Actor in Third Person

Hey there. I want to implement a Box that can be pushed / pulled around.
However, the Physics Handle doesn’t do what I want. The Physics Handle simply attaches the desired Component to the Character without any restrictions.
What I want is a more realistic approach, where the Character can’t freely push things around. More like this:

However, I’m clueless on how to start this, since my Movement is based on the ControlRotation/Camera and the Movement needs to be restricted to the radius of the Actor I want to push.