Push and pull grabbed physics object with scroll

I have a BotW style system for grabbing a physics object and moving it around by looking around but I would love to add a way to “push and pull” the object away from or closer to the player actor by scrolling but not sure how to go about it. Any ideas?