Create Pushable Button

I am trying to create a physical button that a character can push to trigger an event. I am using Oculus Touch remotes for the hands, but I don’t know how to set up the object so that it responds to the force of the hand. I need the button to press in when the hand hits it and be able to hold it there until the hand moves again an is no longer colliding with it. I can do it currently by using an animation that triggers when the hand overlaps a collision box, but I want to fully use the physics of the hand and button. Any ideas?