Interact/Grab Physics Asset with Motion Controller

Isn’t that what Physics Handles are for? This tutorial may be useful:

Cheers,
Marco.