VR Expansion Plugin

Is it possible to prioritize a object to be gripped, having issues with trying to grab a small physics object on a table, seems to attempt to grab the table as well and requires some precision to grab the object