It sounds like sockets would be the way to go, like you tried! Could you clarify what you mean by “it seem to conflict with the existing physic of picking things up in VR.”? Perhaps you are forgetting to turn physics simulation back on when you place the object down?