Is there a way to prevent an object from being grabbed from the Physics Handle?

Yes, there is a way to prevent an object from being grabbed by a Physics Handle in Unreal Engine.