How to fix Physics Handle when you grab object under you

Hi, I made grabbing system, but when I grab object under my player this object pushing me up. How I can fix it?