Physics ball never stopping

Hi. I am trying to make a VR golfing game but for some reason the ball nerver stops rolling. I have tried changing linear damping, angular damping, friction, static friction, physics materials, I also stopped the angular velocity completely but it still never stopped rolling.


This image shows the velocity of the ball. When I hit it, it quickly goes from 1500cm/s to 120cm/s and then nerver decreases from there. This is really annoying as the whole game revolves around the ball rolling physics. Does anyone have a solution or anything I could try please?
Thank you.