You need to add a rolling friction (damping) in addition to the linear friction.
Else the angular momentum will keep turning into linear velocity.
Also, setting the auto-disable thresholds high will help making sure it actually “stops” when it’s “still enough.”