Race track wall collision

I am in the process of making a race track with high walls, as i drive around the track it is smooth until i drive near a wall. The car acts as if it hits a rock and flips/ spins out. How do i fix this? do i need to add more polygons in my modeling software?

Add a Physical Material with a lower friction value.

I think you need to provide a lot more information about your setup. E.g., How are you modelling the wall? Is it part of the same actor/asset as the track or are they different? Here is a video of some of my tests involving hitting the wall of a racetrack, seems to work ok.