Rolling Ball on two static meshes, problem with collisions

I eventually found the solution:

You need to adjust the physics simulation settings of your project. Specifically the “Contact Offset Multiplier” and the “Contact Offset” bounds. Beware of the trade-offs for performance.