Could it be that the surfaces are being triangulated by the engine? Maybe setting the mesh/surface not to deform and or, keep quads, will reduce additional geometry? If the physics are correct, enough velocity will introduce aerodynamics. Perhaps giving the ball a Physical Material of lead :).
Just occurred to me, have you tried raising the value of gravity?