If you’re scaling physically simulated bodies in a non-uniform way, you asking for trouble. Use a box collision, match the extent, attach non sim mesh:
The best example to demo is an egg, notice the clipping: