How many collision primitives is too many?

Sure there is. A rough estimate is that each collision primitive is a box so 12 triangles per collision primitive. That would make your collision primitives somewhere around 768 polys. Then double it for a worst case scenario :stuck_out_tongue: