Could someone help me debug these rendering artifacts?

Thank you all. I feel the best solution will be to design the level geometry in Blender and export it as a mesh.

Do you mean set the diffuse colour to black for the level geometry, why exactly?