Bad normals (or tangents?) of my mesh?

Buildings should generally use tiling textures and trim sheets. Trim sheets are great for adding detail, tiling textures are cheap and allow for texel density even for large assets, and then you can use fancier material setups to add vertex painting or overlaying another texture based off position, etc, to add that variation.