Looking for advice on setting up a material with multiple uvs for damage and paint.

I’m trying to create a stucco building set and I want to add damage and cracks to corners and such, but I’m not super happy with the workflow I’ve come up with. Basically I created two uv maps for the assets and use the first for the tiling texture and the second for the trim sheet. The problem I’m running into is that I don’t want to have too many uv maps, but I think I’ll probably need 3 or 4 to get the look I want. Is there any advice you could give me on how you would go about this? Thanks in advance

Here’s what I’m trying to recreate


Here’s my material setup. I use heightlerp with vertex painting for the basic materials, and a regular lerp to blend the trim sheet.


This is a quick mockup with placeholder textures. As you can see the method I’m using gets me the results I want, but I’m not sure if it’s the best way do do it