You can ‘‘model’’ with brushes but it’s a pain without advanced modifiers and snap tools from a 3d modeling software. Any slightly more complex geometry than a rectangle will be painful. Also, in 3ds max for example, you can download a ton of scripts and plugins to create stuff automatically for you. I have one that build brick walls procedurally with the click of a button!!!
And if you are serious about architecture viz you’ll see that you usually have to use the 3d models/2d cad plans your client will give you anyway!