Its only important if you want to rotate the building probably or want to place above the ground/terrain (for now).
Not for stuff that has a predefined transform.
I have red that you can change it in unreal -> https://forums.unrealengine.com/showthread.php?1140-Manually-changing-the-pivot-of-an-actor
but i do with a 3d programm.