Align Images not using all photos

Out of curiosity, is it “critical” critical that the photos themselves are captured in a circle? When I photographed the building, I walked up and down the sidewalk parallel and perpendicular to the building (three passes: facing the building, and at both 45 degrees to the building). The shape of the street prevented me from being able to do the traditionally recommended onion skin technique.