You likely need more photos inbetween or you need to define a few control points.
you can also change the alignment setting from Images overlap: high to medium or low.
That will widen the “search area” in the photos and possibly provide better alignment results.