I tried different approaches and then I aligned only the 6 line and it was quite deformed…
So I tried to add the closest one and it was possible to align without any issue.
It is true that it should be aligned using the whole dataset, but as you know, this is not an ideal capturing way, so there could be some errors.
And it looks like there is something wrong with line 6, as using only those images it provides deformed alignment. Is there used something different to the other cameras?
Also, like the data 1, 2, 3, 4, 56 works to align (but not always), The only problem there is combination of 0 and 6 images.
The problem could be related to the insufficient number of features over the shirt area:
Wearing different shirt could improve the alignment.