Hi Ruben,
so all the drone images are supposed to be at more or less the same altitude?
Then there is some serious misalignment going on, or rather false distortion parameters seem to have been applied.
Did you try exif grouping yet? When you do that in the first alignment run, it should prevent such gross errors…