Flickering DOF and AA in rendering

This is a project we already delivered to a client, but now we want to make a sequence for reeling purposes. Problem, Lots of flickering.

I already can pinpoint this is being caused by TemporalAA, although, i have no idea how to fix it.

No matter if the performance is impacted, we will be rendering the sequence anyway.

Any ideas how to fix the flickering?