Choppy renders on UE5, why ?

Hey guys, just wondering why my renders using the movie render queue are choppy.
It’s looking like micro frame skips or stuttering and I have absolutely no idea why this is happening.
I’ve increased my pool size limit a little bit to allow the project to breathe and I’m using an RTX 2080.

Here is my render, you can clearly see the frame jumps quite a bit at 0:19 :
UE5 render sequence