Time dilation gives different results every time

I currently have a sequence that speed ramps from normal time to slow motion using the time dilation track in sequencer.

When using 100 samples for testing I get the result im looking for timing wise but when I render in higher samples like 2048 for the final shot, the timing is much more prolonged and seems to be adding more frames.

Is there any way to get consistent results or possibly bake the timing/animation?

I get these errors every time if this helps.

Thanks!