Have you checked how many items are being processed when you get those multi-seconds calls to ComputeIntermediateSpatialAcceleration? You could try to disable the code that uses AccelerationStructureTimeSlicingMaxQueueSizeBeforeForce to prevent those “flushes”.
Regarding the Landscape heightfield, the support for async injection was added in CL 38662612