This is due to the GPU occlusion culling. there is a one frame lag.
If you want to avoid it, Epic implemented software occlusion culling in 4.20.
Switch to this should avoid the one frame delay but will increase the cpu workload.
Its probably best to use it if you dont have too many objects. Try to use precomputed visibility culling, to save some performance there.