Light/Shadow popping when using HDRI backdrop in UE 5.3

I have been trying out the HDRI Backdrop to add in a sky and some skylight to my scene. Overall it seems to work pretty well but I have noticed that is is causing some odd “popping” in the lighting/shadows. If you look at the lower right-hand corner of this scene, you can see as the camera pulls back and forth, I get some weird splotchy pops between the edge of the cliff, and the valley below. With the clouds in there (HVols) it appears more evident. Might anyone have a solution to this issue?

UE5.3_popping
popping