Pixelated, boxy and glitching shadows in UE 5.4.2

Hi,

I am using Unreal engine 5.4.2 to develop a VR walkthrough of a small office space. I am using Lumen for GI and lighting, with Virtual shadow maps. The scene is mostly looking good but I am getting some weird box-like artifacts, which are appearing in certain places, and are changing with the camera movement. This is making the scene very weird looking.

I am sharing some screenshots and video of the issue. If anyone has any idea as to why this is happening, please help me out.