When using lumen in an indoor scene, I found shadows getting hard and pixelated. When I baked the scene with proper lighting by switching of lumen and real time capture, the problems were gone.
Either we need to play around with lumen settings a lot or stick with normal lighting, till the issues are updated in the UE5 final version.