The second issue of the shadows dissapearing when you look at the wall is actually an exposure problem, you can fix it by adjusting the brightness in the PPV.
Also, could you share screenshots of your lumen scene? There could be a mismatch between the SSGI and the lumen scene representation.