UE 5.1 MetaHumans | Issue with shadows after converting from UE 5.0

After converting from UE 5.0 to 5.1, lightning/shadows on my MetaHuman is really off. More specifically groom assets, everything else such as clothes or whole environment is just fine.

On the picture below you can see the current state of shadows. When lighting is directly on MetaHuman everything is fine, but as soon as you look from the other side it’s way too dark.

I’m truly not savvy in dealing with lightning/shadows issues, does anybody know where and how this problem could be fixed? When using 5.0 everything was working just fine, didn’t need to tune anything.