Same result with your suggested settings.
Settings are shown on left panel.
I am using a variety of focal lengths (in a truck), but have no issue on the face or hands - its seems to only occur on larger areas of single tone garments or this high contrast garment with text.
Photo Consistency nails it!
Unwrap:
https://drive.google.com/file/d/1Dxg23hIbRmZ54IBBDGjNxljPNzYu1WXI/view?usp=sharing
Your Visibility Based suggestion:
https://drive.google.com/file/d/1A8IN4DkYEkmUmAgFRG55ffHnwqw0FeWy/view?usp=sharing
Photo consistency:
https://drive.google.com/file/d/1_-RXIVdTePeLenTPXyEiiwzc3F8p5i4y/view?usp=sharing