It isn’t actually, World Normal buffer shows no inversion.
Probably not the best way to describe the effect i would like to get rid of, but to me it just looks somewhat similar to red channel being flipped in shadow areas. In general, all i want to do is to make those grout lines look nice and straight. What i have now is ruined by this nasty inversion offset.
