Proper way to rotate a POM (Parallax Occlusion Mapping)

What is the reason why the dark side color is darker when using the pixel depth offset