I believe to have found a solution: In your material turn off “Tangent space normal”, then use the “Derive Tangent Basis” function with your normal map and plug the “World Space Normal” output into your materials “Normal” input.
2 Likes