I’ve found a relative good solution. It still has some skews and distortion at extreme camera angles, but it’s ok for me. If anyone interested, here is the material graph.
I will not mark it as Solution for now. Maybe someone knows a better way?