I updated the material using a bit of yours and a bit of my material and now I am super happy with the results.
Your approach works perfect for the main goal (shading from camera) but I noticed
Vivew aligned reflection works better for the specular highlight
Thanks man!
Here is the updated final material