Ah yeah, that worked perfectly although I also had to set the center to 0 on the material.
I now have it set up with a parameter between 0 and 10, and a displacement material value of 10 for a maximum of 10cm displacement with the ability to reduce to whatever distance is needed.
Edit: for anyone needing a reference here is my node set up (the parameter has a max slider value of 10)