How can I control World Displacement direction?

Usually you multiply the object normals by the displacement amount to ensure the displacement is in the correct direction for all parts of the mesh