WPO does not alter the surface normals of the mesh, which is what is used to determine the shading of the mesh. The mesh was flat so when you displace it, it is still shading as if it was flat because all the surface normals are still pointing straight up.
In order to fix this you need to either recalculate the normals in your shader, or much more conveniently: Just use a normal map…