Generally, you are doing it right, but you might try using a smoother heightmap with less sharp black to white transition.
Bump offset is capable of adding only a minor perception of depth. For a better effect, consider using Parallax Occlusion Mapping.