The pictures you attached in your post aren’t visible to me.
Anyway, I think it might be because of the heightmap quality yes. Also keep in mind that the more blurry your heightmap the more blurry / smudgy your height displacement will be. If you amp that up too high you will indeed get unnatural looking displacement. It’s better to have a heightmap with crisp details.