8k heightmap gives me very weird landscape

Please stop even suggesting for people to use photoshop at all.

Heightmaps are 16bit.
Photoshop does not work in 16 bit.

Whatever you get out of photoshop will never work correctly. Period.