I worked with that today and if you don‘t need that displacement and the normal is enough for you I have a solution to present.
just ignore those mmo noises xD
that white square at the end is the original 1x1x1 size the whole plane is 20x20x20 and can basically be as large as you want it
if you are interested I‘ll post the answer tomorrow