There's no way to use Quixel materials that have displacement on UE5?

What do you mean by crappy. Have you tried even following those steps. And if you are a power user there is a example maps in the plugin directory as well.