Unreal 5.1: Materials don't load properly on level change, but they work if the map is played directly

Then, yes, there has to be something wrong with the material you are using.
Find a texture (or material) that is as close as possible to your old material, and if that renders, then you just might have to use that one. Also a texture or material that you like, of course