Hi @Astaraa,
How is shader compilation different for you in 5.1?
I know even pre-5.1 shader compilation would sometimes be deferred until you open the materials/meshes/maps. (Like after adding a marketplace asset pack).
On demand shader compilation is experimental and should already be off by default.