I don’t think it works with PSO because it is generated at runtime. However, didn’t all the shaders get compiled during the packaging stage? So, the end-user may not see any shaders compiling when they play the packaged game.
You may take a look at this discussion Compile shaders on game launch?