It only needs to recompile shaders, when I change a vertex factory shader, I could probably be more careful with the ShouldCache function, I plan to do a refactor over the weekend so I will see if I can reduce the number of shaders needing a recompile.