This is a great addition to Unreal Engine :). I just saw this PR from mpolaczyk (I dont know his forum name) that queues all shaders that require compiling so that user can manually do it later.
Here is the pull request https://github.com/EpicGames/UnrealEngine/pull/2660
Again, full credits to mpolaczyk :). Thanks man!