Well I just ran over this one, - while following a tutorial i might add. It just needs a better explanation as to what the various compile modes do and when you need to restart the editor, and rebuild the editor project as opposed to the debug game editor.
It took me a while to get my head around it but I guess your not only compiling the game but your compiling the ue4 part of the IDE too.