Do you have this in your .rc?
#include "Runtime/Launch/Resources/Windows/resource.h"
We also had the problem you describe until added this line. I actually don’t understand how rc.exe worked at all without this line, because that header defines what IDICON_UE4Game is.