I cant compile/launch any C++ UE4 Projects even blank ones. Windows.h missing?!

Sorry, I didn’t check if link works. Launch visual studio installer and install Windows SDK.

If it will not help try Setting Up Visual Studio for Unreal Engine | Unreal Engine Documentation