Downloading Epic Games Launcher and installing any Unreal Editor version (through Unreal Engine tab > Library > Engine Versions > “+” button > Install, will also ask to associate .uprojects with the launcher, automatically, after it has finished installing (select Fix Now).
uproject files are not associated with this Launcher. Would you like to associate them now?
My issue had been that I didn’t have any installed build (“vanilla”) versions of the editor installed.