You may need to restart the Launcher to have it refresh the available versions. Also, make sure you’re on the Library page of the Unreal Engine section, and look for the “+” button in the upper left. For me, “add an engine version” initially defaulted to an old one that is available but not installed, but 5.4.0Preview was on the version dropdown list once the “slot” for the new install was added.