For some reason it would not show up at all as an update.
I had to uninstall everything (the engine and the Epic launcher) redownload the laucher/engine installer, reinstall it, and only then it would show up as an option.
But now it wont launch the engine:
"Launch Failed
The prerequisites for Unreal Engine failed to install.
Error Code: LS-0019-IS-0001"
I searched for that error code and nothing came up.
So I’m not sure how to fix the error code if there’s nothing referencing it.