[Cpp] Can't bring up steam overlay when using steam online subsystem

I was able to get LAN multiplayer working using NULL online subsystem, but I think am failing to migrate this to the steam subsystem. I’m unsure because there are no clear errors, but all the guides I read suggest I should be able to use the steam overlay if I’m successful, which I cannot do. I am trying to set up v139, and I can’t see to find any tutorials for this that are in C++ and also use a newer version of unreal than 4.13. I followed Rama’s Guide most closely when trying to set it up, as well as the official page from epic.

My DefaultEngine.ini looks like this:

[/Script/Engine.GameEngine]
!NetDriverDefinitions=ClearArray
+NetDriverDefinitions=(DefName="GameNetDriver",DriverClassName="OnlineSubsystemSteam.SteamNetDriver",DriverClassNameFallback="OnlineSubsystemUtils.IpNetDriver")

[OnlineSubsystem]
DefaultPlatformService=Steam

[OnlineSubsystemSteam]
bEnabled=true
SteamDevAppId=480
SteamAppId=480

[/Script/OnlineSubsystemSteam.SteamNetDriver]
NetConnectionClassName="OnlineSubsystemSteam.SteamNetConnection"

My build.cs has the following:

PublicDependencyModuleNames.AddRange(new string[] { "Core", "CoreUObject", "Engine", "InputCore", "UMG", "OnlineSubsystem", "OnlineSubsystemUtils"});
DynamicallyLoadedModuleNames.Add("OnlineSubsystemSteam");

My target.cs has the following:

bUsesSteam = true;

In my edit->plugins window I have enable ticked for the steam subsystem.

I open steam before opening the unreal editor. When I run the game in standalone, and try to host a session, it still uses the NULL subsystem. The only mention of steam in the logs (using LogOnline=All) is

LogOnline: Display: STEAM: Loading Steam SDK 1.39
LogOnline: Warning: STEAM: Steam API disabled!
LogOnline: Display: STEAM: OnlineSubsystemSteam::Shutdown()
LogOnline: Unable to create OnlineSubsystem module Steam
LogOnline: Unable to load default OnlineSubsystem module Steam, using NULL interface

When I google the Steam API Disabled warning, I mostly get results from people debugging the packaged version of the game, and many people even report that the Steam API Disabled warning isn’t even a problem. Many people report that they can still use the steam overlay despite these warnings.

I absolutely hate when I find a solution right after posting a question. If I run the game from the editor using Launch instead of Play in Standalone, it uses the Steam subsystem instead of NULL subsystem. I would still like to know a) why it does that and b) how can I get it to use the Steam subsystem in standalone mode (launch takes way too long to boot up).

i think PIE uses a different ini file than standalone maybe. I know packaged builds definitely can.