OnlineSubsystemSteam failed to start. Will it be the reason that my unreal game not working on WAN?

My game on unreal engine 4.24 works on LAN but not WAN. I’m wondering if it’s because OnlineSubsystemSteam failed to start? What does this OnlineSubsystemSteam do actually? I read many related posts on google, most of them just vaguely mentioned ‘u need integrate with steam for your unreal game to work on WAN’. But didn’t mention why Steam can get it work on WAN theorectically? Anybody has the unreal log that they have the game working on WAN and they’re using OnlineSubsystemSteam (or ‘integrate with Steam’)?

Also by this log, I failed to see why OnlineSubsystemSteam didn’t work? Is that because SteamUtils,xxxx failed?

I have tried:

  • Put ip of my computer which is hosting the game on DMZ on my router.
  • Added rules on Port Forwarding on my router to allow router to basically ‘reroute’ all ports to my computer.
    Private port: 1-65535
    Public port: 1-65535
    Private IP: Ip of my computer hosting the game

None of them worked. I used https://canyouseeme.org/ supplying external IP of my router and Port 27036, it says working and not blocking. But if I supplied any other port, it either says connection timeout or refused. I suspect it’s not because port is being blocked, it’s just because there’s no respective ‘listener’ listening on designated port except 27036 which is steam remote player listener. I tested by telnet internal-ip-address-of-my-computer 27036, it also works. I saw ppl keep suggesting me to do port forwarding, what exactly the port needs to be put to port forwarding for my case (game on unreal engine 4.24 but packaged and sent to steam, play from steam)?

Any help will be appreciated! I have been struggling with this for a week, exhausted all possible ways.

Unreal log:

LogSteamShared: Display: Loading Steam SDK 1.46
LogSteamShared: Steam SDK Loaded!
LogOnline: OSS: Creating online subsystem instance for: Steam
LogSteamShared: Warning: SteamAPI failed to initialize, conditions not met.
LogOnline: Warning: STEAM: Steamworks: SteamUtils() failed!
LogOnline: Warning: STEAM: Steamworks: SteamUser() failed!
LogOnline: Warning: STEAM: Steamworks: SteamFriends() failed!
LogOnline: Warning: STEAM: Steamworks: SteamRemoteStorage() failed!
LogOnline: Warning: STEAM: Steamworks: SteamUserStats() failed!
LogOnline: Warning: STEAM: Steamworks: SteamMatchmakingServers() failed!
LogOnline: Warning: STEAM: Steamworks: SteamApps() failed!
LogOnline: Warning: STEAM: Steamworks: SteamNetworking() failed!
LogOnline: Warning: STEAM: Steamworks: SteamMatchmaking() failed!
LogOnline: STEAM: [AppId: 0] Client API initialized 0
LogOnline: Display: STEAM: OnlineSubsystemSteam::Shutdown()
LogOnline: Warning: STEAM: Steam API failed to initialize!
LogOnline: Display: STEAM: OnlineSubsystemSteam::Shutdown()
LogOnline: OSS: Unable to create OnlineSubsystem module Steam
LogOnline: OSS: Creating online subsystem instance for: NULL
LogOnline: Verbose: OSS: Created thread (ID:10008).
LogInit: WinSock: version 1.1 (2.2), MaxSocks=32767, MaxUdp=65467
LogOnline: OSS: TryLoadSubsystemAndSetDefault: Loaded subsystem for module [NULL]