Hey I had the same issue. Looking at the source code I ended up finding that the SteamNetDriver didn’t have any wait time for disconects.
Adding this to the DefaultEngine.ini file fixed it for me.
[/Script/OnlineSubsystemSteam.SteamSocketsNetDriver]
RecentlyDisconnectedTrackingTime=120