I’ve tried this with verbose logging enabled, but unfortunately no change:
One interesting thing is that the On Failture outcome was logged before the generic execution pin outcome.
[2024.11.17-07.48.12:773][555]LogBlueprintUserMessages: [W_MainMenu_C_2147482451] Finding sessions...
[2024.11.17-07.48.12:774][555]LogOnline: VeryVerbose: OSS: FOnlineAsyncTaskManager::AddToInQueue [FOnlineAsyncTaskSteamFindLobbiesForFindSessions bWasSuccessful: 0 NumResults: -842150451]
[2024.11.17-07.48.12:776][555]LogOnline: VeryVerbose: OSS: FOnlineAsyncTaskManager::GameTick Starting serial task [FOnlineAsyncTaskSteamFindLobbiesForFindSessions bWasSuccessful: 0 NumResults: -842150451]
[2024.11.17-07.48.12:776][556]LogOnlineSession: Verbose: STEAM: Starting search for Internet games...
[2024.11.17-07.48.12:780][556]LogRHI: Display: Encountered a new graphics PSO: 1911018763
[2024.11.17-07.48.13:286][705]LogOnline: Verbose: STEAM: FOnlineAsyncEventSteamLobbyUpdate LobbyId: Lobby[0x1860000B02F1DBE]
[2024.11.17-07.48.13:286][705]LogOnline: VeryVerbose: OSS: FOnlineAsyncTaskManager::AddToOutQueue [FOnlineAsyncEventSteamLobbyUpdate LobbyId: Lobby[0x1860000B02F1DBE]]
[2024.11.17-07.48.13:328][718]LogOnline: Verbose: OSS: Async task 'FOnlineAsyncTaskSteamFindLobbiesForFindSessions bWasSuccessful: 1 NumResults: 1' succeeded in 0.554131 seconds
[2024.11.17-07.48.13:328][718]LogOnline: VeryVerbose: OSS: FOnlineAsyncTaskManager::AddToOutQueue [FOnlineAsyncTaskSteamFindLobbiesForFindSessions bWasSuccessful: 1 NumResults: 1]
[2024.11.17-07.48.13:330][718]LogOnlineSession: STEAM: Found 1 lobbies, finalizing the search
[2024.11.17-07.48.13:330][718]LogOnlineSession: STEAM: Search result 0: LobbyId=Lobby[0x1860000B02F1DBE], LobbyId.IsValid()=true, CSteamID(LobbyId).IsLobby()=true
[2024.11.17-07.48.13:333][718]LogScript: Script Msg: Found a session. Ping is 9999
[2024.11.17-07.48.13:333][718]LogOnline: VeryVerbose: OSS: FOnlineAsyncTaskManager::AddToInQueue [FOnlineAsyncTaskSteamFindServers bWasSuccessful: 0 Results: 0]
[2024.11.17-07.48.13:333][718]LogOnline: VeryVerbose: OSS: FOnlineAsyncTaskManager::GameTick Starting serial task [FOnlineAsyncTaskSteamFindServers bWasSuccessful: 0 Results: 0]
[2024.11.17-07.48.13:333][719]LogOnlineSession: Verbose: STEAM: "gamedir" "unrealtest"
[2024.11.17-07.48.14:174][968]LogOnlineSession: Warning: STEAM: Server response IP:118.31.223.0
[2024.11.17-07.48.14:174][968]LogOnlineSession: Warning: STEAM: Removed incompatible build: ServerBuildUniqueId = 0x00000000, GetBuildUniqueId() = 0x023ecee6
[2024.11.17-07.48.14:378][ 25]LogOnlineSession: Warning: STEAM: Server response IP:3.21.236.47
[2024.11.17-07.48.14:378][ 25]LogOnlineSession: Warning: STEAM: Removed incompatible build: ServerBuildUniqueId = 0x00000000, GetBuildUniqueId() = 0x023ecee6
[2024.11.17-07.48.14:418][ 35]LogOnlineSession: Warning: STEAM: Server response IP:76.139.168.52
[2024.11.17-07.48.14:418][ 35]LogOnlineSession: Warning: STEAM: Removed incompatible build: ServerBuildUniqueId = 0x00000000, GetBuildUniqueId() = 0x023ecee6
[2024.11.17-07.48.15:980][487]LogOnlineSession: Warning: STEAM: Failed to respond IP:134.17.6.4
[2024.11.17-07.48.15:980][487]LogOnlineSession: Warning: STEAM: Failed to respond IP:173.248.51.7
[2024.11.17-07.48.15:980][487]LogOnlineSession: Verbose: STEAM: Server query complete '0' eServerResponded (Server success)
[2024.11.17-07.48.15:980][487]LogOnline: Verbose: OSS: Async task 'FOnlineAsyncTaskSteamFindServers bWasSuccessful: 1 Results: 0' succeeded in 2.646849 seconds
[2024.11.17-07.48.15:980][487]LogOnline: VeryVerbose: OSS: FOnlineAsyncTaskManager::AddToOutQueue [FOnlineAsyncTaskSteamFindServers bWasSuccessful: 1 Results: 0]
[2024.11.17-07.48.15:981][487]LogBlueprintUserMessages: [W_MainMenu_C_2147482451] Success! Found 1 sessions
[2024.11.17-07.48.15:981][487]LogBlueprintUserMessages: [W_MainMenu_C_2147482451] Hanayou
[2024.11.17-07.48.15:981][487]LogBlueprintUserMessages: [W_MainMenu_C_2147482451] Joining Session...
[2024.11.17-07.48.17:979][ 40]LogBlueprintUserMessages: [W_MainMenu_C_2147482451] 109775243873033662
[2024.11.17-07.48.17:979][ 40]LogOnlineSession: Warning: STEAM: [FOnlineSessionSteam::JoinSession] The values of FOnlineSessionSettings::bUsesPresence and FOnlineSessionSettings::bUseLobbiesIfAvailable are treated as equal and have to match
[2024.11.17-07.48.17:979][ 40]LogBlueprintUserMessages: [BP_GameInstance_C_2147482572] Join Session Failed!
[2024.11.17-07.48.17:979][ 40]LogBlueprintUserMessages: [BP_GameInstance_C_2147482572] JoinSession Executed....