Hi everybody,
I have some automation tests I wish to execute in a packaged game using a CI workflow.
So I have setup Gauntlet to start the test after packaging the game.
I am using the command .uat RunUnreal -- -build=local -Test="UE.TargetAutomation" -RunTest="My.Awesome.Test"
to start Gauntlet testing. This starts the packaged game, as well as the editor, without any issues.
The game log shows me that it detects all my own automation tests as well as engine internal tests just fine:
[2025.06.18-14.11.51:707][868]LogAutomationCommandLine: Display: Found 1335 Automation Tests
[2025.06.18-14.11.51:707][868]LogAutomationCommandLine: Display: 'My.Awesome.Test'
....
However the editor gets stuck while trying to communicate with the game. It tells me that it cannot find any workers:
[2025.06.18-14.12.42:147][383]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.12.42:161][383]LogAutomationController: Received FindWorkersResponseMessage from 51A12BD34B624D63BCBACC9844010188
[2025.06.18-14.12.42:175][383]LogAutomationController: Requesting test list from 51A12BD34B624D63BCBACC9844010188
[2025.06.18-14.12.42:188][383]LogAutomationWorker: Received RequestTestsMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.12.42:484][383]LogAutomationWorker: Set 2396 tests to 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.12.42:497][385]LogAutomationController: Received RequestTestsReplyCompleteMessage from 51A12BD34B624D63BCBACC9844010188
[2025.06.18-14.12.42:510][386]LogAutomationController: 2396 tests available on 51A12BD34B624D63BCBACC9844010188
[2025.06.18-14.12.42:523][388]LogAutomationCommandLine: Ignoring refresh from ControllerManager. NumDeviceClusters=1, CurrentState=2
[2025.06.18-14.12.42:893][432]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.13.12:887][ 10]LogAutomationCommandLine: Can't find any workers! Searching again
[2025.06.18-14.13.12:900][ 12]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.13.42:902][606]LogAutomationCommandLine: Can't find any workers! Searching again
[2025.06.18-14.13.42:915][607]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.14.12:922][202]LogAutomationCommandLine: Can't find any workers! Searching again
[2025.06.18-14.14.12:935][203]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.14.42:927][795]LogAutomationCommandLine: Can't find any workers! Searching again
[2025.06.18-14.14.42:940][797]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.15.12:935][390]LogAutomationCommandLine: Can't find any workers! Searching again
[2025.06.18-14.15.12:948][392]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.15.42:958][987]LogAutomationCommandLine: Can't find any workers! Searching again
[2025.06.18-14.15.42:971][989]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
[2025.06.18-14.16.12:965][582]LogAutomationCommandLine: Can't find any workers! Searching again
[2025.06.18-14.16.12:979][584]LogAutomationWorker: Received FindWorkersMessage from 57EE7EDF4F9C7A1B281A32B5CB3097BE
Because of this, Gauntlet gets stuck and aborts after 300 seconds.
I am testing everything on my local machine on Windows (no CI involved yet). Do I have to do any setup for the project to make Gauntlet work? Or am I missing something with the command I am using?
Any help is much appreciated, thank you.
- Engine Version: UE 5.5.4 (Epic Launcher version)
- Platform: Win64