Is there way to run automated functional tests through the command line in UE5?

Development Programming & Scripting Blueprint
, , ,
1

I have created some Functional tests using Blueprints in UE5. I would like to add these to our CI/CD pipeline, so whenever we build the game, the tests run as well.

Is there a way to do that in UE5?

2

So far I’ve used the ‘UnrealEditor.exe’ to run my test with the -nullrhi flag - the test seems to run but I don’t get any output of whether it succeeds or not.

I am very new to UE, so any help would be greatly appreciated :slight_smile: . Thanks.

Edit:
I got a bit farther now.
My full command at the moment looks like this:

 .\UnrealEditor.exe "{Path}/MyProj.uproject" -ExecCmds="Automation RunTest FTEST_MyBPTest;quit" -TestExit="Automation Test Queue Empty" -log -nosplash -Unattended -nopause -NullRHI -ReportOutputPath="{PathToOutputFolder}"

I get a json file with all tests that have succeeded/failed, but in order to stop my CI/CD pipeline (if a test failed) would be to parse this file and check for any failed tests. Isn’t there an easier way to do this?

3

we had the same issue and then we implemented the same solution:
parsing the json file to get test results and if there’s any failed test quit the pipeline step with an “exit 1” to raise the error