Run AutomatedPerfTest in Shipping?

Development Pipeline & Plugins
, ,
1

Is running APT in the shipping configuration supported?

I gave it a try and it failed at the very end of the tests in `Gauntlet.UnrealTestNode.GetExitCodeAndReason`. The check for engine initialization in the logs fails - which is obvious since Shipping doesn’t collect logs. `AutomatedPerfTestNode.GetExitCodeAndReason` has a bypass that prevents this failure in the Test configuration, but for some reason it doesn’t cover Shipping. Is this intended or an oversight?

The tests seemed to run fine in Shipping, and they should only rely on CsvProfiler which (according to comments in the header) should work in Shipping, so it seems that this should be supported/easy to support, but there might be things I am missing!

[Attachment Removed]

2

Hi,

I discussed with the owner, running in ‘Shipping’ is not recommended. The system is designed/tested to be run with the ‘Test’ target. Running in Shipping might work with some modifications, but it’s not supported and this is not a use case we test.

Regards,

Patrick

[Attachment Removed]