Hello, our team has recently been working on getting automated performance tests setup in our project. Following this guide (A Tech Artist’s Guide to Automated Performance Testing | Unreal Fest Bali 2025 | Epic Developer Community), we’ve got one test running with the source engine build. However, we also have an internal binary version that we prebuild and release for our art team, and we would like these tests to work on that too.
Whilst we know automated performance tests are only supported in the source engine currently, an attempt was made to get them working for the prebuilt engine. In doing so, it was discovered that the following required build scripts were missing from said engine (there may be more missing, we have not done a thorough investigation):
This is something that we have not tested yet. It is part of the long term roadmap for APT but there is no ETA at this point.
I had a quick look at the state of 5.6 and it requires more than adding the missing XML files. There are some parts of the scripts that assume the project shares the same root folder than the engine. The BuildAndTestProject script also assumes it can compile the tools which is not possible in an InstalledBuild.
It does resolve the tool compilation and the “foreign” project parts. It does not resolve the missing scripts. That part would require modifying InstalledEngineFilters.xml to include Engine\Build\Graph\Tasks\… and Engine\Plugins\Performance\AutomatedPerfTesting\Build\Inc\AutomatedPerfTestCommonSettings.xml
We value automation very highly so we’re still going to pursue getting as much of the automated perf test framework working as we can (for our needs).
We’ll review the linked PR and we’ve already noted the continued development of this plugin in 5.7 and ue5-main and will take all of that into account (probably pull the changes early, where possible). Where appropriate we’ll try to upstream some of our changes.