AutomatedPerfTesting plugin does not build when building city-sample in ue5.5

[syui]

I created a city sample project and built it with ue5.5. I can’t update the windows-sdk. It seems that the AutomatedPerfTesting plugin is the cause.

[UE_5.5/Engine/Plugins/Performance/AutomatedPerfTesting/Build/Scripts/]
Not Found : AutomatedPerfTestConfig.cs , AutomatedPerfTestNode.cs

Using bundled DotNet SDK version: 8.0.300

UATHelper: Installing SDK (Windows): C:\Users\syui\Documents\Unreal Projects\yui\Build\Scripts\CSC(0,0): error CS2001: Source file 'C:\Program Files\Epic\UE_5.5\Engine\Plugins\Performance\AutomatedPerfTesting\Build\Scripts\AutomatedPerfTestConfig.cs' was not found. (C:\Users\syui\Documents\Unreal Projects\yui\Build\Scripts\CitySample.Automation.csproj)
UATHelper: Installing SDK (Windows): C:\Users\syui\Documents\Unreal Projects\yui\Build\Scripts\CSC(0,0): error CS2001: Source file 'C:\Program Files\Epic\UE_5.5\Engine\Plugins\Performance\AutomatedPerfTesting\Build\Scripts\AutomatedPerfTestNode.cs' not found. (C:\Users\syui\Documents\Unreal Projects\yui\Build\Scripts\CitySample.Automation.csproj)
UATHelper: Installing SDK (Windows): Failed to build: C:\Users\syui\Documents\Unreal Projects\yui\Build\Scripts\CitySample.Automation.csproj

This is where the file is specified.

${project}/Build/Script/CitySample.Automation.csproj

<Project Sdk="Microsoft.NET.Sdk">
  <Import Project="CitySample.Automation.csproj.props" Condition="Exists('CitySample.Automation.csproj.props')"/>
  
  <PropertyGroup>
    <TargetFramework>net8.0</TargetFramework>
  </PropertyGroup>

  <ItemGroup>
    <Compile Include="$(EngineDir)\Plugins\Performance\AutomatedPerfTesting\Build\Scripts\AutomatedPerfTestConfig.cs" />
    <Compile Include="$(EngineDir)\Plugins\Performance\AutomatedPerfTesting\Build\Scripts\AutomatedPerfTestNode.cs" />
  </ItemGroup>

</Project>

AutomatedPerfTestin is a plugin added to 5.5, I am having trouble updating windows-sdk. The windows-sdk is the latest version that worked with 5.4.

Experimental release of Automated Perf Testing Plugin v0.1, providing Gauntlet Test Controllers, UAT Test Nodes, and BuildGraph macros for adding common automated performance tests to a project’s automated build and test.

• Unreal Engine 5.5 Release Notes | Unreal Engine 5.5 Documentation | Epic Developer Community
• AutomatedPerfTesting | Unreal Engine 5.5 Documentation | Epic Developer Community

[syui]

@syui

Automation.csproj

I found a way. Go to github src and download the file.

• https://www.unrealengine.com/en/ue-on-github
• https://github.com/EpicGames/UnrealEngine/tree/release/Engine/Plugins/Performance/AutomatedPerfTesting/Build/Scripts

# example
$(EngineDir) = C:\Program Files\Epic\UE_5.5\Engine

# copy file
$(EngineDir)\Plugins\Performance\AutomatedPerfTesting\Build\Scripts
    ├──AutomatedPerfTestConfig.cs
    ├──AutomatedPerfTestInsightsReport.cs
    └──AutomatedPerfTestNode.cs

[2350lev]

Hi

I’ve used your solution

500×500 2.84 KB

disabled FAB plugin 0.1 experimental (error: working to slow) copy hostfxr.dll to D:\Epic Games\UE_5.5\Engine\Binaries\DotNET\UnrealBuildTool D:\Epic Games\UE_5.5\Engine\Binaries\DotNET\AutomationTool I found this SOLUTION, but THEN I get NEW error NUGET =) login to github connect github and epic account download 3 files (https://github.com/EpicGames/UnrealEngine/tree/release/Engine/Plugins/Performance/AutomatedPerfTesting/Build/Scripts) TO D:\Epic Games\UE_5.5\Engine\Plugins\Perfor…

Now I get NUGET error
UATHelper: Packaging (Windows): D:\Epic Games\UE_5.5\Engine\Source\Programs\Shared\EpicGames.IoHash\EpicGames.IoHash.csproj(0,0): error NU1301: Unable to load the service index for source https://api.nuget.org/v3/index.json. (D:\Unreal Projects\CitySample\Build\Scripts\CitySample.Automation.csproj)

Did you managed to package UE5.5 Matrix city demo?
How long did it took on your CPU?
I’ve researched NUGET error on the Inet, but didn’t find any working solution. Any ideas? =)

[syui]

Yes, I have successfully packaged the city sample this way.

I read your article. Your method was completely correct.

The first build takes 2-3 hours. Next time it will be reduced to about 30 minutes.

Are you still having this problem?
Maybe there is a problem with the windows sdk.

Troubleshooting NuGet Package Restore in Visual Studio

[2350lev]

New error after 90 seconds. CS1225 invalid expresion
UE Editor goes from 22GB to 27GB and becames unresponsive on my 32GB RAM
How many RAM do you have? UE process in your PC is how big when packaging?

Which components do I also need ?

[2350lev]

: error CS1002: ; expected
: error CS1525: Invalid expression term ‘<’
: error CS1525: Invalid expression term ‘/’
: error CS1525: Invalid expression term ‘<’
error CS1525: Invalid expression term ‘/’
error CS1525: Invalid expression term ‘<’
error CS1525: Invalid expression term ‘/’
error CS1733: Expected expression
error CS1002: ; expected

[2350lev]

Still no luck =)
did it work for You out-of-the-box or you had to manually correct some syntax errors in some files?
neither UE5.4 and Matrix5.4 nor UE5.5 and Matrix5.5 work. I have downloaded them both. They Just report different errors, UE5.5 Editor has memory leak and exe goes to 27GB and becames unresponsive after 90 seconds reports error, UE5.4 exe stays at 6GB and reports error after 4 min

[syui]

From what I’ve seen the windows sdk configuration is probably fine.
The memory is 32GB. The build was successful when I brought the files from github. Nothing else was done.
If the build fails when you can start it in the editor, there may be some kind of bug.
If the build fails even with ue5.4, this method cannot be used to resolve the issue.

I heard that for 5.4 it’s a good idea to delete CitySampleCookedEditor.Target.cs.

Targets with a unique build environment cannot be built with an installed engine.

In the case of City Sample and UE 5.3.2 that line doesn’t exist in any .Target file and I even tried doing “BuildEnvironment = TargetBuildEnvironment.Shared;” in all .Target files and nothing changed, I still can’t generate the project files.

[2350lev]

You have heard right =)
5.4 it’s a good idea to delete CitySampleCookedEditor.Target.cs
MATRIX5.4 packaged SUCCESSFULLY

1. 32GB RAM + 16GB PAGEFILE = CRASH
   32GB RAM + 32GB PAGEFILE = finished =)

2. There is not enough space on the disk. = CRASH

vault cache 5.4 100GB (can be deleted = download cache)
project 5.4 100GB (= copy of vault cache + more)
project cooked +100GB
package 5.4 20GB
UE5.4 40GB
= 360 GB

Running AutomationTool…
Using bundled DotNet SDK version: 6.0.302
Starting AutomationTool…

BUILD SUCCESSFUL
AutomationTool executed for 0h 27m 31s (3rd try)
AutomationTool exiting with ExitCode=0 (Success)
I think It took in summary about 1 hour in 3 tries on 12600k

minimum?? VS2022 components needed (maybe any other can be substracted =) )

Now I will try to package Matrix 5.5

Thanks for the tip for Matrix 5.4 =)

[2350lev]

MATRIX 5.5 - I downloaded 3 files 1 by one from github again and now cooking is working
Installed win app development 10GB
NET core 3.1

G:\EpicGames\UE_5.5\Engine\Plugins\Performance\AutomatedPerfTesting\Build\Scripts
├──AutomatedPerfTestConfig.cs
├──AutomatedPerfTestInsightsReport.cs
└──AutomatedPerfTestNode.cs

I clicked do not show this Warning again - SDK is not installed properly.

Packaging (Windows): Running AutomationTool…
Packaging (Windows): Using bundled DotNet SDK version: 8.0.300
Packaging (Windows): Starting AutomationTool…

Using Visual Studio 2022 14.38.33143 toolchain (G:\Visual Studio win11\2022\VC\Tools\MSVC\14.38.33130) and Windows 10.0.22621.0 SDK (G:\Windows SDK win11)

UnrealEditor exe is hovering around 17-20GB, memory commited 70/80 GB

********** ARCHIVE COMMAND COMPLETED **********
Packaging (Windows): BuildCookRun time: 14228.29 s
Packaging (Windows): BUILD SUCCESSFUL
Packaging (Windows): AutomationTool executed for 3h 57m 16s
Packaging (Windows): AutomationTool exiting with ExitCode=0 (Success)

I moved all 12+ ShaderCompilerWorker.exe from Ecores to POWER cores with Process Lasso on 12600k 32GB RAM

vault cache 5.5 100GB (can be deleted = download cache)
project 5.5 100GB (= copy of vault cache + more)
project cooked +100GB
package 5.5 20GB
UE5.5 40GB
= 360 GB