Knowledge Base: Practical Setup Tips for Horde Analytics & Performance Trends

[JulianGamble]

Just circling back to this: the above issue was discussed at length here:

How to set up the Automated Performance Testing to send and view results in Horde Performance Trends dashboard, and not having to look through it via the SummaryTable.html locally?

I have been trying to set this up for the past 3 days, the automated testing framework results generate ok locally into a SummaryTable.html, but I cannot send them reliably to Horde. It seems like it was made with P4 in mind, and I am not using that. My goal: I just want to run the RunLocalTests and see the results in the Horde Performance Trends dashboard, and not look through it via the SummaryTable.html. I am using the RunLocalTest and then sending it to horde with: dotnet “C:\Unreal5.8\…

The main issues observed:

• Out of band Horde emissions weren’t including the necessary horde elements
• As a result the user above tried to manually create columns
• The underlying Horde server wasn’t retrieving the data correctly as a result.

I will be making some patches to better support the out of band emissions. I expect this to land in a hotfix version of 5.8.X - once the changes are in I will submit them to the respective line.

Notable patches:

• (REQUIRED) PerfReportTool metadata parameters override
  • I
  • II
  • Rebuild CSVTools and use this version of PerfReportTool
• (REQUIRED) Dashboard fix
• ClickHouse telemetry sink optimizations

Updated full list (Sept 8th) : https://github.com/EpicGames/UnrealEngine/commit/ba87e38c4f34596a63421a339f18d5fcf61c926d - this introduces the payload override mechanism in PRT (REQUIRED)

• https://github.com/EpicGames/UnrealEngine/commit/8b7eb1de7e0376b0ec1cd838fea75cee0b6e60cd - this introduces server side optimizations (OPTIONAL)
• https://github.com/EpicGames/UnrealEngine/commit/902ccf78e0b31decf5512f937ddf13d45473ceca - this fixes out of band emissions on the dashboard (REQUIRED)
• https://github.com/EpicGames/UnrealEngine/commit/ca30ee7d1d2355564e67b33227c96f2535c05ca9 - fixes override order issues in PRT emissions - always guarantees command line will flatten metadata (REQUIRED)
• https://github.com/EpicGames/UnrealEngine/commit/01ba8cdfd7111c64ae1897da51b4670352cd4a9b - brings PRT emissions in alignment with Horde regarding URL resolution (OPTIONAL)