Horde Agent's job gets auto-cancelled

Development Pipeline & Plugins
, ,
1

When scheduling a job that uses a pool that has this specific machine (FARM06), there is a one in ten chance that this machine’s job gets auto-cancelled (pic attached). There are no logs. View Log for the setup step and the test step are empty. The agent itself has Unreal toolbox running with the Horde Agent mode set to Dedicated. Any idea why this happens? Or if there is a way to diagnose this deeper?

eps.png(11.8 KB)

2

Steps to Reproduce

  1. Schedule a job that uses a pool that has this specific machine (FARM06)
  2. There is a one in ten chance that this machine’s job gets auto-cancelled
3

Hi Ralph,

Sounds quite strange. I would look at:

  • Logs for the lease (View Log on the “FARM06 - Cancelled” line)
  • Logs from the agent machine itself
    • On Windows, they are in C:\ProgramData\Epic\Horde\Agent\Log-*.txt
    • If the above lease log is empty, you may find it under the Leases\ dir here if it had any output
  • Horde’s server logs
    • Search for the lease ID and possibly log lines near it
    • That ID can be found in the lease log, but if that’s missing you would need to look at /api/v1/jobs/[JOB-ID] and find it in that JSON