Changes / Buildkite / Delays in Hosted Agents job dispatch

Buildkite: Major incident: Delays in Hosted Agents job dispatch

Summary

Buildkite reported a major Hosted Agents job-dispatch degradation affecting Linux (AMD64), Linux (ARM64), and MacOS from 2026-09-02 14:45 UTC to 2026-09-02 15:51 UTC, lasting 1 h 5 min. Self-hosted agents were unaffected; Buildkite worked through the delayed-job backlog and confirmed dispatch delays were resolved.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Delays in Hosted Agents job dispatch
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-09-02 14:45 UTC
AddedResolved time#5
Before: not present
After: 2026-09-02 15:51 UTC
AddedAffected components#6
Before: not present
After: Hosted Agents, Hosted Agents - Hosted Agents, Hosted Agents - Linux (AMD64), Hosted Agents - Linux (ARM64), Hosted Agents - MacOS, Linux (AMD64), Linux (ARM64), MacOS
AddedUpdateinvestigating#7
Before: not present
After: We're investigating an issue with job dispatch to our Hosted Agents.
AddedUpdateinvestigating#8
Before: not present
After: Our engineers are continuing to investigate an issue with delayed job dispatch for Hosted Agents. Job dispatch for self-hosted agents remains unaffected.
AddedUpdateidentified#9
Before: not present
After: We're beginning to see recovery with delayed job dispatch for Hosted Agents. We are currently working through the backlog of delayed jobs.
AddedUpdatemonitoring#10
Before: not present
After: We are continuing to process through the backlog of delayed jobs and monitoring.
AddedUpdateresolved#11
Before: not present
After: Job dispatch for Hosted Agents is no longer experiencing delays.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Delays in Hosted Agents job dispatch (this change)
Buildkite reported a major Hosted Agents job-dispatch degradation affecting Linux (AMD64), Linux (ARM64), and MacOS from 2026-09-02 14:45 UTC to 2026-09-02 15:51 UTC, lasting 1 h 5 min. Self-hosted agents were unaffected; Buildkite worked through the delayed-job backlog and confirmed dispatch delays were resolved.
Major incident

All Buildkite changes → · Buildkite profile · Markdown · JSON