Changes / Buildkite / Increased latency on REST and GraphQL APIs

Buildkite: Major incident: Increased latency on REST and GraphQL APIs

Summary

Buildkite reported a major incident involving increased REST and GraphQL API latency for all customers, starting 2026-06-11 23:18 UTC and resolved 2026-06-12 00:16 UTC (57 min). Buildkite attributed the issue to elevated REST API service load and confirmed recovery after mitigation; the agent and stacks API were unaffected.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Increased latency on REST and GraphQL APIs
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-06-11 23:18 UTC
AddedResolved time#5
Before: not present
After: 2026-06-12 00:16 UTC
AddedAffected components#6
Before: not present
After: Remote MCP Server, REST API, REST API - Remote MCP Server, REST API - REST API
AddedUpdateinvestigating#7
Before: not present
After: We're observing increased latency for all our customers. We're currently investigating and will provide status updates as they become available.
AddedUpdatemonitoring#8
Before: not present
After: We've isolated the issue to elevated load on our REST API service and are working to mitigate. The agent and stacks API isn’t affected.
AddedUpdatemonitoring#9
Before: not present
After: We've isolated the issue to elevated load on our REST API service and have mitigated the issue. The agent and stacks API isn’t affected.
AddedUpdateresolved#10
Before: not present
After: The mitigation applied before the last update had the intended effect, and we have seen recovery in REST API latency.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Increased latency on REST and GraphQL APIs (this change)
Buildkite reported a major incident involving increased REST and GraphQL API latency for all customers, starting 2026-06-11 23:18 UTC and resolved 2026-06-12 00:16 UTC (57 min). Buildkite attributed the issue to elevated REST API service load and confirmed recovery after mitigation; the agent and stacks API were unaffected.
Major incident

All Buildkite changes → · Buildkite profile · Markdown · JSON