# Buildkite: Major incident: Increased latency and error rates

**Summary:** Buildkite reported a major degradation affecting the REST API’s builds create API for a subset of tenants, with increased latency and error rates. It started at 2026-06-18 08:05 UTC and lasted 1 h 37 min, resolving at 2026-06-18 09:43 UTC; a fix was deployed and full recovery confirmed. _(machine-written, sol)_
- Kind: Major incident · Label: degradation (model (Jev))
- Changed: 2026-06-18 08:05 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/2g336gvyxpmf](https://stspg.io/2g336gvyxpmf)
- [Company: Buildkite](https://rewindex.com/company/buildkite.md)
- Versions: before (none: first archived) → after incident\_version:178/wdkm31c8ym4h@b97094b17f51
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Increased latency and error rates
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2026-06-18 08:05 UTC
```

**5. Added: Resolved time**

```diff
+ 2026-06-18 09:43 UTC
```

**6. Added: Affected components**

```diff
+ REST API, REST API - REST API
```

**7. Added: Update** (identified) · 2026-06-18 08:05 UTC

```diff
+ We're seeing increased latency and error rates for a subset of our customers. We're currently investigating and will provide status updates as they become available.
```

**8. Added: Update** (identified) · 2026-06-18 08:59 UTC

```diff
+ We've identified the issue, we're continuing working on rolling out a fix. Impact is restricted to the builds create API for a subset of tenants.
```

**9. Added: Update** (monitoring) · 2026-06-18 09:17 UTC

```diff
+ A fix has been deployed, services are recovering.
```

**10. Added: Update** (resolved) · 2026-06-18 09:43 UTC

```diff
+ We have seen a full recovery of services.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2026-06-18 08:05 UTC | Major incident: Increased latency and error rates (this change) | degradation |

All Buildkite changes: [timeline](https://rewindex.com/company/buildkite/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i7966fe4522473e · Markdown: https://rewindex.com/change/i7966fe4522473e.md · JSON: https://rewindex.com/api/v1/changes/i7966fe4522473e · Generated 2026-10-18T03:55:44.060Z