# Honeycomb: Major incident: Ingest issues for some customers

**Summary:** Honeycomb reported a major US1 Event Ingest outage affecting data ingestion for some teams on Classic environments, from 2026-04-10 13:41 UTC to 2026-04-10 17:24 UTC (3 h 42 min). Honeycomb applied a manual fix, then confirmed the fix covered all impacted and potentially impacted environments and related ingest errors should no longer occur. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2026-04-10 13:41 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/dg6jdpbb3d3g](https://stspg.io/dg6jdpbb3d3g)
- [Company: Honeycomb](https://rewindex.com/company/honeycomb.md)
- Versions: before (none: first archived) → after incident\_version:279/wqk8nwp23ncz@861763e90152
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Ingest issues for some customers
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2026-04-10 13:41 UTC
```

**5. Added: Resolved time**

```diff
+ 2026-04-10 17:24 UTC
```

**6. Added: Affected components**

```diff
+ api.honeycomb.io - US1 Event Ingest
```

**7. Added: Update** (identified) · 2026-04-10 13:41 UTC

```diff
+ We have confirmed reports of some teams getting issues ingesting their data. We have identified a probable source behind this behavior and are currently trying to correct it.
```

**8. Added: Update** (identified) · 2026-04-10 13:46 UTC

```diff
+ We have further narrowed down that only teams on Classic environments are currently seeing issues. We are figuring out mitigation mechanisms at the moment.
```

**9. Added: Update** (identified) · 2026-04-10 13:55 UTC

```diff
+ We've identified a manual fix and are deploying that by hand to each affected environment, while also investigating a systemic solution.
```

**10. Added: Update** (monitoring) · 2026-04-10 14:19 UTC

```diff
+ We've applied the manual fix to nearly all affected datasets (less than 1% remaining). The systemic solution is still in progress.
```

**11. Added: Update** (monitoring) · 2026-04-10 14:32 UTC

```diff
+ The manual fix has been applied to all environments.
```

**12. Added: Update** (monitoring) · 2026-04-10 15:21 UTC

```diff
+ We are continuing to work on the systemic solution and monitor. We'll leave the incident open until we're able to confirm the issue won't recur.
```

**13. Added: Update** (resolved) · 2026-04-10 17:24 UTC

```diff
+ We can confirm that the fix was applied uniformly to all impacted and potentially impacted environments; no teams should see ingest errors related to this issue anymore.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2026-04-10 13:41 UTC | Major incident: Ingest issues for some customers (this change) | outage |

All Honeycomb changes: [timeline](https://rewindex.com/company/honeycomb/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i62ee27a3652868 · Markdown: https://rewindex.com/change/i62ee27a3652868.md · JSON: https://rewindex.com/api/v1/changes/i62ee27a3652868 · Generated 2026-10-18T03:32:32.497Z