# Grain: Major incident: Webhook consumers failing causing app failures

**Summary:** _summary pending_
- Kind: Major incident · Label: major (vendor)
- Changed: 2026-10-20 17:38 UTC · Detected: 2026-10-20 17:43 UTC
- [Source: https://stspg.io/979tbj5kzvjx](https://stspg.io/979tbj5kzvjx)
- [Company: Grain](https://rewindex.com/company/grain.md)
- Versions: before (none: first archived) → after incident\_version:20/7kpmkpwb04tr@a876d048a1c8
- Change 1 of 3 for this incident

Incident page (full timeline): [Webhook consumers failing causing app failures](https://rewindex.com/company/grain/incidents/7kpmkpwb04tr.md)
## What changed

**1. Added: Title**

```diff
+ Webhook consumers failing causing app failures
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ investigating
```

**4. Added: Start time**

```diff
+ 2026-10-20 17:38 UTC
```

**5. Added: Affected components**

```diff
+ Grain Recorder, Recording Processing
```

**6. Added: Update** (investigating) · 2026-10-20 17:38 UTC

```diff
+ The team is actively rolling back a failed update for its webhook consumers. Webhooks are currently failing to process leading to UI to fail to update for bots and recording processing. No data loss has occurred.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2026-10-20 17:38 UTC | Major incident: Webhook consumers failing causing app failures (this change) | major |
| 2026-10-20 18:13 UTC | [Incident updated: Webhook consumers failing causing app failures](https://rewindex.com/change/r00a5e136b202ae.md) |  |
| 2026-10-20 18:43 UTC | [Incident updated: Webhook consumers failing causing app failures](https://rewindex.com/change/r024917f19aff7e.md) |  |

Next: [change](https://rewindex.com/change/r00a5e136b202ae.md) · All Grain changes: [timeline](https://rewindex.com/company/grain/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i69aac0f11b710a · Markdown: https://rewindex.com/change/i69aac0f11b710a.md · JSON: https://rewindex.com/api/v1/changes/i69aac0f11b710a · Generated 2026-10-21T00:24:36.009Z