rewindex

ChangesGrainWebhook consumers failing causing app failures

Grain: Major incident: Webhook consumers failing causing app failures

Major incidentmajor (vendor)Changed Detected stspg.io (opens in new tab)
Summary

Summary pending. The diff below shows exactly what changed.

Incident page: the full timeline of updates

What changed

Struck in red is what Grain removed; blue is what they added. Muted text is unchanged context.

AddedTitle#1
Before: not present
After: Webhook consumers failing causing app failures
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: investigating
AddedStart time#4
Before: not present
After: 2026-10-20 17:38 UTC
AddedAffected components#5
Before: not present
After: Grain Recorder, Recording Processing
AddedUpdateinvestigating#6
Before: not present
After: The team is actively rolling back a failed update for its webhook consumers. Webhooks are currently failing to process leading to UI to fail to update for bots and recording processing. No data loss has occurred.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert.

How the archive is checked, and what it cannot prove.

Rewindex captured this after the last checkpoint; the next run () commits it.

History of this incident

TodayTuesday, October 20Tue, Oct 20

3 incident changes

All Grain changesGrain profileMarkdownJSON