Changes / Sentry / Error ingestion degraded in US region

Sentry: Critical incident: Error ingestion degraded in US region

Summary

Sentry reported critical degradation of US Error Ingestion and US Errors Alerting, delaying ingested errors from 2026-07-10 22:43 UTC to 2026-07-11 03:34 UTC (4 h 51 min). Sentry confirmed the backlog was processed at resolution; no specific cause was stated.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 95%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Error ingestion degraded in US region
AddedImpact#2
Before: not present
After: critical
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-07-10 22:43 UTC
AddedResolved time#5
Before: not present
After: 2026-07-11 03:34 UTC
AddedAffected components#6
Before: not present
After: Alerting - US Errors Alerting, US Ingestion - US Error Ingestion
AddedUpdateinvestigating#7
Before: not present
After: We are currently investigating this issue.
AddedUpdateidentified#8
Before: not present
After: We have identified the problem and are working on a fix, ingested errors are delayed and will be processed once the fix is in place.
AddedUpdateidentified#9
Before: not present
After: We have identified the problem and are working on recovery. New errors are being processed in real time and we are in the process of consuming backlogged errors.
AddedUpdateidentified#10
Before: not present
After: We are still working on recovery. New errors should be processed in real time, and we are working on recovering historical data.
AddedUpdateidentified#11
Before: not present
After: We expect recovery of historical data to be complete within the next 2 hours.
AddedUpdateidentified#12
Before: not present
After: We have processed the majority of our backlog. We are now recovering an additional 25M error events ranging from 22:20 to 23:20 UTC, which should complete in the next 2 hours
AddedUpdatemonitoring#13
Before: not present
After: We have processed the majority of our backlog. We are now recovering the tail of the backlog.
AddedUpdateresolved#14
Before: not present
After: We have processed the backlog.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Critical incident: Error ingestion degraded in US region (this change)
Sentry reported critical degradation of US Error Ingestion and US Errors Alerting, delaying ingested errors from 2026-07-10 22:43 UTC to 2026-07-11 03:34 UTC (4 h 51 min). Sentry confirmed the backlog was processed at resolution; no specific cause was stated.
Major incident

All Sentry changes → · Sentry profile · Markdown · JSON