Changes / v0 / Telemetry data loss for Drains
v0: Major incident: Telemetry data loss for Drains
Summary
v0 resolved a major Drains incident, recorded as starting 2026-07-23 19:00 UTC with a computed duration of 0 min. Its update reports unrecoverable traces and events between 19:12 and 19:18 UTC on July 23, 2026; undelivered logs remain accessible and exportable in the Logs UI dashboard. A fix was deployed.
Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.
What changed
Before: not present
After: Telemetry data loss for Drains
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2026-07-23 19:00 UTC
Before: not present
After: 2026-07-23 19:00 UTC
Before: not present
After: Between 19:12 and 19:18 UTC on July 23, 2026, telemetry forwarded through Drains was not delivered. Traces and events forwarded via Drains during this window were dropped and are unrecoverable. Logs forwarded via Drains during this window were also not delivered, but remain accessible in the Logs UI dashboard, where they can also be exported.
We have deployed a fix and are adding additional monitoring to detect and prevent this failure mode from happening in the future.
We know how much you rely on this data, and we sincerely apologize for the disruption.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Telemetry data loss for Drains (this change) v0 resolved a major Drains incident, recorded as starting 2026-07-23 19:00 UTC with a computed duration of 0 min. Its update reports unrecoverable traces and events between 19:12 and 19:18 UTC on July 23, 2026; undelivered logs remain accessible and exportable in the Logs UI dashboard. A fix was deployed. | Major incident |