Changes / Datadog / Delayed Distribution Monitors Evaluations
Datadog: Critical incident: Delayed Distribution Monitors Evaluations
Summary
Datadog reported a critical incident delaying Distribution Monitors evaluations, which it said began at 17:15 UTC on 2026-01-29. The incident resolved at 2026-01-29 19:55 UTC; the recorded duration was 2 h 19 min. Datadog deployed a fix at 18:36 UTC and stated no data was lost and evaluations would catch up.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)
What changed
Before: not present
After: Delayed Distribution Monitors Evaluations
Before: not present
After: critical
Before: not present
After: resolved
Before: not present
After: 2026-01-29 17:35 UTC
Before: not present
After: 2026-01-29 19:55 UTC
Before: not present
After: Monitors
Before: not present
After: We are investigating delays in Monitors evaluations, which began at 17:15 UTC.
Before: not present
After: We have identified the underlying issue and are working on a fix. It is important to note that no data has been lost, and evaluations will be caught up once the service is operational again.
Before: not present
After: We are continuing to work on a fix for this issue. It is important to note that no data has been lost, and evaluations will be caught up once the service is operational again.
Before: not present
After: We have deployed a fix and we are monitoring the results. We will continue to provide regular updates.
Before: not present
After: We are continuing to monitor the fix and will continue to provide regular updates.
Before: not present
After: This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Critical incident: Delayed Distribution Monitors Evaluations (this change) Datadog reported a critical incident delaying Distribution Monitors evaluations, which it said began at 17:15 UTC on 2026-01-29. The incident resolved at 2026-01-29 19:55 UTC; the recorded duration was 2 h 19 min. Datadog deployed a fix at 18:36 UTC and stated no data was lost and evaluations would catch up. | Major incident |