Changes / Datadog / Delayed Monitors Notifications
Datadog: Critical incident: Delayed Monitors Notifications
Summary
Datadog reported critical delays in monitor notifications and platform data beginning at 23:39 UTC (recorded start: 2026-05-08 00:06 UTC). It identified upstream provider issues; data processing and alerting were normal by 06:21 UTC. The incident was resolved at 2026-05-08 14:07 UTC, with a recorded duration of 14 h 0 min.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
What changed
Before: not present
After: Delayed Monitors Notifications
Before: not present
After: critical
Before: not present
After: resolved
Before: not present
After: 2026-05-08 00:06 UTC
Before: not present
After: 2026-05-08 14:07 UTC
Before: not present
After: APM, CI Visibility, Error Tracking, Log Management, Metrics and Infra Monitoring, Monitors, RUM
Before: not present
After: We are investigating delays in Monitors Notifications, which began at 23:39 UTC.
Before: not present
After: We are investigating increased latency across multiple products which began at 23:39 UTC. As a result of this issue, some users may see delays in data across the platform.
Before: not present
After: Due to upstream provider issues, we are also continuing to see unavailability of telemetry data coming from AWS into Datadog.
https://health.aws.amazon.com/health/status
Before: not present
After: We have identified upstream provider issues and are continuing to experience delays in processing data across multiple products. We are working on a fix.
https://health.aws.amazon.com/health/status
Before: not present
After: We have identified upstream provider issues and are continuing to experience delays in processing data across multiple products. We are working on a fix.
https://health.aws.amazon.com/health/status
Before: not present
After: We have identified due to upstream provider issues, we are continuing to see unavailability of telemetry data coming from AWS into Datadog. We are continuing to work on a fix.
https://health.aws.amazon.com/health/status
Before: not present
After: We have identified due to upstream provider issues, we are continuing to see unavailability of telemetry data coming from AWS into Datadog. We are continuing to work on a fix.
https://health.aws.amazon.com/health/status
For metrics we are still seeing delays in distribution metrics. Counts, rates and gauge metrics are being processed normally for most customers
Before: not present
After: We have identified upstream provider issues and are continuing to experience delays in processing data across multiple products. We are continuing to work on a fix.
https://health.aws.amazon.com/health/status
For metrics, distribution metrics and point metrics are being processed normally for all customers.
Before: not present
After: We have identified upstream provider issues and are continuing to experience delays in processing data across multiple products. We are continuing to work on a fix.
https://health.aws.amazon.com/health/status
For metrics, distribution metrics and point metrics are being processed normally for all customers.
Before: not present
After: We have identified upstream provider issues and are continuing to experience delays in processing data across multiple products. We are continuing to work on a fix.
https://health.aws.amazon.com/health/status
For metrics, distribution metrics and point metrics are being processed normally for all customers.
Before: not present
After: We have identified upstream provider issues. Metrics, Logs, APM and RUM data are being processed normally for all customers. Alerting is also functional. There are still processing delays for CI visibility.
We are monitoring the situation.
https://health.aws.amazon.com/health/status
Before: not present
After: We have identified upstream provider issues. Metrics, Logs, APM, RUM and CI visibility data are being processed normally for all customers. Alerting is also functional.
We are monitoring the situation.
https://health.aws.amazon.com/health/status
Before: not present
After: This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Critical incident: Delayed Monitors Notifications (this change) Datadog reported critical delays in monitor notifications and platform data beginning at 23:39 UTC (recorded start: 2026-05-08 00:06 UTC). It identified upstream provider issues; data processing and alerting were normal by 06:21 UTC. The incident was resolved at 2026-05-08 14:07 UTC, with a recorded duration of 14 h 0 min. | Major incident |