Changes / Datadog / Delayed Monitors Notifications

Datadog: Major incident: Delayed Monitors Notifications

Summary

Datadog reported major delays in Monitors notifications beginning at 12:00 UTC, potentially delaying customer alerts. The incident record started at 2026-03-26 14:24 UTC and lasted 5 h 32 min, resolving at 2026-03-26 19:56 UTC after a fix was implemented.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Delayed Monitors Notifications
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-03-26 14:24 UTC
AddedResolved time#5
Before: not present
After: 2026-03-26 19:56 UTC
AddedAffected components#6
Before: not present
After: Monitors
AddedUpdateinvestigating#7
Before: not present
After: We are investigating delays in monitor notifications, which began at 12:00 UTC.
AddedUpdateinvestigating#8
Before: not present
After: We are continuing investigating delays in monitor notifications that started at 12:00 UTC.
AddedUpdateinvestigating#9
Before: not present
After: We are still continuing investigating delays in monitor notifications that started at 12:00 UTC. We've identified the root cause and are working on a fix.
AddedUpdateinvestigating#10
Before: not present
After: We are continuing to investigate delays in monitor notifications.
AddedUpdateidentified#11
Before: not present
After: The issue has been identified and a fix is being implemented.
AddedUpdateidentified#12
Before: not present
After: We are continuing to work on a fix for this issue.
AddedUpdateidentified#13
Before: not present
After: We are continuing to work on a fix for this issue.
AddedUpdateidentified#14
Before: not present
After: We are continuing to work on a fix for this issue.
AddedUpdatemonitoring#15
Before: not present
After: A fix has been implemented and we are monitoring the results.
AddedUpdateresolved#16
Before: not present
After: This incident has been resolved.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Delayed Monitors Notifications (this change)
Datadog reported major delays in Monitors notifications beginning at 12:00 UTC, potentially delaying customer alerts. The incident record started at 2026-03-26 14:24 UTC and lasted 5 h 32 min, resolving at 2026-03-26 19:56 UTC after a fix was implemented.
Major incident

All Datadog changes → · Datadog profile · Markdown · JSON