Changes / Datadog / Delayed Traces in APM Trace Search
Datadog: Major incident: Delayed Traces in APM Trace Search
Summary
Datadog reported a major APM degradation starting 2026-03-27 18:57 UTC, causing missing or delayed traces in APM Trace Search and delayed trace-based monitors; user impact was reported since 5pm UTC. A fix was implemented, and the incident was resolved at 2026-03-27 19:30 UTC, with a recorded duration of 32 min.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)
What changed
Before: not present
After: Delayed Traces in APM Trace Search
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2026-03-27 18:57 UTC
Before: not present
After: 2026-03-27 19:30 UTC
Before: not present
After: APM
Before: not present
After: We are investigating increased latency in processing and storing Traces in APM.
As a result of this issue, some users may see missing or delayed traces in APM Trace Search since 5pm UTC. They may also experience delay in APM trace-based monitors.
Before: not present
After: The issue has been identified and a fix is being implemented.
Before: not present
After: A fix has been implemented and we are monitoring the results.
Before: not present
After: This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Delayed Traces in APM Trace Search (this change) Datadog reported a major APM degradation starting 2026-03-27 18:57 UTC, causing missing or delayed traces in APM Trace Search and delayed trace-based monitors; user impact was reported since 5pm UTC. A fix was implemented, and the incident was resolved at 2026-03-27 19:30 UTC, with a recorded duration of 32 min. | Major incident |