Changes / Close / Delayed Webhook events

Close: Major incident: Delayed Webhook events

Summary

Close reported a major API degradation delaying webhook events from 2023-03-01 13:24 UTC to 2023-03-01 15:39 UTC, lasting 2 h 15 min. A fix was implemented by 14:13 UTC, and the event backlog was fully processed by resolution.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Delayed Webhook events
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2023-03-01 13:24 UTC
AddedResolved time#5
Before: not present
After: 2023-03-01 15:39 UTC
AddedAffected components#6
Before: not present
After: API
AddedUpdateinvestigating#7
Before: not present
After: Webhook events are being delayed. We are currently investigating this issue.
AddedUpdatemonitoring#8
Before: not present
After: The issue has been identified, and a fix has been implemented. The event backlog is being processed.
AddedUpdateresolved#9
Before: not present
After: The event backlog has been processed.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Delayed Webhook events (this change)
Close reported a major API degradation delaying webhook events from 2023-03-01 13:24 UTC to 2023-03-01 15:39 UTC, lasting 2 h 15 min. A fix was implemented by 14:13 UTC, and the event backlog was fully processed by resolution.
Major incident

All Close changes → · Close profile · Markdown · JSON