Rewindex

ChangesCourierDelayed Message Processing

Courier: Major incident: Delayed Message Processing

Major incidentmajor (vendor)Changed Detected stspg.io (opens in new tab)
Summary

Summary pending. The diff below shows exactly what changed.

Incident page: the full timeline of updates

What changed

Struck in red is what Courier removed; blue is what they added. Muted text is unchanged context.

AddedTitle#1
Before: not present
After: Delayed Message Processing
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2024-10-24 22:38 UTC
AddedResolved time#5
Before: not present
After: 2024-10-25 02:48 UTC
AddedAffected components#6
Before: not present
After: API, Courier - API
AddedUpdateinvestigating#7
Before: not present
After: Courier has identified a delay in message processing for the messages API. We are currently investigating the root cause and will update you periodically.
AddedUpdateinvestigating#8
Before: not present
After: We are continuing to monitor the root cause of the delayed message processing.
AddedUpdateinvestigating#9
Before: not present
After: The team is still investigating and discussing the root cause internally. Messages are experiencing longer than normal processing times.
AddedUpdateidentified#10
Before: not present
After: The team has identified the issue and is rolling out a fix for the message delays.
AddedUpdateidentified#11
Before: not present
After: Fix has been deployed and will be live in around 1hr.
AddedUpdateidentified#12
Before: not present
After: The team identified an issue with the latest fix and reverted it. A new fix has been published to mitigate the message delay issue. ETA to land in production ~45 minutes.
AddedUpdatemonitoring#13
Before: not present
After: A fix has been implemented and delivery times are beginning to returning to expected levels. The team will continue to monitor.
AddedUpdateresolved#14
Before: not present
After: This incident has been resolved

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

Thursday, October 24, 2024

1 incident change

All Courier changesCourier profileMarkdownJSON