Companies/Courier/Incidents

Courier: Delayed Message Processing

Affected components: APICourier - API

Timeline of updates

1. investigating2024-10-24 22:38 UTC

   Courier has identified a delay in message processing for the messages API. We are currently investigating the root cause and will update you periodically.

2. investigating2024-10-24 23:01 UTC

   We are continuing to monitor the root cause of the delayed message processing.

3. investigating2024-10-24 23:29 UTC

   The team is still investigating and discussing the root cause internally. Messages are experiencing longer than normal processing times.

4. identified2024-10-25 00:00 UTC

   The team has identified the issue and is rolling out a fix for the message delays.

5. identified2024-10-25 00:40 UTC

   Fix has been deployed and will be live in around 1hr.

6. identified2024-10-25 01:31 UTC

   The team identified an issue with the latest fix and reverted it. A new fix has been published to mitigate the message delay issue. ETA to land in production ~45 minutes.

7. monitoring2024-10-25 02:43 UTC

   A fix has been implemented and delivery times are beginning to returning to expected levels. The team will continue to monitor.

8. resolved2024-10-25 02:48 UTC

   This incident has been resolved

Changes Rewindex caught on this incident

• Oct 24, 2024Major incident: Delayed Message Processing

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab).

Courier profileRecent Courier incidentsMarkdownJSON