ChangesStream (GetStream)Feed Realtime - SQS high error rate
Stream (GetStream): Critical incident: Feed Realtime - SQS high error rate
Summary
Summary pending. The diff below shows exactly what changed.
Incident page: the full timeline of updates
What changed
Struck in red is what Stream (GetStream) removed; blue is what they added. Muted text is unchanged context.
Before: not present
After: Feed Realtime - SQS high error rate
Before: not present
After: critical
Before: not present
After: resolved
Before: not present
After: 2021-01-04 16:57 UTC
Before: not present
After: 2021-01-04 23:25 UTC
Before: not present
After: Feed Realtime Notifications, Personalization
Before: not present
After: We are currently investigating an issue with AWS SQS, we are receiving 100% error rate from SQS APIs.
Our feeds realtime endpoint is currently unable to push notifications to SQS.
Before: not present
After: A fix has been implemented and we are monitoring the results.
Before: not present
After: We are continuing to monitor for any further issues.
Before: not present
After: Millions of requests to the handshake endpoint of our feed realtime system broke the API. This issue has been resolved and a full post mortem will follow.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
Monday, January 4, 2021
1 incident change
- CriticalCritical incident
Feed Realtime - SQS high error ratethis change
All Stream (GetStream) changesStream (GetStream) profileMarkdownJSON