Changes / Grain / AWS outage causing video processing delays

Grain: Critical incident: AWS outage causing video processing delays

Summary

Grain reported a critical Recording Processing incident: an Amazon outage delayed video processing from 2023-06-13 20:11 UTC to 2023-06-14 02:39 UTC, lasting 6 h 27 min. Grain reported that the Amazon outage appeared resolved and the video backlog was processing, then confirmed all systems were operating correctly.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 54%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: AWS outage causing video processing delays
AddedImpact#2
Before: not present
After: critical
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2023-06-13 20:11 UTC
AddedResolved time#5
Before: not present
After: 2023-06-14 02:39 UTC
AddedAffected components#6
Before: not present
After: Recording Processing
AddedUpdateinvestigating#7
Before: not present
After: Amazon is currently experiencing an outage causing Grain video processing to be delayed. The team is monitoring the outage for potential mitigations.
AddedUpdatemonitoring#8
Before: not present
After: The Amazon outage appears to have been resolved and the video backlog is being processed. We are monitoring for any other issues related to the outage.
AddedUpdateresolved#9
Before: not present
After: All systems are operating correctly at this time.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Critical incident: AWS outage causing video processing delays (this change)
Grain reported a critical Recording Processing incident: an Amazon outage delayed video processing from 2023-06-13 20:11 UTC to 2023-06-14 02:39 UTC, lasting 6 h 27 min. Grain reported that the Amazon outage appeared resolved and the video backlog was processing, then confirmed all systems were operating correctly.
Major incident

All Grain changes → · Grain profile · Markdown · JSON