Changes / Grain / Audio corruption on some recordings
Grain: Critical incident: Audio corruption on some recordings
Summary
Grain Recorder experienced audio “popping” on some calls in a critical-impact incident starting 2023-11-28 18:34 UTC and lasting 20 days 23 h. A fix was deployed by 11-29 15:37 UTC, but affected recordings cannot be repaired. The incident was resolved at 2023-12-19 18:20 UTC, with no further instances reported since the fix.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
Major incidentLabel: degradation (model (Jev), 96%)Changed Detected Source: stspg.io (opens in new tab)
What changed
Before: not present
After: Audio corruption on some recordings
Before: not present
After: critical
Before: not present
After: resolved
Before: not present
After: 2023-11-28 18:34 UTC
Before: not present
After: 2023-12-19 18:20 UTC
Before: not present
After: Grain Recorder
Before: not present
After: We have started receiving reports of audio "popping" on some recorder calls. The team is investigating the root cause and a resolutions.
Before: not present
After: The underlying issue has been uncovered and a fix has been deployed. We are monitoring for further issues. Unfortunately the audio on impacted recordings cannot be repaired.
Before: not present
After: We have not seen any further instances of this issue since the fix.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Critical incident: Audio corruption on some recordings (this change) Grain Recorder experienced audio “popping” on some calls in a critical-impact incident starting 2023-11-28 18:34 UTC and lasting 20 days 23 h. A fix was deployed by 11-29 15:37 UTC, but affected recordings cannot be repaired. The incident was resolved at 2023-12-19 18:20 UTC, with no further instances reported since the fix. | Major incident |