Companies / Grain / incidents

Grain: Platform Instability

Impact: minorStatus: resolvedStarted Resolved (4 d)4 updatesSource: stspg.io (opens in new tab)

Affected components: Grain Web AppGrain Desktop AppRecording Processing

Timeline of updates

  1. investigating

    The platform is currently experiencing instability, the team is deploying upgraded infrastructure and investigating the root cause.

  2. investigating

    The team has rolled out mitigations and we're not longer seeing node failures. However we are still investigating the root cause of the issue.

  3. monitoring

    The mitigation has prevented further instability but the team is still investigating the root cause of the issue. The issue caused intermittent and cascading excess memory pressure on the application nodes.

  4. resolved

    The team has deployed a fix around large memory spikes trigging out-of-memory failures. Since the latest fix, no further memory spikes have occurred.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Grain profile · Recent Grain incidents · Markdown · JSON