Companies / Metabase / incidents
Metabase: Degraded service in our Business tier
Metabase reported major degradation on its Cloud Platform affecting Business tier customers in isolated environments from 2021-08-10 16:37 UTC to 2021-08-10 20:38 UTC, lasting 4 h 1 min. A failed Elastic Beanstalk upgrade left instances inconsistent, with load balancers unable to flag them healthy and servers continuously recycled; a fix was deployed and the incident resolved.
Machine-written from the archived incident (Sol). Check the timeline before relying on it.
Affected components: Metabase Cloud Platform
Timeline of updates
- investigating
We identified an issue in our Business tier customers that run on isolated environments. The issue appears to be an issue with our load balancers not being able to flag instances as healthy which results in application servers being recycled continously.
- identified
We've identified a fix for the outage and we're in the process of issuing an update to resolve the situation
- monitoring
We've deployed a fix and we're monitoring the health of the instances.
- resolved
This incident has been resolved.
- postmortem
A failure in the upgrade in our Elastic Beanstalk deployment for improving the timeout on reverse proxies led to instances not being able to revert back to previous version leaving them in an inconsistent state.
Rewindex changes for this incident
- Major incident: Degraded service in our Business tier 2021-08-10 16:37 UTC
Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Metabase profile · Recent Metabase incidents · Markdown · JSON