# Doppler: Migration Script Race Condition

- Impact (vendor’s label): critical
- Status: resolved
- Started: 2020-02-06 23:43 UTC · Resolved: 2020-02-06 23:43 UTC · Duration: 0 min
- Updates: 1
- [Vendor status page: http://stspg.io/vm8mddpc2xg5](http://stspg.io/vm8mddpc2xg5)
- [Company: Doppler](https://rewindex.com/company/doppler.md)

## Summary

Doppler reported a critical outage starting and resolved at 2020-02-06 23:43 UTC (computed duration: 0 min; vendor reported approximately 2 minutes of downtime). A migration failed to run before deployment, causing services to crash because a critical database table lacked a column; the deployment orchestrator reverted to the previous build. _(machine-written, sol)_
## Timeline of updates

- **resolved** 2020-02-06 23:43 UTC: We had a migration script that failed to run before the rest of our services deployed. This caused the newly deployed services to crash because the database was missing a column in a critical table. Our deployment orchestrator quickly detected the issue and reverted to the previous build. Total downtime was approximately 2 minutes. We plan to mitigate future failures by requiring our migrations to complete before rolling out our remaining services.

## Rewindex changes for this incident

- 2020-02-06 23:43 UTC: [Critical incident: Migration Script Race Condition](https://rewindex.com/change/i9f28819ce96ca7.md)


---
Canonical: https://rewindex.com/company/doppler/incidents/00sm33hz7ktx · Markdown: https://rewindex.com/company/doppler/incidents/00sm33hz7ktx.md · JSON: https://rewindex.com/api/v1/companies/doppler/incidents/00sm33hz7ktx · Generated 2026-10-18T11:37:28.629Z