# Doppler: Critical incident: Migration Script Race Condition

**Summary:** Doppler reported a critical outage starting and resolved at 2020-02-06 23:43 UTC (computed duration: 0 min; vendor reported approximately 2 minutes of downtime). A migration failed to run before deployment, causing services to crash because a critical database table lacked a column; the deployment orchestrator reverted to the previous build. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2020-02-06 23:43 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: http://stspg.io/vm8mddpc2xg5](http://stspg.io/vm8mddpc2xg5)
- [Company: Doppler](https://rewindex.com/company/doppler.md)
- Versions: before (none: first archived) → after incident\_version:308/00sm33hz7ktx@885cbc624bc2
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Migration Script Race Condition
```

**2. Added: Impact**

```diff
+ critical
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2020-02-06 23:43 UTC
```

**5. Added: Resolved time**

```diff
+ 2020-02-06 23:43 UTC
```

**6. Added: Update** (resolved) · 2020-02-06 23:43 UTC

```diff
+ We had a migration script that failed to run before the rest of our services deployed. This caused the newly deployed services to crash because the database was missing a column in a critical table. Our deployment orchestrator quickly detected the issue and reverted to the previous build. Total downtime was approximately 2 minutes. We plan to mitigate future failures by requiring our migrations to complete before rolling out our remaining services.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2020-02-06 23:43 UTC | Critical incident: Migration Script Race Condition (this change) | outage |

All Doppler changes: [timeline](https://rewindex.com/company/doppler/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i9f28819ce96ca7 · Markdown: https://rewindex.com/change/i9f28819ce96ca7.md · JSON: https://rewindex.com/api/v1/changes/i9f28819ce96ca7 · Generated 2026-10-18T02:55:28.739Z