# Doppler: Critical incident: Background job delays impacting sync and email delivery

**Summary:** Doppler reported a critical background-job degradation from 2025-08-20 18:52 UTC to 2025-08-20 19:58 UTC, lasting 1 h 6 min. Integration syncs showed failed with "Out of sync", while email, activity log, and webhook delivery were delayed. A fix was implemented and all unprocessed jobs were processed by 19:38 UTC; the incident was resolved at 19:58 UTC. _(machine-written, sol)_
- Kind: Major incident · Label: degradation (model (Jev))
- Changed: 2025-08-20 18:52 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/zjcknwfkkngy](https://stspg.io/zjcknwfkkngy)
- [Company: Doppler](https://rewindex.com/company/doppler.md)
- Versions: before (none: first archived) → after incident\_version:308/ztnbvdp6wwg5@cdc4bdd58503
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Background job delays impacting sync and email delivery
```

**2. Added: Impact**

```diff
+ critical
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2025-08-20 18:52 UTC
```

**5. Added: Resolved time**

```diff
+ 2025-08-20 19:58 UTC
```

**6. Added: Affected components**

```diff
+ AWS IAM Dynamic Secrets, AWS MySQL Rotation, AWS Parameter Store, AWS Secrets Manager, AWS User Key Rotation, Azure App Service, Azure Dev Ops, Azure Key Vault, CircleCI, Codefresh, Dashboard (dashboard.doppler.com), Fly.io, GCP Secret Manager, GitHub, Heroku, Integrations - AWS IAM Dynamic Secrets, Integrations - AWS MySQL Rotation, Integrations - AWS Parameter Store, Integrations - AWS Secrets Manager, Integrations - AWS User Key Rotation, Integrations - Azure App Service, Integrations - Azure Dev Ops, Integrations - Azure Key Vault, Integrations - CircleCI, Integrations - Codefresh, Integrations - Fly.io, Integrations - GCP Secret Manager, Integrations - GitHub, Integrations - Heroku, Integrations - Laravel Forge, Integrations - Netlify, Integrations - Railway, Integrations - Render, Integrations - SendGrid Rotation, Integrations - Splunk, Integrations - Twilio Rotation, Integrations - Vercel, Laravel Forge, Netlify, Railway, Render, SendGrid Rotation, Splunk, Twilio Rotation, Vercel
```

**7. Added: Update** (investigating) · 2025-08-20 18:52 UTC

```diff
+ We're currently investigating an issue involving delays in background job processing that's impacting integration syncs, email delivery, activity log delivery, and webhook delivery (amongst other things). Impacted integration syncs will show as failed with "Out of sync". If expected emails aren't being received, it's likely related to this as well.
```

**8. Added: Update** (investigating) · 2025-08-20 19:15 UTC

```diff
+ We are continuing to investigate the issue.
```

**9. Added: Update** (identified) · 2025-08-20 19:36 UTC

```diff
+ The issue has been identified and a fix is being implemented.
```

**10. Added: Update** (monitoring) · 2025-08-20 19:38 UTC

```diff
+ A fix has been implemented and we're monitoring the situation. All unprocessed jobs have now been processed.
```

**11. Added: Update** (resolved) · 2025-08-20 19:58 UTC

```diff
+ This incident has been resolved.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2025-08-20 18:52 UTC | Critical incident: Background job delays impacting sync and email delivery (this change) | degradation |

All Doppler changes: [timeline](https://rewindex.com/company/doppler/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i0e3871723606f4 · Markdown: https://rewindex.com/change/i0e3871723606f4.md · JSON: https://rewindex.com/api/v1/changes/i0e3871723606f4 · Generated 2026-10-18T02:29:47.672Z