Changes / Doppler / Background job delays impacting sync, webhook and email delivery
Doppler: Major incident: Background job delays impacting sync, webhook and email delivery
Summary
Doppler reported a major incident delaying integration sync, webhooks and email delivery, starting at 2025-11-20 15:55 UTC and resolved at 2025-11-20 19:46 UTC; the reported duration was 3 h 50 min. A fix was implemented by 18:54 UTC, but no cause or fix details were stated.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
What changed
Before: not present
After: Background job delays impacting sync, webhook and email delivery
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2025-11-20 15:55 UTC
Before: not present
After: 2025-11-20 19:46 UTC
Before: not present
After: AWS IAM Dynamic Secrets, AWS MySQL Rotation, AWS Parameter Store, AWS Secrets Manager, AWS User Key Rotation, Azure App Service, Azure Dev Ops, Azure Key Vault, CircleCI, Codefresh, Dashboard (dashboard.doppler.com), Fly.io, GCP Secret Manager, GitHub, Heroku, Integrations - AWS IAM Dynamic Secrets, Integrations - AWS MySQL Rotation, Integrations - AWS Parameter Store, Integrations - AWS Secrets Manager, Integrations - AWS User Key Rotation, Integrations - Azure App Service, Integrations - Azure Dev Ops, Integrations - Azure Key Vault, Integrations - CircleCI, Integrations - Codefresh, Integrations - Fly.io, Integrations - GCP Secret Manager, Integrations - GitHub, Integrations - Heroku, Integrations - Laravel Forge, Integrations - Netlify, Integrations - Railway, Integrations - Render, Integrations - SendGrid Rotation, Integrations - Splunk, Integrations - Twilio Rotation, Integrations - Vercel, Laravel Forge, Netlify, Railway, Render, SendGrid Rotation, Splunk, Twilio Rotation, Vercel
Before: not present
After: We are currently investigating an issue involving delays impacting integration sync, webhook and email delivery.
Before: not present
After: We are continuing to investigate this issue.
Before: not present
After: A fix has been implemented and we are monitoring the results.
Before: not present
After: This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Background job delays impacting sync, webhook and email delivery (this change) Doppler reported a major incident delaying integration sync, webhooks and email delivery, starting at 2025-11-20 15:55 UTC and resolved at 2025-11-20 19:46 UTC; the reported duration was 3 h 50 min. A fix was implemented by 18:54 UTC, but no cause or fix details were stated. | Major incident |