# Doppler: Critical incident: Secrets unable to be read

**Summary:** Doppler reported a critical outage preventing secrets from being read via the API and Dashboard, starting 2022-08-29 00:38 UTC and resolved at 2022-08-29 01:38 UTC (59 min). A Redis server ran out of memory; Doppler increased its allotted memory and said it would add resource-usage alerting. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2022-08-29 00:38 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/m6j6ljl2bh4y](https://stspg.io/m6j6ljl2bh4y)
- [Company: Doppler](https://rewindex.com/company/doppler.md)
- Versions: before (none: first archived) → after incident\_version:308/zk5b3qbz3rv9@74eec48d9085
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Secrets unable to be read
```

**2. Added: Impact**

```diff
+ critical
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2022-08-29 00:38 UTC
```

**5. Added: Resolved time**

```diff
+ 2022-08-29 01:38 UTC
```

**6. Added: Affected components**

```diff
+ API (api.doppler.com), Dashboard (dashboard.doppler.com)
```

**7. Added: Update** (investigating) · 2022-08-29 00:38 UTC

```diff
+ We are currently investigating this issue.
```

**8. Added: Update** (monitoring) · 2022-08-29 01:32 UTC

```diff
+ A fix has been implemented and we are monitoring the results.
```

**9. Added: Update** (resolved) · 2022-08-29 01:38 UTC

```diff
+ This issue was caused by a redis server running out of memory. We've increased the amount of memory allotted to this server. We'll also be setting up additional alerting on redis resource usage so that we can catch and prevent these issues in the future.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2022-08-29 00:38 UTC | Critical incident: Secrets unable to be read (this change) | outage |

All Doppler changes: [timeline](https://rewindex.com/company/doppler/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/idda682c476950a · Markdown: https://rewindex.com/change/idda682c476950a.md · JSON: https://rewindex.com/api/v1/changes/idda682c476950a · Generated 2026-10-18T01:29:49.776Z
