# Lightdash: Major incident: Degraded performance and Snowflake Query Failures

**Summary:** Lightdash reported a major incident affecting Lightdash Cloud (EU) and Lightdash Cloud (US), with Snowflake query failures, dashboards not loading charts, app crashes and high backend latency. It started and was marked resolved at 2023-10-03 15:39 UTC (recorded duration: 0 min); Lightdash said it identified the root cause and took corrective measures but provided no specifics. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2023-10-03 15:39 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/h54hwgqcpv0n](https://stspg.io/h54hwgqcpv0n)
- [Company: Lightdash](https://rewindex.com/company/lightdash.md)
- Versions: before (none: first archived) → after incident\_version:68/twx0jht6fnfj@67ae6f25aa77
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Degraded performance and Snowflake Query Failures
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ postmortem
```

**4. Added: Start time**

```diff
+ 2023-10-03 15:39 UTC
```

**5. Added: Resolved time**

```diff
+ 2023-10-03 15:39 UTC
```

**6. Added: Affected components**

```diff
+ Lightdash Cloud (EU), Lightdash Cloud - Lightdash Cloud (EU), Lightdash Cloud - Lightdash Cloud (US), Lightdash Cloud (US)
```

**7. Added: Update** (resolved) · 2023-10-03 15:39 UTC

```diff
+ We've successfully identified the root cause and have taken measures to resolve the issue. We apologize for any inconvenience this may have caused and appreciate your understanding and patience during this time.
```

**8. Added: Update** (postmortem) · 2023-10-03 15:43 UTC

```diff
+ #### 2:11 PM * **Issue Reported**: Users report that dashboards aren’t loading any charts. #### 3:41 PM * **Additional Reports**: Other users report that app is crashing #### 3:14 PM - 4:30 PM * **Observation**: High backend latency was detected. * **Collaboration**: Engaged in a chat with other engineers to identify potential causes. * **Root Cause Analysis**:     * Reviewed changes released that morning.     * Suspected the Node upgrade might be the cause.     * Discovered a related GitHub issue with Snowflake and Node 20: [GitHub Issue](https://github.com/snowflakedb/snowflake-connector-nodejs/issues/588)      * **Decision**:     * Immediate rollback.     * Plan to create a PR to update the ʹsnowflake-sdkʹ package.      #### 4:25 PM * **Rollback**: Rolled back from release 0.797.0 to 0.795.0. #### 4:47 PM * **Feedback**: Users report that app is functioning correctly #### 5:10 PM * **Follow-up Action**: Began working on the PR to upgrade Snowflake's SDK.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2023-10-03 15:39 UTC | Major incident: Degraded performance and Snowflake Query Failures (this change) | outage |

All Lightdash changes: [timeline](https://rewindex.com/company/lightdash/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i40e25a00fc9f5f · Markdown: https://rewindex.com/change/i40e25a00fc9f5f.md · JSON: https://rewindex.com/api/v1/changes/i40e25a00fc9f5f · Generated 2026-10-18T03:55:40.956Z