# Dremio: Major incident: Intermittent Query Failures

**Summary:** Dremio reported major intermittent query failures starting 2023-09-07 15:50 UTC, believed limited to AWS projects created since Aug 17th, 2023, following a deployment. Fixes restored normal operation in US and European production environments; the incident was resolved at 2023-09-08 17:40 UTC after 25 h 50 min. _(machine-written, sol)_
- Kind: Major incident · Label: degradation (model (Jev))
- Changed: 2023-09-07 15:50 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/379ykxrm492l](https://stspg.io/379ykxrm492l)
- [Company: Dremio](https://rewindex.com/company/dremio.md)
- Versions: before (none: first archived) → after incident\_version:144/ksrpwtwf1nkw@3befb8df9563
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Intermittent Query Failures
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2023-09-07 15:50 UTC
```

**5. Added: Resolved time**

```diff
+ 2023-09-08 17:40 UTC
```

**6. Added: Affected components**

```diff
+ Dremio Cloud - Europe - Site Availability, Dremio Cloud - US - Site Availability, Site Availability
```

**7. Added: Update** (investigating) · 2023-09-07 15:50 UTC

```diff
+ Following the deployment on Wednesday, Sept 6th, 2023 our monitoring has detected an increase in query failure rates for some projects. We believe this is only impacting AWS projects created since Aug 17th, 2023.  If you are experiencing query failures, please contact Dremio Support and they can assist in mitigation. We believe the issue has been identified and a fix is being evaluated. We will update further when the fix is deployed.
```

**8. Added: Update** (identified) · 2023-09-07 15:50 UTC

```diff
+ The issue has been identified and a fix is being implemented.
```

**9. Added: Update** (identified) · 2023-09-08 00:31 UTC

```diff
+ We are moving the mitigation through our testing environments in preparation of deploying to our production systems.
```

**10. Added: Update** (identified) · 2023-09-08 15:55 UTC

```diff
+ A fix has been deployed to the US site and is being evaluated. Initial reports are showing increased latency in the UI. We will update as we consider next steps.
```

**11. Added: Update** (monitoring) · 2023-09-08 16:14 UTC

```diff
+ The fix deployed to the US site is performing well now. We will continue to monitor and then roll out the same fix to the European site.
```

**12. Added: Update** (monitoring) · 2023-09-08 17:09 UTC

```diff
+ The fix has been deployed to both production environments and normal operation has resumed. We will continue to monitor before resolving the incident.
```

**13. Added: Update** (resolved) · 2023-09-08 17:40 UTC

```diff
+ This incident has been resolved.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2023-09-07 15:50 UTC | Major incident: Intermittent Query Failures (this change) | degradation |

All Dremio changes: [timeline](https://rewindex.com/company/dremio/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/ibcd9d9e567308a · Markdown: https://rewindex.com/change/ibcd9d9e567308a.md · JSON: https://rewindex.com/api/v1/changes/ibcd9d9e567308a · Generated 2026-10-18T02:54:55.854Z