# Harness: Major incident: SEI 2.0 dashboards are not loading

**Summary:** _summary pending_
- Kind: Major incident · Label: major (vendor)
- Changed: 2026-08-06 14:30 UTC · Detected: 2026-10-19 17:33 UTC
- [Source: https://stspg.io/twn4gg4bm5mz](https://stspg.io/twn4gg4bm5mz)
- [Company: Harness](https://rewindex.com/company/harness.md)
- Versions: before (none: first archived) → after incident\_version:695/gftvdqf3l1r6@98e15b7b83f3
- Change 1 of 1 for this incident

Incident page (full timeline): [SEI 2.0 dashboards are not loading](https://rewindex.com/company/harness/incidents/gftvdqf3l1r6.md)
## What changed

**1. Added: Title**

```diff
+ SEI 2.0 dashboards are not loading
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ postmortem
```

**4. Added: Start time**

```diff
+ 2026-08-06 14:30 UTC
```

**5. Added: Resolved time**

```diff
+ 2026-08-06 16:01 UTC
```

**6. Added: Affected components**

```diff
+ Prod 1 - Software Engineering Insights (SEI) /AI DLC Insights, Prod 2 - Software Engineering Insights (SEI) / AI DLC Insights, Prod 3 - Software Engineering Insights (SEI) / AI DLC Insights, Prod 6 - Software Engineering Insights (SEI) /AI DLC Insights, Prod Eu 1 - Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) /AI DLC Insights
```

**7. Added: Update** (investigating) · 2026-08-06 14:30 UTC

```diff
+ We are currently investigating a Harness component that is experiencing issues. We are working to identify the cause and restore normal operations as soon as possible.
```

**8. Added: Update** (investigating) · 2026-08-06 14:32 UTC

```diff
+ We are continuing to investigate this issue.
```

**9. Added: Update** (identified) · 2026-08-06 15:46 UTC

```diff
+ The issue has been identified and a fix is being implemented.
```

**10. Added: Update** (resolved) · 2026-08-06 16:01 UTC

```diff
+ This incident has been resolved.
```

**11. Added: Update** (postmortem) · 2026-08-10 18:24 UTC

```diff
+ ## Summary Customers on Prod1, Prod2, and Prod3 \(US\) clusters experienced failures when loading SEI 2.0 dashboards on August 6, 2026, from 7:22 AM PDT to 9:03 AM PDT. Customers calling the SEI 2.0 API also experienced similar failures. No customer data was lost, and ingestion of all integration data continued to work uninterrupted. SEI customers using 1.0 were not impacted. ## Root Cause The incident was caused by resource exhaustion on the nodes serving queries. This resource degradation developed in a pattern that did not cross our existing alerting thresholds early enough to provide sufficient warning or allow mitigation before customer impact occurred. ## Impact Customers on Prod1, Prod2, and Prod3 \(US\) clusters were unable to load SEI 2.0 dashboards during the incident window. **Duration:** August 6, 2026, 7:22 AM PDT – 9:03 AM PDT \(~1 hour 41 minutes\) ### What was not impacted? * Data ingestion and processing * SEI 1.0 customers * Integrations and metadata flows No customer data was lost. ## Remediation Upon identifying the root cause, our team took immediate corrective action by adding capacity to restore the affected systems. Services were fully recovered, and all dashboards resumed normal operation at 9:03 AM PDT. ## Action Items To prevent from such issues happening again, Harness is/has Proactively added  capacity  updates have been applied to prevent this issue from recurring ####  Enhanced Monitoring and Alerting Additional monitoring and alerting have been put in place to detect anomalies early, focused on a leading indicator, which in this case was thread pool exhaustion, before they can impact dashboard availability and data rendering. #### System Patch in Progress We are working with our vendor to apply a patch to remediate this and similar issues completely.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2026-08-06 14:30 UTC | Major incident: SEI 2.0 dashboards are not loading (this change) | major |

All Harness changes: [timeline](https://rewindex.com/company/harness/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i5dfe36a3f8e201 · Markdown: https://rewindex.com/change/i5dfe36a3f8e201.md · JSON: https://rewindex.com/api/v1/changes/i5dfe36a3f8e201 · Generated 2026-10-19T23:13:22.451Z
