# LiveKit: Critical incident: Observability upload and Agent Simulations failures

**Summary:** _summary pending_
- Kind: Major incident · Label: critical (vendor)
- Changed: 2026-10-13 10:01 UTC · Detected: 2026-10-19 17:03 UTC
- [Source: https://stspg.io/0tnknwzkh37q](https://stspg.io/0tnknwzkh37q)
- [Company: LiveKit](https://rewindex.com/company/livekit.md)
- Versions: before (none: first archived) → after incident\_version:666/x45ytm36m8c3@bd384350d020
- Change 1 of 1 for this incident

Incident page (full timeline): [Observability upload and Agent Simulations failures](https://rewindex.com/company/livekit/incidents/x45ytm36m8c3.md)
## What changed

**1. Added: Title**

```diff
+ Observability upload and Agent Simulations failures
```

**2. Added: Impact**

```diff
+ critical
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2026-10-13 10:01 UTC
```

**5. Added: Resolved time**

```diff
+ 2026-10-13 13:44 UTC
```

**6. Added: Affected components**

```diff
+ Cloud Dashboard (cloud.livekit.io)
```

**7. Added: Update** (investigating) · 2026-10-13 10:01 UTC

```diff
+ We are investigating an issue with Agent Insights where agents are unable to upload their observability data at the end of their sessions. Some recent agent sessions may be missing from the dashboard's sessions list or shown as “In progress”. Agent sessions themselves are not affected. We will post an update shortly.
```

**8. Added: Update** (identified) · 2026-10-13 10:45 UTC

```diff
+ We have identified the cause of the Agent Insights issue and are working on a fix.
```

**9. Added: Update** (identified) · 2026-10-13 11:40 UTC

```diff
+ We are continuing to work on a fix for this issue.
```

**10. Added: Update** (identified) · 2026-10-13 13:15 UTC

```diff
+ Agent Insights uploads are now operational and session data has been storing normally since 12:40 UTC. We are still investigating an issue with Simulations. Simulation runs may complete without a transcript, summary, or verdict. We will post an update shortly.
```

**11. Added: Update** (resolved) · 2026-10-13 13:44 UTC

```diff
+ This incident has been resolved. Between 08:15 and 12:35 UTC, agents were not able to upload agent observability data to LiveKit's servers in all regions. Agent sessions completed normally, but, unfortunately, any Agent Insights data which attempted to upload within that window (traces/transcripts/logs/recordings) is unrecoverable. The ability to download existing Agent Insights data was impaired until 13:15 UTC. Agent Simulations were unavailable due to a upstream dependency and came back online at 13:25 UTC.  Sincere apologies for the impact. We will follow up with a postmortem as soon as possible.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2026-10-13 10:01 UTC | Critical incident: Observability upload and Agent Simulations failures (this change) | critical |

All LiveKit changes: [timeline](https://rewindex.com/company/livekit/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/ib6f27daaf25729 · Markdown: https://rewindex.com/change/ib6f27daaf25729.md · JSON: https://rewindex.com/api/v1/changes/ib6f27daaf25729 · Generated 2026-10-19T23:13:29.446Z