Changes / Sanity / Elevated listener latency affecting Studio performance

Sanity: Major incident: Elevated listener latency affecting Studio performance

Summary

Sanity reported a major degradation starting 2026-10-08 18:27 UTC, lasting 13 h 29 min and resolved at 2026-10-09 07:57 UTC. Elevated listener latency affected Studio performance for some customers; Dataset Embeddings could be stale, and Functions triggering could be delayed or time out. Sanity reported a fix fully implemented at 10-08 20:08 UTC while embedding processing caught up.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io

What changed

AddedTitle#1
Before: not present
After: Elevated listener latency affecting Studio performance
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-10-08 18:27 UTC
AddedResolved time#5
Before: not present
After: 2026-10-09 07:57 UTC
AddedAffected components#6
Before: not present
After: Dataset Embeddings, Functions, Studio
AddedUpdateinvestigating#7
Before: not present
After: We are investigating an issue of elevated listener latency, which may cause performance issues in the Studio for some customers.
AddedUpdateinvestigating#8
Before: not present
After: We are investigating an issue of elevated listener latency, which may cause performance issues in the Studio for some customers. Dataset embeddings may be stale at this time.
AddedUpdateinvestigating#9
Before: not present
After: We are investigating an issue of elevated listener latency, which may cause performance issues in the Studio for some customers. Dataset embeddings may be stale at this time. The triggering of Functions may be delayed or time out.
AddedUpdateidentified#10
Before: not present
After: The triggering of Functions and listener performance have returned to normal. Dataset embeddings may continue to be stale for some customers.
AddedUpdatemonitoring#11
Before: not present
After: A fix has been fully implemented, and we are monitoring results. Some users may see stale Dataset Embeddings while processing catches up.
AddedUpdateresolved#12
Before: not present
After: This incident has been resolved.

First version of this incident archived by Rewindex. View the live incident.

History of this incident

When (UTC)ChangeKind
Major incident: Elevated listener latency affecting Studio performance (this change)
Sanity reported a major degradation starting 2026-10-08 18:27 UTC, lasting 13 h 29 min and resolved at 2026-10-09 07:57 UTC. Elevated listener latency affected Studio performance for some customers; Dataset Embeddings could be stale, and Functions triggering could be delayed or time out. Sanity reported a fix fully implemented at 10-08 20:08 UTC while embedding processing caught up.
Major incident

All Sanity changes → · Sanity profile · Markdown · JSON