Changes / CockroachDB / Elevated error rate for some Standard and Basic clusters

CockroachDB: Major incident: Elevated error rate for some Standard and Basic clusters

Summary

CockroachDB reported a major incident with elevated error rates on isolated Standard and Basic clusters from 2024-11-19 16:48 UTC to 2024-11-19 18:36 UTC, lasting 1 h 48 min. Engineering reported identifying and resolving the root cause, without specifying it, and confirmed resolution for all affected clusters.

Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.

Major incidentLabel: outage (model (Jev), 59%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Elevated error rate for some Standard and Basic clusters
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2024-11-19 16:48 UTC
AddedResolved time#5
Before: not present
After: 2024-11-19 18:36 UTC
AddedUpdateinvestigating#6
Before: not present
After: We have received alerts indicating elevated error rates on isolated Standard and Basic clusters. The Engineering team is currently investigating the issue.
AddedUpdatemonitoring#7
Before: not present
After: The root cause of the issue was identified and resolved. Engineering is monitoring the situation.
AddedUpdateresolved#8
Before: not present
After: The Engineering team has isolated and resolved the elevated error rate for all affected clusters.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Elevated error rate for some Standard and Basic clusters (this change)
CockroachDB reported a major incident with elevated error rates on isolated Standard and Basic clusters from 2024-11-19 16:48 UTC to 2024-11-19 18:36 UTC, lasting 1 h 48 min. Engineering reported identifying and resolving the root cause, without specifying it, and confirmed resolution for all affected clusters.
Major incident

All CockroachDB changes → · CockroachDB profile · Markdown · JSON