rewindex

CompaniesGrafana CloudIncidents

Grafana Cloud: Elevated Request Errors for Grafana Across Multiple Regions

MinorStatus: resolvededitedStarted Resolved (1.0 h)5 updatesstatus.grafana.com (opens in new tab)

Affected components: AWS Australia - prod-au-southeast-1AWS Australia - prod-au-southeast-2AWS Brazil - prod-sa-east-1AWS Canada prod-ca-central-1AWS Canada - prod-ca-east-0AWS East - VAAWS Germany prod-eu-central-1AWS Germany - prod-eu-west-2AWS Germany - prod-eu-west-4AWS India - prod-ap-south-1AWS Indonesia - prod-ap-southeast-2AWS Indonesia - prod-ap-southeast-3AWS Ireland eu-west-1AWS Ireland - prod-eu-west-6AWS Japan - prod-ap-northeast-0AWS Singapore - prod-ap-southeast-1AWS Sweden eu-north-1AWS Sweden - prod-eu-north-0AWS Switzerland eu-central-2AWS Switzerland - prod-eu-central-0AWS UAE - prod-me-central-1AWS UK - prod-gb-south-1AWS US East - OHAWS US East - VAAWS US West - prod-us-west-0- prod-us-east-0prod-us-east-1- prod-us-east-2

Timeline of updates

  1. investigating

    We are investigating some failed requests affecting Grafana across multiple Grafana Cloud regions, beginning at approximately 12:10 UTC. Customers may see slow-loading or failing dashboards and Explore queries, and some requests may time out or be cancelled. Our engineers are actively investigating. Next update by 13:30 UTC.

  2. identified

    We have identified the cause of the elevated request errors affecting Grafana across multiple Grafana Cloud regions and are applying mitigation. Customers may still see slow-loading or failing dashboards and Explore queries while recovery continues. Next update by 13:30 UTC.

  3. monitoring

    We have identified the cause of the elevated request errors affecting Grafana across multiple Grafana Cloud regions and have applied a mitigation. We are seeing early signs of recovery and are monitoring closely. Customers may still see slow-loading or failing dashboards and Explore queries while recovery continues. Next update by 13:30 UTC.

  4. monitoring

    We have identified the cause of the elevated request errors affecting Grafana across multiple Grafana Cloud regions and have applied a mitigation. We are seeing signs of recovery and are continuing to monitor closely. Customers may still see slow-loading or failing dashboards and Explore queries while recovery continues. Next update by 14:00 UTC.

  5. resolved

    Between approximately 12:10 UTC and 13:22 UTC on 3 November (about 1 hour 12 minutes), Grafana across multiple Grafana Cloud regions experienced elevated request errors, causing slow-loading or failing dashboards and Explore queries. The issue has been resolved and service has been fully restored.

Changes Rewindex caught on this incident

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert.

How the archive is checked, and what it cannot prove.

Rewindex captured this after the last checkpoint; the next run () commits it.

Impact, status and times are the vendor’s own, as last archived. View on status.grafana.com (opens in new tab).

Grafana Cloud profileRecent Grafana Cloud incidentsMarkdownJSON