GitHub Copilot: Issues enabling actions and running jobs on GitHub

MinorStatus: resolvedStarted 2024-07-18 22:47 UTCResolved 2024-07-19 02:38 UTC (3.9 h)1 updatewww.githubstatus.com

Part of an outage event

Azure central us outage, Jul 18, 2024 · 7 vendors, 7 incidents

GitHub Copilot’s incident names Azure / central us (location or integration). (hop 1, posted +47 min vs the first vendor naming Azure)

“…r register self-hosted runners. This was caused by an unreachable backend resource in the Central US region. That resource is configured for geo-replication, but the replication configuration prevente…”

Swipe sideways to see the whole diagram.

GitHub Copilot is outlined in red. Groups show up to a few vendors each; the event page lists every incident.

Mermaid source

flowchart LR
  root["Azure central us<br/>own incident not archived"]:::inferred
  h1["Within an hour<br/>5 vendors, 1 blamed Azure<br/>MongoDB Atlas, Confluent, GitHub, GitHub Copilot +1"]:::blames
  root --> h1
  later["Later<br/>1 vendor<br/>Contentstack"]:::names
  root --> later
  me["GitHub Copilot (this incident)<br/>posted +47 min"]:::me
  h1 --- me

Full event: timeline, evidence and all vendors →

Detected automatically from incidents that started together and named the same provider. A link means one vendor’s incident named another, not a confirmed cause.

Timeline of updates

resolved2024-07-19 02:38 UTC
Beginning on July 18, 2024 at 22:38 UTC, network issues within an upstream provider led to degraded experiences across Actions, Copilot, and Pages services. Up to 50% of Actions workflow jobs were stuck in the queuing state, including Pages deployments. Users were also not able to enable Actions or register self-hosted runners. This was caused by an unreachable backend resource in the Central US region. That resource is configured for geo-replication, but the replication configuration prevented resiliency when one region was unavailable. Updating the replication configuration mitigated the impact by allowing successful requests while one region was unavailable. By July 19 00:12 UTC, users saw some improvement in Actions jobs and full recovery of Pages. Standard hosted runners and self-hosted Actions workflows were healthy by 2:10 UTC and large hosted runners fully recovered at 2:38. Copilot requests were also impacted with up to 2% of Copilot Chat requests and 0.5% of Copilot Completions requests resulting in errors. Chat requests were routed to other regions after 20 minutes while Completions requests took 45 minutes to reroute. We have identified improvements to detection to reduce the time to engage all impacted on-call teams and improvements to our replication configuration and failover workflows to be more resilient to unhealthy dependencies and reduce our time to failover and mitigate customer impact.

From GitHub Copilot’s published incident history: for incidents before Rewindex began polling this status page, only the final update text is available.

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert.

How the archive is checked, and what it cannot prove.

This incident predates live tracking (October 17, 2026). It came from the vendor’s own published history, which is not covered by checkpoints.

Impact, status and times are the vendor’s own, as last archived. View on www.githubstatus.com (opens in new tab).

Cite this

Status incident (vendor impact label: minor) posted by GitHub Copilot, started 2024-07-18 22:47 UTC, resolved after 3.9 h, 1 update(s).

Title: Issues enabling actions and running jobs on GitHub
Vendor: GitHub Copilot
Date: 2024-07-18 22:47 UTC
URL: https://rewindex.com/company/github-copilot/incidents/m70hk23gx3nx

GitHub Copilot profile Recent GitHub Copilot incidents All outages on July 18, 2024 GitHub Copilot in July 2024 Markdown JSON