# GitHub Copilot: Incident with Codespaces and API Requests

- Impact (vendor’s label): major
- Status: resolved
- Started: 2024-03-15 19:55 UTC · Resolved: 2024-03-15 20:24 UTC · Duration: 29 min
- Updates: 1
- [Vendor status page: https://www.githubstatus.com/incidents/9ym5p2sg6w5v](https://www.githubstatus.com/incidents/9ym5p2sg6w5v)
- [Company: GitHub Copilot](https://rewindex.com/company/github-copilot.md)

## Timeline of updates

- **resolved** 2024-03-15 20:24 UTC: On March 15, 2024, between 19:42 UTC and 20:24 UTC several services were degraded due to a regression in calling the permissions system. New GitHub Codespaces could not be created, as were Codespaces sessions that required minting a new auth token. Actions saw delays and infrastructure failures due to the upstream dependency on fetching tokens for the repository for runs to successfully execute. GitHub Pages were affected due to the impact on Actions, resulting in 1266 page builds failing, which at the low point represented 33% of page builds failing. This resulted in page edits not being reflected on those impacted sites. We deployed an application update that included a newer version of our database query builder. The new version uses a newer MySQL syntax for upsert queries that is not supported by the database proxy service we use for some of our production-environment database clusters. This incompatibility impacted the permissions cluster specifically, causing requests that attempted such queries to fail. We responded by rolling back the deployment, restoring the previous query use, and thus mitigated the incident. We have identified and corrected a misconfiguration of the permissions cluster in our development and CI environments that will ensure queries utilize the proxy service to prevent future syntax additions causing issues in production.

_From the vendor’s published history: only the final update text is available for incidents before Rewindex began polling this page._


---
Canonical: https://rewindex.com/company/github-copilot/incidents/9ym5p2sg6w5v · Markdown: https://rewindex.com/company/github-copilot/incidents/9ym5p2sg6w5v.md · JSON: https://rewindex.com/api/v1/companies/github-copilot/incidents/9ym5p2sg6w5v · Generated 2026-10-18T10:24:03.301Z
