rewindex

CompaniesGitHubIncidents

GitHub: Incident with Pull Requests, Issues, Webhooks and Actions

MinorStatus: resolvedStarted Resolved (1.5 h)1 updatewww.githubstatus.com (opens in new tab)

Timeline of updates

  1. resolved

    This incident has been resolved. On November 27, 2023 at 18:46 UTC, we attempted to rotate our OpenID Connect (OIDC) authentication flow certificates. Due to an error in the certificate formatting, we uploaded an invalid certificate configuration that was not observed in our pre-production testing. Our background job servers were unable to start because a valid configuration is required at worker start up. As a result, users experienced delays in Pull Requests, Webhooks, Issues, Actions and Projects. Rollback of the change was slowed by the invalid certificate as our deployment system relied on the same certificate. Rollback was completed at 20:35 UTC. Most services recovered by 20:44 UTC. Delayed updates to Issues and Pull Requests were applied normally once the changes were rolled back. After the change was rolled back, a large queue of Actions-related jobs built up which included Pull Request, Pull Request review and Pull Request review comment events. About 2.3% of Actions jobs failed during the duration of the incident. Job queue times returned to normal once all remaining jobs were processed. We are working to improve our certificate testing and rotation process to reduce the risk of customer-impacting errors.

From GitHub’s published incident history: for incidents before Rewindex began polling this status page, only the final update text is available.

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert.

How the archive is checked, and what it cannot prove.

This incident predates live tracking (October 17, 2026). It came from the vendor’s own published history, which is not covered by checkpoints.

Impact, status and times are the vendor’s own, as last archived. View on www.githubstatus.com (opens in new tab).

Cite this

Status incident (vendor impact label: minor) posted by GitHub, started 2023-11-27 19:43 UTC, resolved after 1.5 h, 1 update(s).

Title
Incident with Pull Requests, Issues, Webhooks and Actions
Vendor
GitHub
Date
URL
https://rewindex.com/company/github/incidents/66vhjmd266r9

GitHub profileRecent GitHub incidentsAll outages on November 27, 2023GitHub in November 2023MarkdownJSON