Companies/GitHub Copilot/Incidents

GitHub Copilot: Incident with Actions and Webhooks

Timeline of updates

1. resolved2023-11-28 17:59 UTC

   This incident has been resolved. An interaction between two feature flag rollouts caused us to suppress delivery of push webhooks between 16:23 and 17:11 UTC in a manner that evaded our existing observability. This affected 71,000 repositories whose users will have noted missing webhook deliveries and/or experienced Actions jobs with push triggers failing to start. During this period, around 25% of new Actions jobs were impacted. The issues were resolved by disabling one of the feature flags in question. After weighing various options for retroactively dispatching old push webhooks, we concluded that the risk of delivering stale data to customers with these redeliveries outweighed the possible benefit. As follow up to this incident, we are working to improve monitoring of webhook throughput and to document a policy around webhook redelivery timelines.

From GitHub Copilot’s published incident history: for incidents before Rewindex began polling this status page, only the final update text is available.

Impact, status and times are the vendor’s own, as last archived. View on www.githubstatus.com (opens in new tab).

GitHub Copilot profileRecent GitHub Copilot incidentsAll outages on November 28, 2023GitHub Copilot in November 2023MarkdownJSON