Search

Changes / GitLab / Issue with processing CI jobs

GitLab: Major incident: Issue with processing CI jobs

Summary

Summary pending. The diff below shows exactly what changed.

Major incidentLabel: outage (model (Jev), 79%)Changed Detected Source: status.gitlab.com (opens in new tab)

Incident page: full timeline of updates →

What changed

AddedTitle#1
Before: not present
After: Issue with processing CI jobs
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-06-05 11:58 UTC
AddedResolved time#5
Before: not present
After: 2026-06-05 13:46 UTC
AddedAffected components#6
Before: not present
After: CI/CD, CI/CD - Hosted runners on Linux
AddedUpdateinvestigating#7
Before: not present
After: We are investigating an issue where CI jobs are not processing. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22256
AddedUpdateidentified#8
Before: not present
After: We have identified a recent change as a possible root cause and we are working on rolling back the change. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22256
AddedUpdateidentified#9
Before: not present
After: We are still working on rolling back the change that we believe is the root cause. This issue impacts GitLab Hosted Runners and Hosted Runners on Linux. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22256
AddedUpdateidentified#10
Before: not present
After: We are still working on rolling back the change that we believe is the root cause. This issue impacts GitLab Hosted Runners and Hosted Runners on Linux. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22256
AddedUpdateidentified#11
Before: not present
After: The change has been reverted and we are seeing that error rates are recovering. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22256
AddedUpdatemonitoring#12
Before: not present
After: Error rates have recovered back to normal levels and we started processing jobs again. We expect that the job queue should be processed over the next 30 minutes. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22256
AddedUpdateresolved#13
Before: not present
After: The job queue is now cleared and we do not expect any further customer impact. This is considered resolved. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22256

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Issue with processing CI jobs (this change)Major incident

All GitLab changes → · GitLab profile · Markdown · JSON