Companies / GitLab / incidents

GitLab: CI/CD pipeline processing delays

Affected components: CI/CD

Timeline of updates

1. investigating2026-03-09 15:59 UTC

   We are seeing delays in CI/CD pipeline processing. The cause for this problem is under investigation. Please follow https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21484 for more details.

2. investigating2026-03-09 16:19 UTC

   Our team is still investigating this issue. Users might encounter some delays with processing CI/CD pipelines.

3. investigating2026-03-09 16:33 UTC

   Our team is considering increasing resources to address the issue with the Sidekiq backlog impacting CI/CD pipelines. We're working on a deployment fix to address this, though we are seeing some improvement overall with queue durations.

4. identified2026-03-09 17:07 UTC

   Our team has turned off a specific worker to help improve pipeline processing. There has been significant recovery, and our team has identified this as a resource issue. We are monitoring for stability in addition to investigating the root cause and determining a permanent fix.

5. identified2026-03-09 17:45 UTC

   We are continuing to monitor but the main backlog drivers are mitigated. Users should expect normal operations. Our team is currently deploying a configuration update to further address this. We'll provide an update once it is deployed.

6. resolved2026-03-09 18:15 UTC

   The configuration change has been deployed and we have seen stability with Sidekiq and pipeline processing. This incident is now resolved.

Rewindex changes for this incident

• Major incident: CI/CD pipeline processing delays 2026-03-09 15:59 UTC

Impact, status and times are the vendor’s own, as last archived. View on status.gitlab.com (opens in new tab). GitLab profile · Recent GitLab incidents · Markdown · JSON