# GitLab: CI/CD pipelines intermittently stuck on running status

- Impact (vendor’s label): major
- Status: resolved
- Started: 2026-03-05 21:25 UTC · Resolved: 2026-03-06 00:04 UTC · Duration: 2.6 h
- Updates: 8 · Affected components: CI/CD
- [Vendor status page: https://status.gitlab.com/pages/incident/5b36dc6502d06804c08349f7/69a9f4b650f2320a21a9175a](https://status.gitlab.com/pages/incident/5b36dc6502d06804c08349f7/69a9f4b650f2320a21a9175a)
- [Company: GitLab](https://rewindex.com/company/gitlab.md)

## Timeline of updates

- **investigating** 2026-03-05 21:25 UTC: Some users are experiencing CI/CD pipelines where jobs and pipelines are stuck in a “running” state, even though earlier-stage jobs have completed successfully. Follow https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462 for details.
- **investigating** 2026-03-05 21:40 UTC: No material change since the last update. The incident remains under active investigation. Follow https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462 for details.
- **investigating** 2026-03-05 21:55 UTC: We’re still actively investigating and are currently collating data from affected pipelines to better understand the patterns and root cause. Please follow https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462 for details.
- **investigating** 2026-03-05 22:12 UTC: We are currently reviewing logs from our production infrastructure and specifically the status and behavior of the pipeline workers for potential causes. Follow https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462 for details.
- **investigating** 2026-03-05 22:25 UTC: We’ve identified a potential issue with the job deferral mechanism that may be affecting pipeline transitions between stages. For details, please see https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462.
- **identified** 2026-03-05 23:19 UTC: We have identified the cause of this incident as the recurrence of an existing defect in the pipeline job deferral mechanism. In this case, it was triggered by a period of temporary high pipeline concurrency. See https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462 for details.
- **monitoring** 2026-03-05 23:27 UTC: At this time, we are confident that current pipelines are not being affected by this behavior. We are continuing to monitor new reports closely until the top of the hour to ensure there is no ongoing impact. See https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462 for details.
- **resolved** 2026-03-06 00:04 UTC: As there is no current impact, we are setting this incide to Resolved. We have identified the problematic behavior behind it and are working on a long-term fix. However, we know this defect can reoccur under certain high‑concurrency conditions. See https://gitlab.com/gitlab-com/gl-infra/production/-/work\_items/21462 for details.

## Rewindex changes for this incident

- 2026-03-05 21:25 UTC: [Major incident: CI/CD pipelines intermittently stuck on running status](https://rewindex.com/change/ia344ad2eb09afe.md)


---
Canonical: https://rewindex.com/company/gitlab/incidents/69a9f4b650f2320a21a9175a · Markdown: https://rewindex.com/company/gitlab/incidents/69a9f4b650f2320a21a9175a.md · JSON: https://rewindex.com/api/v1/companies/gitlab/incidents/69a9f4b650f2320a21a9175a · Generated 2026-10-18T09:36:50.380Z
