Changes / GitLab / Delay in background job processing
GitLab: Major incident: Delay in background job processing
Summary
Summary pending. The diff below shows exactly what changed.
Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: status.gitlab.com (opens in new tab)
Incident page: full timeline of updates →
What changed
Before: not present
After: Delay in background job processing
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2026-03-16 16:23 UTC
Before: not present
After: 2026-03-17 11:54 UTC
Before: not present
After: Background Processing
Before: not present
After: We are investigating a delay in background job processing. Users may observe a delay in CI job status updates in the UI. Details in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
Before: not present
After: Our investigation is ongoing. Users may still observe delays in CI job status updates. Details in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
Before: not present
After: We've identified a potential fix and are working to deploy it. We'll update you once we have a production deployment timeline. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
Before: not present
After: The primary fix has been merged and deployment is underway. Full rollout typically takes several hours, so we're pursuing additional mitigations and implementation changes in parallel. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
Before: not present
After: We are observing improved system metrics and reduced user impact. Mitigations are pending deployment with the goal of preventing future recurrence. This incident will remain in monitoring status as we observe system behavior. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
Before: not present
After: Monitoring of CI pipelines shows metrics have returned to normal. We will keep monitoring the fix for the next hour. More details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
Before: not present
After: After monitoring the CI pipelines, we are marking the incident as resolved. More details https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Delay in background job processing (this change) | Major incident |