# GitLab: Major incident: Delay in background job processing

**Summary:** _summary pending_
- Kind: Major incident · Label: degradation (model (Jev))
- Changed: 2026-03-16 16:23 UTC · Detected: 2026-10-18 05:08 UTC
- [Source: https://status.gitlab.com/pages/incident/5b36dc6502d06804c08349f7/69b82e936d1d12059dda1fc6](https://status.gitlab.com/pages/incident/5b36dc6502d06804c08349f7/69b82e936d1d12059dda1fc6)
- [Company: GitLab](https://rewindex.com/company/gitlab.md)
- Versions: before (none: first archived) → after incident\_version:188/69b82e936d1d12059dda1fc6@cc2d9caa4a78
- Change 1 of 1 for this incident

Incident page (full timeline): [Delay in background job processing](https://rewindex.com/company/gitlab/incidents/69b82e936d1d12059dda1fc6.md)
## What changed

**1. Added: Title**

```diff
+ Delay in background job processing
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2026-03-16 16:23 UTC
```

**5. Added: Resolved time**

```diff
+ 2026-03-17 11:54 UTC
```

**6. Added: Affected components**

```diff
+ Background Processing
```

**7. Added: Update** (investigating) · 2026-03-16 16:23 UTC

```diff
+ We are investigating a delay in background job processing. Users may observe a delay in CI job status updates in the UI. Details in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
```

**8. Added: Update** (investigating) · 2026-03-16 16:48 UTC

```diff
+ Our investigation is ongoing. Users may still observe delays in CI job status updates. Details in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
```

**9. Added: Update** (identified) · 2026-03-16 17:21 UTC

```diff
+ We've identified a potential fix and are working to deploy it. We'll update you once we have a production deployment timeline. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
```

**10. Added: Update** (identified) · 2026-03-16 17:54 UTC

```diff
+ The primary fix has been merged and deployment is underway. Full rollout typically takes several hours, so we're pursuing additional mitigations and implementation changes in parallel. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
```

**11. Added: Update** (monitoring) · 2026-03-16 20:30 UTC

```diff
+ We are observing improved system metrics and reduced user impact. Mitigations are pending deployment with the goal of preventing future recurrence. This incident will remain in monitoring status as we observe system behavior. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
```

**12. Added: Update** (monitoring) · 2026-03-17 10:58 UTC

```diff
+ Monitoring of CI pipelines shows metrics have returned to normal. We will keep monitoring the fix for the next hour. More details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
```

**13. Added: Update** (resolved) · 2026-03-17 11:54 UTC

```diff
+ After monitoring the CI pipelines, we are marking the incident as resolved. More details https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21562
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2026-03-16 16:23 UTC | Major incident: Delay in background job processing (this change) | degradation |

All GitLab changes: [timeline](https://rewindex.com/company/gitlab/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i3f7d1118354d5e · Markdown: https://rewindex.com/change/i3f7d1118354d5e.md · JSON: https://rewindex.com/api/v1/changes/i3f7d1118354d5e · Generated 2026-10-18T12:19:12.876Z