# GitLab: Major incident: Self-managed runners seeing 401 when picking jobs

**Summary:** _summary pending_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2025-09-29 04:00 UTC · Detected: 2026-10-18 05:08 UTC
- [Source: https://status.gitlab.com/pages/incident/5b36dc6502d06804c08349f7/68da0472923a050548bd7c07](https://status.gitlab.com/pages/incident/5b36dc6502d06804c08349f7/68da0472923a050548bd7c07)
- [Company: GitLab](https://rewindex.com/company/gitlab.md)
- Versions: before (none: first archived) → after incident\_version:188/68da0472923a050548bd7c07@c43750b20ee0
- Change 1 of 1 for this incident

Incident page (full timeline): [Self-managed runners seeing 401 when picking jobs](https://rewindex.com/company/gitlab/incidents/68da0472923a050548bd7c07.md)
## What changed

**1. Added: Title**

```diff
+ Self-managed runners seeing 401 when picking jobs
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2025-09-29 04:00 UTC
```

**5. Added: Resolved time**

```diff
+ 2025-09-29 07:17 UTC
```

**6. Added: Affected components**

```diff
+ CI/CD, CI/CD - Self-managed runners
```

**7. Added: Update** (investigating) · 2025-09-29 04:00 UTC

```diff
+ We are investigating reports of self-managed runners receiving 401 errors when trying to pick up jobs. See https://gitlab.com/gitlab-com/gl-infra/production/-/issues/20621 for more details.
```

**8. Added: Update** (identified) · 2025-09-29 04:38 UTC

```diff
+ We have identified the MR that caused GitLab Runner versions older than 18 to see 401s when picking up jobs from GitLab.com. We are rolling back the MR and will update here when rollback is complete. See https://gitlab.com/gitlab-com/gl-infra/production/-/issues/20621 for more details.
```

**9. Added: Update** (monitoring) · 2025-09-29 05:40 UTC

```diff
+ The rollback has been completed, and we are observing a reduced rate of 401 errors. Please see https://gitlab.com/gitlab-com/gl-infra/production/-/issues/20621 for more details.
```

**10. Added: Update** (resolved) · 2025-09-29 07:17 UTC

```diff
+ The incident is now resolved, and we are no longer observing 401 errors. Please see https://gitlab.com/gitlab-com/gl-infra/production/-/issues/20621 for more details.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2025-09-29 04:00 UTC | Major incident: Self-managed runners seeing 401 when picking jobs (this change) | outage |

All GitLab changes: [timeline](https://rewindex.com/company/gitlab/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i9b36f5bac06f9d · Markdown: https://rewindex.com/change/i9b36f5bac06f9d.md · JSON: https://rewindex.com/api/v1/changes/i9b36f5bac06f9d · Generated 2026-10-18T11:25:22.713Z