Search

Changes / GitLab / Elevated Errors Affecting AI Gateway Health Checks

GitLab: Major incident: Elevated Errors Affecting AI Gateway Health Checks

Summary

Summary pending. The diff below shows exactly what changed.

Major incidentLabel: outage (model (Jev), 81%)Changed Detected Source: status.gitlab.com (opens in new tab)

Incident page: full timeline of updates →

What changed

AddedTitle#1
Before: not present
After: Elevated Errors Affecting AI Gateway Health Checks
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-07-14 22:47 UTC
AddedResolved time#5
Before: not present
After: 2026-07-15 00:47 UTC
AddedAffected components#6
Before: not present
After: GitLab Duo
AddedUpdateinvestigating#7
Before: not present
After: We're aware of elevated errors affecting AI Gateway health checks. We've identified a likely cause and are actively working on a fix. Details in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22519
AddedUpdateidentified#8
Before: not present
After: We have identified the problematic change causing this behavior and are working to revert it. Details will be shared in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22519
AddedUpdateidentified#9
Before: not present
After: We're continuing to work on reverting the change causing this issue. Details will be shared in: gitlab.com/gitlab-com/gl-infra/production/-/work_items/22519
AddedUpdateidentified#10
Before: not present
After: The revert remains in progress. Additional updates will be shared in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22519
AddedUpdatemonitoring#11
Before: not present
After: Deployment for the revert has reached production. Manual verification is successful with error rates trending down. We are continuing to monitor. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22519
AddedUpdatemonitoring#12
Before: not present
After: We are monitoring the situation to ensure that services have returned to normal. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22519
AddedUpdateresolved#13
Before: not present
After: We are seeing error rates return to normal. This issue has been resolved. Details at https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22519

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Elevated Errors Affecting AI Gateway Health Checks (this change)Major incident

All GitLab changes → · GitLab profile · Markdown · JSON