Changes / Matillion / Customers receiving Authentication failed messages upon login attempts
Matillion: Major incident: Customers receiving Authentication failed messages upon login attempts
Summary
Matillion reported a major Hub login outage starting 2026-09-01 17:03 UTC, resolved at 2026-09-01 17:55 UTC after 52 min; the support portal was also affected. New tokens could not be issued after hitting the global token limit; Matillion attributed widespread permission-check failures to an out-of-memory event triggered by a Permission Service deployment.
Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.
What changed
Before: not present
After: Customers receiving Authentication failed messages upon login attempts
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2026-09-01 17:03 UTC
Before: not present
After: 2026-09-01 17:55 UTC
Before: not present
After: Hub
Before: not present
After: We are currently investigating this issue.
Before: not present
After: We are currently experiencing an incident where the Permission service deployment errored out in Production. Users attempting to log in are impacted as new tokens cannot be issued due to hitting the global token limit. The Matillion support portal is also affected. The team is actively investigating the root cause.
Before: not present
After: Root Cause: The deployment of a Permission Service triggered an out of memory (OOM) event which led to widespread permission check failures across the product.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Customers receiving Authentication failed messages upon login attempts (this change) Matillion reported a major Hub login outage starting 2026-09-01 17:03 UTC, resolved at 2026-09-01 17:55 UTC after 52 min; the support portal was also affected. New tokens could not be issued after hitting the global token limit; Matillion attributed widespread permission-check failures to an out-of-memory event triggered by a Permission Service deployment. | Major incident |
All Matillion changes → · Matillion profile · Markdown · JSON