Changes / Inngest / Function processing delays
Inngest: Major incident: Function processing delays
Summary
Inngest reported major function-processing delays starting 2026-07-23 14:17 UTC, resolved at 2026-07-23 15:24 UTC (1 h 6 min); delays began around 14:03 UTC. An issue publishing to a new Kafka topic delayed function scheduling; the team isolated the topic and scaled consuming services to clear the backlog. No events were dropped.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
What changed
Before: not present
After: Function processing delays
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2026-07-23 14:17 UTC
Before: not present
After: 2026-07-23 15:24 UTC
Before: not present
After: We are actively investigating an issue with function execution that is leading to delays starting function runs after events are received. We will provider further updates as we identify the cause and resolve the issue.
Before: not present
After: We have identified the cause of the issue - the team has deployed a fix and is scaling to catch up on function delays.
Before: not present
After: New function execution has resumed and nearly caught up from the incurred backlog. Wait for event and cancel on handlers are still in a backlog and are catching up with processing.
No events were dropped during this issue, all functions will be executed, but with delays.
The root cause has been confirmd and changes are underway to prevent reoccurrence.
Before: not present
After: The incident is now resolved and the system is full operational.
Delays began around 14:03 UTC caused by an issue publishing to a new Kafka topic. Recovery began around 14:40 UTC as the team was able to isolate this topic. The consuming services which schedules new function runs was scaled out and began to consume the backlog. No events were dropped during this incident, all functions were scheduled, but with delays during this time window. No action is needed for manual recovery.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Function processing delays (this change) Inngest reported major function-processing delays starting 2026-07-23 14:17 UTC, resolved at 2026-07-23 15:24 UTC (1 h 6 min); delays began around 14:03 UTC. An issue publishing to a new Kafka topic delayed function scheduling; the team isolated the topic and scaled consuming services to clear the backlog. No events were dropped. | Major incident |