Changes / Runway / Significant delays in asset generation

Runway: Major incident: Significant delays in asset generation

Summary

Runway reported a major asset-generation degradation affecting App, Backend and Public API from 2025-12-05 02:35 UTC to 2025-12-05 03:51 UTC, lasting 1 h 15 min. Users faced significant delays and generation failures; a fix was deployed, with Gen4 Turbo backlog-related queue delays noted before full resolution.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 69%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Significant delays in asset generation
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2025-12-05 02:35 UTC
AddedResolved time#5
Before: not present
After: 2025-12-05 03:51 UTC
AddedAffected components#6
Before: not present
After: App, Backend, Public API
AddedUpdateinvestigating#7
Before: not present
After: Our engineering team is investigating a problem affecting users. We're aware of the problem and are working towards a solution. We will provide an update soon.
AddedUpdateinvestigating#8
Before: not present
After: We're aware that some users are experiencing significant delays in generations and are actively investigating the issue. We'll provide updates as we learn more.
AddedUpdateinvestigating#9
Before: not present
After: We're continuing to investigate the issue. A significant number of generations are currently failing to process.
AddedUpdatemonitoring#10
Before: not present
After: We've identified the root cause of the generation delays and have rolled out a fix. Generations should now be processing normally. We'll continue monitoring to ensure stability.
AddedUpdatemonitoring#11
Before: not present
After: All systems have recovered and are processing normally. Gen4 Turbo is experiencing elevated queue wait times due to backlog, but this should clear soon.
AddedUpdateresolved#12
Before: not present
After: The issue has been fully resolved and all systems are back to normal operation. We apologize for the disruption.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Significant delays in asset generation (this change)
Runway reported a major asset-generation degradation affecting App, Backend and Public API from 2025-12-05 02:35 UTC to 2025-12-05 03:51 UTC, lasting 1 h 15 min. Users faced significant delays and generation failures; a fix was deployed, with Gen4 Turbo backlog-related queue delays noted before full resolution.
Major incident

All Runway changes → · Runway profile · Markdown · JSON