Rewindex

Companiescrates.ioIncidents

crates.io: static.crates.io not resolving

CriticalStatus: resolvedStarted Resolved (38 min)3 updatesstspg.io (opens in new tab)
Part of an outage event

Azure outage, Jan 25, 2023 · 14 vendors, 14 incidents

crates.io’s incident started in the same window without naming Azure (timing only, not evidence of a link). (timing only, posted +2 h 40 min vs the first vendor naming Azure)

Swipe sideways to see the whole diagram.

same windowAzureown incident not archivedWithin an hour1 vendor, 1 blamed AzureMongoDB Atlas1 to 4 hours later3 vendors, 2 blamed AzureGrafana Cloud, Retool, InfluxData (InfluxDB Cloud)crates.io (this incident)posted +2 h 40 min
same windowAzureown incident not archivedWithin an hour1 vendor, 1 blamed AzureMongoDB Atlas1 to 4 hours later3 vendors, 2 blamed AzureGrafana Cloud, Retool,InfluxData (InfluxDB Cloud)crates.io (this incident)posted +2 h 40 min
crates.io is outlined in red. Groups show up to a few vendors each; the event page lists every incident.
Mermaid source
flowchart LR
  root["Azure<br/>own incident not archived"]:::inferred
  h1["Within an hour<br/>1 vendor, 1 blamed Azure<br/>MongoDB Atlas"]:::blames
  root --> h1
  h4["1 to 4 hours later<br/>3 vendors, 2 blamed Azure<br/>Grafana Cloud, Retool, InfluxData (InfluxDB Cloud)"]:::blames
  root --> h4
  me["crates.io (this incident)<br/>posted +2 h 40 min"]:::me
  root -.->|"same window"| me

Full event: timeline, evidence and all vendors →

Detected automatically from incidents that started together and named the same provider. A link means one vendor’s incident named another, not a confirmed cause.

Affected components: crates.io

Timeline of updates

  1. identified

    Due to an infrastructure change, the DNS record for static.crates.io, the CDN serving crate releases, stopped resolving. The new records are propagating, the problem should be fixed soon.

  2. monitoring

    Traffic to static.crates.io is returning to normal levels and we're monitoring the situation.

  3. resolved

    Traffic returned to normal levels.

Changes Rewindex caught on this incident

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert. That proves this record existed by then and has not been changed since, by anyone, Rewindex included.

How the archive is checked, and what it cannot prove.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab).

crates.io profileRecent crates.io incidentsMarkdownJSON