Hetzner: Object Storage in location HEL1 partially degraded
Timeline of updates
- investigating
Start: 2026-09-09T12:00:00+00:00
We are observing elevated response times and stalled requests for a subset of buckets. - in progress
The situation for affected customers in hel1 has stabilized. Few requests may still take longer than usual to complete, and we are actively working on addressing that.
- in progress
Unfortunately, the issue remains unresolved. Requests may still sometimes be delayed or time out for buckets located on the affected cluster.
We have managed to narrow it down to certain low-level commit operations becoming stuck, sometimes for several seconds.
Investigating this issue is difficult because these stalls never last long and affect different parts of the cluster at different times.
We are continuing to investigate this issue. Thank you for your understanding. - in progress
We were able to use a workaround to contain the problem to such an extent that it no longer directly affects buckets; however, it is still not entirely clear how the situation occurred. We are still investigating the issue.
- monitoring
Our cluster is back online; we are continuing to monitor the situation
- monitoring
We are still experiencing occasional delays and are continuing to work on restoring the service in full.
- monitoring
Due to the increased utilisation of the Object Storage product, we are still experiencing partially elevated response times and stalled requests.
We are implementing bucket migrations within HEL1 to address the I/O situation that has been causing performance issues for a subset of customers.
These migrations will be performed in the background and will not require any changes on the customer side. - resolved
No longer listed in the status feed.
Changes Rewindex caught on this incident
Archive proof
Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert. That proves these records existed by then and have not been changed since, by anyone, Rewindex included.
How the archive is checked, and what it cannot prove.
First version captured
In the 2026-10-22 checkpoint, timestamped by FreeTSA and DigiCert on . Record hash
9ca4d50d754a26d9…Version 2 captured
In the 2026-10-22 checkpoint, timestamped by FreeTSA and DigiCert on . Record hash
bb8074a3247dc603…
Impact, status and times are the vendor’s own, as last archived. View on status.hetzner.com (opens in new tab).
Cite this
Status incident (vendor impact label: minor) posted by Hetzner, started 2026-09-09 12:00 UTC, resolved after 43 d, 8 update(s); edited after publishing.
- Title
- Object Storage in location HEL1 partially degraded
- Vendor
- Hetzner
- Date
- URL
- https://rewindex.com/company/hetzner/incidents/382ed0e5-f1c4-45ec-a7a3-326d3970d6b3
Hetzner profileRecent Hetzner incidentsAll outages on September 9, 2026Hetzner in September 2026MarkdownJSON