# PyPI (Python Infrastructure): PyPI Increased Error Rates

> PyPI (Python Infrastructure) status incident “PyPI Increased Error Rates” on 2017-04-15: impact none (vendor’s label), 0 min, 1 update(s). Archived by Rewindex.

Canonical: https://rewindex.com/company/pypi/incidents/fl474p9027bx
Last updated: 2017-04-15T14:14:00Z

- Impact (vendor’s label): none
- Status: resolved
- Started: 2017-04-15 14:14 UTC · Resolved: 2017-04-15 14:14 UTC · Duration: 0 min
- Updates: 1
- [Vendor status page: https://status.python.org/incidents/fl474p9027bx](https://status.python.org/incidents/fl474p9027bx)
- [Company: PyPI (Python Infrastructure)](https://rewindex.com/company/pypi.md)

## Timeline of updates

- **resolved** 2017-04-15 14:14 UTC: PyPI experienced increased error rates overnight, beginning at 00:35 UTC and ending at 00:43 UTC. The root cause was increased latency in calls to the backing Elasticsearch cluster which services PyPI's search. This latency caused our backend servers to spin on search requests until the default 60s timeout leading to exhaustion of our backend worker pools. The root cause of the Elasticsearch issue was a failing job which temporarily filled the disk on the Elasticsearch server. This job's work is not at all critical to PyPI's operation and the volume of data it was processing has grown unchecked. While search doesn't seem like it would generate sufficient traffic to overload our backends to this extent, the legacy PyPI XMLRPC interface exposes this search method and is frequently used by many automation tools. Mitigation: - Disabled failing non-critical job, the volume of data it was processing had grown unchecked. - Implemented metrics on calls to Elasticsearch - Implemented strict timeouts on calls to Elasticsearch to guard PyPI's availability. We'll be monitoring the affect of these timeouts via the implemented metrics and adjust them as needed to ensure search availability is not adversely affected during regular operation.

_From the vendor’s published history: only the final update text is available for incidents before Rewindex began polling this page._

## Cite this

Status incident (vendor impact label: none) posted by PyPI (Python Infrastructure), started 2017-04-15 14:14 UTC, resolved after 0 min, 1 update(s).

- Canonical URL: https://rewindex.com/company/pypi/incidents/fl474p9027bx
- Citation: PyPI (Python Infrastructure), “PyPI Increased Error Rates” (2017-04-15 14:14 UTC). Archived by Rewindex: https://rewindex.com/company/pypi/incidents/fl474p9027bx (CC BY 4.0).
- Markdown link: `[PyPI (Python Infrastructure): PyPI Increased Error Rates (2017-04-15)](https://rewindex.com/company/pypi/incidents/fl474p9027bx)`


---
Canonical: https://rewindex.com/company/pypi/incidents/fl474p9027bx · Markdown: https://rewindex.com/company/pypi/incidents/fl474p9027bx.md · JSON: https://rewindex.com/api/v1/companies/pypi/incidents/fl474p9027bx · Data licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/) · Generated 2026-11-04T16:42:35.464Z