rewindex

CompaniesRudderStackIncidents

RudderStack: Incorrect Delivery for S3 and S3 Datalake

MinorStatus: resolvedStarted Resolved (2.3 h)2 updatesstspg.io (opens in new tab)

Affected components: Data Processing Pipeline - Data Processing Pipeline (US)Data Processing Pipeline (US)Warehouses

Timeline of updates

  1. identified

    Issue has been identified with S3 and S3 datalake deliveries. Actively working on the fix.

  2. resolved

    An issue was identified with the delivery module for S3 & S3_DATALAKE destinations, leading to the incorrect duplication of the prefix in the final file path. This resulted in data being uploaded to an unintended location, making it unavailable for any downstream consumption for the duration of the incident.
    The flag was enabled only for free tier and starter and growth customers.

    Follow the below recommended steps to recover the data:

    Prerequisite: Make sure the AWS CLI is installed and configured locally to access the relevant S3 bucket.
    1. Go to the Rudderstack configuration page of your S3/S3 Datalake destinations and copy bucket name and prefix.
    2. Copy all the files from the double-prefix path to the single prefix path.
    Command: aws s3 cp s3://{bucket_name}/{prefix}/{prefix}/ s3://{bucket_name}/{prefix}/ --recursive
    3. Delete the original files (optional)
    Command:aws s3 rm s3://{bucket_name}/{prefix}/{prefix}/ --recursive

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert. That proves this record existed by then and has not been changed since, by anyone, Rewindex included.

How the archive is checked, and what it cannot prove.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab).

Cite this

Status incident (vendor impact label: minor) posted by RudderStack, started 2025-05-28 17:00 UTC, resolved after 2.3 h, 2 update(s).

Title
Incorrect Delivery for S3 and S3 Datalake
Vendor
RudderStack
Date
URL
https://rewindex.com/company/rudderstack/incidents/l6d24f0nn8s7

RudderStack profileRecent RudderStack incidentsAll outages on May 28, 2025RudderStack in May 2025MarkdownJSON