Raw Export Pipeline

Use Mixpanel's Raw Export Pipeline to export your unaltered Mixpanel event data directly into supported destination buckets. The exported data includes all event properties and timestamps in JSON format.

You must configure your destination bucket before creating the raw export pipeline. This ensures that the data is not rejected after Mixpanel exports it.

📘

Each pipeline is tied to a specific Mixpanel project and not the organization. So you will need to create a separate pipeline for each of your projects, if needed.

📘

Raw export pipelines currently supports exporting only to Google Cloud Storage, Amazon S3 or Azure Blob Storage. Please note that exporting user profile data and PARQUET format is not currently supported. Please consider using Schematized Export Pipeline if these features are desired.

📘

Raw Export Pipeline is available as an add-on for Growth and Enterprise plans. Additionally, a free 30 day trial is available to customers looking to try this add-on. You may create one trial pipeline, which will close when the 30 day trial period ends. For more information see Trial Pipeline.

Raw Data Pipeline Details

The raw data pipeline creates a scheduled raw export from Mixpanel to a data storage solution.

This is different from the raw export API as the raw export pipeline is scheduled and ongoing. The raw export pipeline also requires a destination.

Upon successful creation of a pipeline, the data will be exported to <BUCKET_NAME>/<PATH_PREFIX>/<MIXPANEL_PROJECT_ID>/<YEAR>/<MONTH>/<DAY>/full_day for daily exports and <BUCKET_NAME>/<PATH_PREFIX>/<MIXPANEL_PROJECT_ID>/<YEAR>/<MONTH>/<DAY>/<HOUR> for hourly exports. An example path for hourly export would be my-mixpanel-export/my_prefix/1234567/2021/03/10/16.

Upon the completion of each export, an empty complete file will be written in the finished hour or day prefix. The absence of this file means there is an ongoing export for that hour or day.

📘

The date used in the path prefix is not in UTC but in the project timezone from the project settings page

📘

Exporting the events that come into Mixpanel a few days late to the configured pipeline is not currently supported by raw export pipeline. Please consider using Schematized Export Pipeline if this feature is desired.

Raw Export Pipeline Format

The raw export pipeline exports your event data in its unaltered JSON format.

An example exported event could look like:

// Expected Return
{
  "event": "Viewed report",
    "properties": {
        "distinct_id": "foo",
        "time": 1518314400,
        "$os": "Linux",
        "$browser": "Chrome",
        "Project ID": "3",
        "mp_country_code": "US"
    }
}

Did this page help you?