The GCS schema pipeline exports transformed data to a GCS bucket. This can be useful in case you want to export Mixpanel data into your own BigQuery instance.
To set up a schematized export pipeline to Google Cloud Storage (GCS) from Mixpanel, you must configure GCS to receive the exported data, then create a pipeline to export the data.
The following document summarizes the steps to edit GCS permissions so that it accepts the Mixpanel export, and provides an example request to create the pipeline.
Create a destination bucket, or use an existing one.
"[email protected]" needs to be given a "Storage Object Admin" role on the bucket you are creating or intending to reuse for this purpose.
After permissions have been granted, use the Data Pipelines API to create the pipeline. Here is an example request:
curl https://data.mixpanel.com/api/2.0/nessie/pipeline/create \ -u API_SECRET: \ -d type="gcs-schema" \ -d from_date="2019-08-10" \ -d gcs_bucket="example-gcs-export" \ -d gcs_prefix="dwe" \ -d schema_type="multischema" \ -d gcs_region="us-east-2"
Updated about 1 year ago