Skip to main content
 print this page

Sync partitions from source for lf and s3athena datasets

PUT 

/datasets/:id/sync-partitions

Triggers an asynchronous partition sync from the dataset S3 source via Step Functions. Supported only for TargetLocation lf or s3athena. Not supported for views, Iceberg tables, or Delta Lake tables (GE-1106: "sync partitions is/are not supported for {views| <target> datasets|deltalake/iceberg datasets}"). External datasets without partition keys return DS-1054. Internal datasets default the partition key to upload_date when none are defined. On success an email notification with more details is sent when the sync completes. No request body.

Request

Responses

Partition sync process triggered. Email notification follows on completion.

Response Headers
    Access-Control-Allow-Origin
    Access-Control-Allow-Methods
    Access-Control-Allow-Headers