Trigger Iceberg/Hudi/DeltaLake dataload for pending files

POST 
/datasets/:id/dataloads

Starts an asynchronous Iceberg/Hudi/DeltaLake dataload for pending Landing Zone files on the dataset. Handler is fileUploadS3LZTrigger.

Required: query type (iceberg | hudi | deltalake) and body Files (non-empty array of pending file-load FileName keys, max 750). Empty Files → IPV-1001. type missing → IPV-1052; invalid type → IPV-1071. type must match the dataset framework (GE-1034 on mismatch). Every Files entry must have LoadStatus pending (GE-1034 otherwise).

Caller must be owner or editor. Rejected while DatasetStatus is {type}-data-loading (concurrent load). On success the load runs in the background; response Message is "{Framework} dataload started successfully and running in background".

Request

Responses

200

Async dataload started. Message is "{Iceberg|Hudi|Deltalake} dataload started successfully and running in background"; DatasetId echoes path id.

Response Headers

Access-Control-Allow-Origin
Access-Control-Allow-Methods
Access-Control-Allow-Headers

400

Validation/auth failure. Codes/messages: IPV-1052 (missing type), IPV-1071 (type not in iceberg/hudi/deltalake), IPV-1001 (empty Files), GE-1034 (type/dataset mismatch, non-pending files, or validation failure), AUTH when caller lacks editor access, plain Message when more than 750 files or DatasetStatus is {type}-data-loading.

Response Headers

Access-Control-Allow-Origin
Access-Control-Allow-Methods
Access-Control-Allow-Headers

500

Backend/generic failure.

Response Headers

Access-Control-Allow-Origin
Access-Control-Allow-Methods
Access-Control-Allow-Headers