Ingest Spark execution lineage events
POST/jobs/lineage/execution-events
Spline agent callback that attaches read/write metrics to a plan previously stored by POST /jobs/lineage/execution-plans. Body must be a JSON array. Only payload[0] is used (planId plus extra.readMetrics / extra.writeMetrics). Byte fields filesSize, filesMaxSplitSize, and numOutputBytes are converted to human-readable strings before they are appended on the metrics item and written to {jobId}/execution-lineage/{executionId}.json. If the PlanId is unknown, the handler skips the update and still returns HTTP 200. An empty array raises IndexError and becomes HTTP 500. Success Message is always "Metrics Added Successfully". The handler has a single except Exception: typed failures surface as HTTP 500 GE-1008, not 400. role_id is audit-only.
Request
Responses
- 200
- 500
Metrics accepted. Message is "Metrics Added Successfully", including when PlanId is not in the metrics table (no-op).
Response Headers
Any handler exception, including empty array, invalid JSON, S3 errors other than 404, and GE-1018 metadata update failure. Body is {"Message": "GE-1008 - Could not complete the request. Please try again."}. HTTP 400 is not returned by this lambda.