Jon Mio created SPARK-52166:
-------------------------------
Summary: [SDP] Add support for PipelineEvents
Key: SPARK-52166
URL: https://issues.apache.org/jira/browse/SPARK-52166
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.0.0
Reporter: Jon Mio
The execution of an SDP is a complex, multi-stage computation. To observe
progress and monitor state transitions of a pipeline execution, we will
maintain a stream of pipeline events (e.g. flow started, flow completed,
pipeline run started, pipeline run completed). This ticket tracks the task to
introduce the data model for PipelineEvents.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
