Herman van Hövell created SPARK-50371:
-----------------------------------------
Summary: Introduce a shared plan representation
Key: SPARK-50371
URL: https://issues.apache.org/jira/browse/SPARK-50371
Project: Spark
Issue Type: New Feature
Components: Connect, SQL
Affects Versions: 4.0.0
Reporter: Herman van Hövell
Introduce a stable structured plan representation that can be used by both
Connect and Classic. This can be used by explain, queryExecution, or a
lightweight version of QueryExecutionListener.
This plan representation should support the following things:
* (Parsed/Logical/Pysical)Plans
** Schema
** Name
** Children
* Expressions
** Name
** Children
* Subqueries
* Reuse of subqueries/plans.
* Metrics
* (optionally) Statistics
The plan representation must be serializable to and from proto.
For connect we may want to send it at the end of query execution. We do need to
think about limits here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
