Herman van Hövell created SPARK-52452:
-----------------------------------------
Summary: Break-up the SparkConnectPlanner
Key: SPARK-52452
URL: https://issues.apache.org/jira/browse/SPARK-52452
Project: Spark
Issue Type: Task
Components: Connect, SQL
Affects Versions: 4.1.0
Reporter: Herman van Hövell
The SparkConnectPlanner is a monolithic beast. This has a couple of problems:
* Hard to work with for developers
* It has a dependency on all of Spark. This is annoying for plugin developers.
The proposal is to break the planner apart into a couple of logical components,
e.g.:
* Regular SQL operations
* Read
* Write
* Expressions
* Stats
* Catalog
* ...
Before working on this please ping me or Martin. This requires a small design.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
