jiaan.geng created SPARK-43829: ---------------------------------- Summary: Improve SparkConnectPlanner by reuse Dataset and avoid construct new Dataset Key: SPARK-43829 URL: https://issues.apache.org/jira/browse/SPARK-43829 Project: Spark Issue Type: Improvement Components: Connect Affects Versions: 3.5.0 Reporter: jiaan.geng
Currently, SparkConnectPlanner.transformRelation always return the LogicalPlan of Dataset. The SparkConnectStreamHandler.handlePlan constructs a new Dataset for it. Sometimes, SparkConnectStreamHandler.handlePlan could reuse the Dataset created by SparkConnectPlanner.transformRelation. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org