[jira] [Commented] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-42651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695991#comment-17695991
 ] 

Apache Spark commented on SPARK-42651:
--

User 'ulysses-you' has created a pull request for this issue:
https://github.com/apache/spark/pull/40262

> Optimize global sort to driver sort
> ---
>
> Key: SPARK-42651
> URL: https://issues.apache.org/jira/browse/SPARK-42651
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.5.0
>Reporter: XiDuo You
>Priority: Major
>
> If the size of plan is small enough, it's more efficient to sort all rows at 
> driver side that saves one shuffle



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-42651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695992#comment-17695992
 ] 

Apache Spark commented on SPARK-42651:
--

User 'ulysses-you' has created a pull request for this issue:
https://github.com/apache/spark/pull/40262

> Optimize global sort to driver sort
> ---
>
> Key: SPARK-42651
> URL: https://issues.apache.org/jira/browse/SPARK-42651
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.5.0
>Reporter: XiDuo You
>Priority: Major
>
> If the size of plan is small enough, it's more efficient to sort all rows at 
> driver side that saves one shuffle



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org