[
https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mori[A]rty updated SPARK-33531:
---
Description:
Currently, when invoking CollectLimitExec#executeToIterator, a single-partition
[
https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mori[A]rty updated SPARK-33531:
---
Summary: [SQL] Reduce shuffle task number when calling
CollectLimitExec#executeToIterator (was:
[
https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mori[A]rty updated SPARK-33531:
---
Description:
Using a new method SparkPlan#executeTakeToIterator to implement
[
https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mori[A]rty updated SPARK-33531:
---
Description:
CollectLimitExec#executeToIterator should be implemented using
Mori[A]rty created SPARK-33531:
--
Summary: [SQL] Avoid shuffle when calling
CollectLimitExec#executeToIterator
Key: SPARK-33531
URL: https://issues.apache.org/jira/browse/SPARK-33531
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789589#comment-16789589
]
Mori[A]rty edited comment on SPARK-21067 at 3/11/19 2:04 PM:
-
Spark 2.4.0
[
https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789589#comment-16789589
]
Mori[A]rty commented on SPARK-21067:
Spark 2.4.0 still has the same problem. And I want to elaborate
[
https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789589#comment-16789589
]
Mori[A]rty edited comment on SPARK-21067 at 3/11/19 1:57 PM:
-
Spark 2.4.0
