Szehon Ho created SPARK-49839:
---------------------------------
Summary: SPJ: Skip shuffles if possible for sorts
Key: SPARK-49839
URL: https://issues.apache.org/jira/browse/SPARK-49839
Project: Spark
Issue Type: New Feature
Components: SQL
Affects Versions: 4.0.0
Reporter: Szehon Ho
It may be possible to use the same logic as SPJ (for joins), to skip shuffles
for ORDER BY or other sort operations, if we are sorting on partition columns.
Today all data is shuffled even if we have all the partition values and can
return them in sorted order.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
