akshaytayal opened a new pull request, #13246:
URL: https://github.com/apache/gluten/pull/13246

   ## What changes are proposed in this pull request?
   
   Re-enables the 4 Spark 4.2 storage-partitioned join tests in 
`GlutenKeyGroupedPartitioningSuite` that cover sorted-merge (k-way merge) 
coalescing in `GroupPartitionsExec`:
   
   - `SPARK-55715: Custom metrics of sorted-merge coalesced partitions`
   - `SPARK-55715: preserve outputOrdering when coalescing partitions with 
sorted merge`
   - `SPARK-55715: preserve outputOrdering when coalescing 
transform-partitioned splits`
   - `SPARK-56549: k-way merge enabled only when parent requires ordering`
   
   With Gluten, calling `execute()` on the coalescing `GroupPartitionsExec` 
(the first test does this to check for `SortedMergeCoalescedRDD`) fails with 
`UnsupportedOperationException` from `ColumnarToColumnarExec.doExecute`, 
because its input is a Gluten columnar node. The other three fail when they 
look for a vanilla `SortMergeJoinExec` or `ShuffledHashJoinExec`, which Gluten 
replaces.
   
   This commit only removes the 4 excludes. The fix will follow in this PR. The 
other 25 tests of #13174 are in #13243.
   
   Part of #13174.
   
   ## How was this patch tested?
   
   Spark 4.2 UT CI (`spark-test-spark42` group 3 runs 
`org.apache.spark.sql.connector`).
   
   ## Was this patch authored or co-authored using generative AI tooling?
   
   Generated-by: GitHub Copilot CLI (Claude Opus 5.5)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to