EnricoMi commented on PR #35965: URL: https://github.com/apache/spark/pull/35965#issuecomment-1096802477
@sunchao @dongjoon-hyun looks like #35657 (20ffbf7b) broke reusing **partitioning and order** provided by DS V2 in my tests, which worked before rebase. The query planner now introduces a shuffle and sort again. Any suggestion how Spark can pick up the existing partitioning and order with the new partitioning design? Any plans for DS V2 to report ordering? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
