dongjoon-hyun edited a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573485861 Of course, it does. And, Apache Spark doesn't change the original semantic of `Seq(...).toDF.orderBy("b").sortWithinPartitions`. > The key point here is optimizer should not affect the result of the code. As you see, the optimizer also doesn't change the result of `Seq(...).toDF.repartition($"b").sortWithinPartitions("c")`, does it? The above two are different queries but you are trying to say that they are the same. My point is that they are not the same query.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
