ulysses-you commented on PR #38356: URL: https://github.com/apache/spark/pull/38356#issuecomment-1296543549
The reason is `convertEmptyToNull` added a new project on the top of the original plan, then the output ordering of the plan does not match the required ordering of dynamic partition. https://github.com/apache/spark/blob/90d31541fb0313d762cc36067060e6445c04a9b6/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/V1Writes.scala#L72-L87 This issue should only affect partition column who is string type. We should use the original plan to get the output ordering directly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
