hvanhovell commented on a change in pull request #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#discussion_r323613828
########## File path: docs/sql-migration-guide-upgrade.md ########## @@ -7,6 +7,12 @@ displayTitle: Spark SQL Upgrading Guide * Table of contents {:toc} +## Upgrading from Spark SQL 2.4 to 2.4.5 + + - Starting from 2.4.5, SQL configurations are effective also when a Dataset is converted to an RDD and its + plan is executed due to action on the derived RDD. The previous buggy behavior can be restored setting + `spark.sql.legacy.rdd.applyConf` to `false`. Review comment: I don't think we need to add the flag to master. We are allowed to break behavior there. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org