This is an automated email from the ASF dual-hosted git repository. gengliang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push: new b36b1c7 Revert "[SPARK-35083][FOLLOW-UP][CORE] Add migration guide for the re… b36b1c7 is described below commit b36b1c7e8a69f0aa02d7471fc7dadd32ed57ade1 Author: Gengliang Wang <gengli...@apache.org> AuthorDate: Thu Aug 19 21:30:00 2021 +0800 Revert "[SPARK-35083][FOLLOW-UP][CORE] Add migration guide for the re… …mote scheduler pool files support" This reverts commit e3902d1975ee6a6a6f672eb6b4f318bcdd237e3f. The feature is improvement instead of behavior change. Closes #33789 from gengliangwang/revertDoc. Authored-by: Gengliang Wang <gengli...@apache.org> Signed-off-by: Gengliang Wang <gengli...@apache.org> --- docs/core-migration-guide.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/docs/core-migration-guide.md b/docs/core-migration-guide.md index 02ed430..1dee502 100644 --- a/docs/core-migration-guide.md +++ b/docs/core-migration-guide.md @@ -24,8 +24,6 @@ license: | ## Upgrading from Core 3.1 to 3.2 -- Since Spark 3.2, the fair scheduler also supports reading a configuration file from a remote node. `spark.scheduler.allocation.file` can either be a local file path or HDFS file path. - - Since Spark 3.2, `spark.hadoopRDD.ignoreEmptySplits` is set to `true` by default which means Spark will not create empty partitions for empty input splits. To restore the behavior before Spark 3.2, you can set `spark.hadoopRDD.ignoreEmptySplits` to `false`. - Since Spark 3.2, `spark.eventLog.compression.codec` is set to `zstd` by default which means Spark will not fallback to use `spark.io.compression.codec` anymore. --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org