Github user gengliangwang commented on a diff in the pull request: https://github.com/apache/spark/pull/22752#discussion_r225846631 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/config.scala --- @@ -64,4 +64,11 @@ private[spark] object config { .bytesConf(ByteUnit.BYTE) .createWithDefaultString("1m") + val IN_PROGRESS_ABSOLUTE_LENGTH_CHECK = + ConfigBuilder("spark.history.fs.inProgressAbsoluteLengthCheck.enabled") + .doc("Enable to check the absolute length of the in-progress" + --- End diff -- Could you explain a little bit in details? So that general user can know what the benefit is.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org