[ https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520421#comment-14520421 ]
Marcelo Vanzin commented on SPARK-7189: --------------------------------------- Correct, {{>=}} is still required. The trick here is to find an alternative way to detect whether logs that match the last timestamp really need to be parsed. > History server will always reload the same file even when no log file is > updated > -------------------------------------------------------------------------------- > > Key: SPARK-7189 > URL: https://issues.apache.org/jira/browse/SPARK-7189 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.3.0 > Reporter: Zhang, Liye > Priority: Minor > > History server will check every log file with it's modification time. It will > reload the file if the file's modification time is later or equal to the > latest modification time it remembered. So it will reload the same file(s) > periodically if the file(s) with the latest modification time even if there > is nothing change. This is not necessary. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org