[ https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516852#comment-14516852 ]
Sean Owen commented on SPARK-7189: ---------------------------------- Hm, I'd swear we had discussed this already and there was a good reason for it from [~vanzin], but I can't find the PR or JIRA now. I remember a PR changing the >= to > and the result was that it was on purpose. Not sure if this was a helpful comment but I do remember something like this. > History server will always reload the same file even when no log file is > updated > -------------------------------------------------------------------------------- > > Key: SPARK-7189 > URL: https://issues.apache.org/jira/browse/SPARK-7189 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.3.0 > Reporter: Zhang, Liye > Priority: Minor > > History server will check every log file with it's modification time. It will > reload the file if the file's modification time is later or equal to the > latest modification time it remembered. So it will reload the same file(s) > periodically if the file(s) with the latest modification time even if there > is nothing change. This is not necessary. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org