Repository: flume Updated Branches: refs/heads/flume-1.6 935f9ba7d -> dbf4828b8
FLUME-2665. Update documentation for hdfs.closeTries based on FLUME-2586 (Johny Rufus via Hari) Project: http://git-wip-us.apache.org/repos/asf/flume/repo Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/dbf4828b Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/dbf4828b Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/dbf4828b Branch: refs/heads/flume-1.6 Commit: dbf4828b89a36fda9434163f1835382e2f0c56ba Parents: 935f9ba Author: Hari Shreedharan <[email protected]> Authored: Tue Apr 14 16:21:26 2015 -0700 Committer: Hari Shreedharan <[email protected]> Committed: Tue Apr 14 16:21:26 2015 -0700 ---------------------------------------------------------------------- flume-ng-doc/sphinx/FlumeUserGuide.rst | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flume/blob/dbf4828b/flume-ng-doc/sphinx/FlumeUserGuide.rst ---------------------------------------------------------------------- diff --git a/flume-ng-doc/sphinx/FlumeUserGuide.rst b/flume-ng-doc/sphinx/FlumeUserGuide.rst index 43ca5db..8d91cec 100644 --- a/flume-ng-doc/sphinx/FlumeUserGuide.rst +++ b/flume-ng-doc/sphinx/FlumeUserGuide.rst @@ -1728,10 +1728,10 @@ hdfs.roundValue 1 Rounded down to the highest multiple of th hdfs.roundUnit second The unit of the round down value - ``second``, ``minute`` or ``hour``. hdfs.timeZone Local Time Name of the timezone that should be used for resolving the directory path, e.g. America/Los_Angeles. hdfs.useLocalTimeStamp false Use the local time (instead of the timestamp from the event header) while replacing the escape sequences. -hdfs.closeTries 0 Number of times the sink must try to close a file. If set to 1, this sink will not re-try a failed close +hdfs.closeTries 0 Number of times the sink must try renaming a file, after initiating a close attempt. If set to 1, this sink will not re-try a failed rename (due to, for example, NameNode or DataNode failure), and may leave the file in an open state with a .tmp extension. - If set to 0, the sink will try to close the file until the file is eventually closed - (there is no limit on the number of times it would try). + If set to 0, the sink will try to rename the file until the file is eventually renamed (there is no limit on the number of times it would try). + The file may still remain open if the close call fails but the data will be intact and in this case, the file will be closed only after a Flume restart. hdfs.retryInterval 180 Time in seconds between consecutive attempts to close a file. Each close call costs multiple RPC round-trips to the Namenode, so setting this too low can cause a lot of load on the name node. If set to 0 or less, the sink will not attempt to close the file if the first attempt fails, and may leave the file open or with a ".tmp" extension.
