Patrick Wendell created FLUME-1400:
--------------------------------------

             Summary: Understand and document behavior of exec source when 
tailing rolling logs
                 Key: FLUME-1400
                 URL: https://issues.apache.org/jira/browse/FLUME-1400
             Project: Flume
          Issue Type: Improvement
            Reporter: Patrick Wendell
            Assignee: Patrick Wendell


There has been some discussion recently around the behavior of exec("tail -f") 
when tailing logs, if the log files are themselves being rolled and renamed by 
a writer process.

The primary concern is whether there is a race condition or correctness problem 
related to tailing a log which is renamed.

I am fairly certain that the tail binary, when passed -f, will deal with all of 
the ugliness of recognizing when a file is rolled and open the new "current" 
file as expected. However, we should both verify and document that behavior.

Flume OG, which implemented its own tailing functionality, dealt with this 
ugliness by introducing increasing break-fix complexity to the tail source. I 
am hoping that by delegating to the "tail" binary we have avoided having to do 
this (though at the cost of OS portability). Nonetheless, I should confirm this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to