[ 
https://issues.apache.org/jira/browse/FLUME-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286253#comment-13286253
 ] 

Mike Percy commented on FLUME-1238:
-----------------------------------

Seems like having a separate thread that watches the open files should do the 
trick. It can also keep track of rollInterval.

I'll take a stab at this one.
                
> Support active rolling of files created by HDFS Event Sink
> ----------------------------------------------------------
>
>                 Key: FLUME-1238
>                 URL: https://issues.apache.org/jira/browse/FLUME-1238
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Arvind Prabhakar
>
> The HDFS Event Sink uses lazy rolling for closing files that are being 
> written to. This results in many files being open for longer than their 
> expected roll-interval if they are not actively written to and can even last 
> in open state until the sink shuts down.
> It will be preferable to have these files roll proactively rather than 
> waiting for a write to trigger the roll. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to