[
https://issues.apache.org/jira/browse/FLUME-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286258#comment-13286258
]
Juhani Connolly commented on FLUME-1238:
----------------------------------------
Was having a look through the code myself, but go ahead. It looks like you
could probably add in some logic to the WriterLinkedHashMap to keep tracking of
last access time to a bucketwriter local to one place in code. It would involve
some threading issues that would require some care, but it looks like a
tractable solution that doesn't add logic all over the place.
> Support active rolling of files created by HDFS Event Sink
> ----------------------------------------------------------
>
> Key: FLUME-1238
> URL: https://issues.apache.org/jira/browse/FLUME-1238
> Project: Flume
> Issue Type: Improvement
> Reporter: Arvind Prabhakar
> Assignee: Mike Percy
>
> The HDFS Event Sink uses lazy rolling for closing files that are being
> written to. This results in many files being open for longer than their
> expected roll-interval if they are not actively written to and can even last
> in open state until the sink shuts down.
> It will be preferable to have these files roll proactively rather than
> waiting for a write to trigger the roll.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira