[
https://issues.apache.org/jira/browse/FLUME-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399137#comment-13399137
]
Mike Percy commented on FLUME-1301:
-----------------------------------
Thanks for taking a look, Tom!
> HDFSCompressedDataStream can lose data
> --------------------------------------
>
> Key: FLUME-1301
> URL: https://issues.apache.org/jira/browse/FLUME-1301
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.1.0
> Reporter: Mike Percy
> Assignee: Mike Percy
> Priority: Blocker
> Fix For: v1.2.0
>
> Attachments: FLUME-1301-2.patch
>
>
> HDFSCompressedDataStream currently uses flush() to flush the compressed
> streams. Unfortunately, in at least Snappy and GZip, those operations are
> no-ops. So we have to go back to using finish() in order to ensure the
> durability of writes at Transaction boundaries.
> In addition to finish(), resetState() must be called.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
