Mike Percy created FLUME-1301:
---------------------------------
Summary: HDFSCompressedDataStream can lose data
Key: FLUME-1301
URL: https://issues.apache.org/jira/browse/FLUME-1301
Project: Flume
Issue Type: Bug
Components: Sinks+Sources
Affects Versions: v1.1.0
Reporter: Mike Percy
Priority: Blocker
Fix For: v1.2.0
HDFSCompressedDataStream currently uses flush() to flush the compressed
streams. Unfortunately, in at least Snappy and GZip, those operations are
no-ops. So we have to go back to using finish() in order to ensure the
durability of writes at Transaction boundaries.
In addition to finish(), resetState() must be called.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
