[
https://issues.apache.org/jira/browse/FLUME-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Junjun updated FLUME-1218:
-----------------------------
Description:
NaiveFileWALManager's recover method move the file in sentDir into
loggedDir(cause it was not being writting ,so isFramingValid ).
but the file in sentDir may had been persisted in collector or not according to
the ack in master. So we should not just move the file into loggedDir to
retransmit it ,we should recover it to
NaiveFileWALManager.sendQ,NaiveFileWALManager.table and WALAckManager.pending
, then let the WALAckManager handle them.
was:
NaiveFileWALManager's recover method move the file in sentDir into
loggedDir(cause it was not being writting ,so isFramingValid ).
but the file in sentDir may had persist in collector or not according to the
ack in master. So we should not just move the file into loggedDir to
retransmit it ,we should recover it to
NaiveFileWALManager.sendQ,NaiveFileWALManager.table and WALAckManager.pending
, then let the WALAckManager handle them.
> NaiveFileWALManager's recover method handles sentDir may be improper
> -----------------------------------------------------------------------
>
> Key: FLUME-1218
> URL: https://issues.apache.org/jira/browse/FLUME-1218
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4, v0.9.5
> Reporter: Li Junjun
>
> NaiveFileWALManager's recover method move the file in sentDir into
> loggedDir(cause it was not being writting ,so isFramingValid ).
> but the file in sentDir may had been persisted in collector or not according
> to the ack in master. So we should not just move the file into loggedDir to
> retransmit it ,we should recover it to
> NaiveFileWALManager.sendQ,NaiveFileWALManager.table and WALAckManager.pending
> , then let the WALAckManager handle them.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
