[
https://issues.apache.org/jira/browse/FLUME-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Junjun updated FLUME-1218:
-----------------------------
Description:
NaiveFileWALManager's recover method move the file in sentDir into
loggedDir(cause it was not being writting ,so isFramingValid ).
but the file in sentDir may had persist in collector or not according to the
ack in master. So we should not just move the file into loggedDir to
retransmit it ,we should recover it to
NaiveFileWALManager.sendQ,NaiveFileWALManager.table and WALAckManager.pending
, then let the WALAckManager handle them.
was:
NaiveFileWALManager's recover method move the file in sentDir into loggedDir.
but the file in sentDir may had persist in collector or not according to the
ack in master. So we should not just move the file into loggedDir to
retransmit it ,we should recover it to
NaiveFileWALManager.sendQ,NaiveFileWALManager.table and pending
WALAckManager.pending , then let the WALAckManager handle them.
> NaiveFileWALManager recover handles sentDir
> -----------------------------------------------
>
> Key: FLUME-1218
> URL: https://issues.apache.org/jira/browse/FLUME-1218
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4, v0.9.5
> Reporter: Li Junjun
>
> NaiveFileWALManager's recover method move the file in sentDir into
> loggedDir(cause it was not being writting ,so isFramingValid ).
> but the file in sentDir may had persist in collector or not according to the
> ack in master. So we should not just move the file into loggedDir to
> retransmit it ,we should recover it to
> NaiveFileWALManager.sendQ,NaiveFileWALManager.table and WALAckManager.pending
> , then let the WALAckManager handle them.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
