[
https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13849963#comment-13849963
]
Hari Shreedharan commented on FLUME-2181:
-----------------------------------------
If during replay we hit a bad event, the sequential reader cannot really
recover, because we don't know how to (unless we read byte by byte and try to
read and parse the protobuf out of it). But in the previously discussed file
format with sync marker we should be able to. So I am not sure whether we
should go the byte-by-byte reading and parsing route or ignoring the test of
the file route.
> Optionally disable File Channel fsyncs
> ---------------------------------------
>
> Key: FLUME-2181
> URL: https://issues.apache.org/jira/browse/FLUME-2181
> Project: Flume
> Issue Type: Improvement
> Reporter: Hari Shreedharan
> Assignee: Hari Shreedharan
> Attachments: FLUME-2181.patch
>
>
> This will give File Channel performance a big boost, at the cost of possible
> data loss if a crash happens between checkpoints.
> Also we should make it configurable, with default to false. If the user does
> not mind slight inconsistencies, this feature can be explicitly enabled
> through configuration. So if it is not configured, then the behavior will be
> exactly as it is now.
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
