[
https://issues.apache.org/jira/browse/FLUME-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13665522#comment-13665522
]
Hari Shreedharan commented on FLUME-1995:
-----------------------------------------
Israel,
Couple of questions:
1. What do you mean by "hardware failure"? If you mean disk failing, why not
improve the file channel to support mirroring?
2. If you mean machine failing and all disks failing - I don't really think we
need to prepare Flume for that. If you think about failures like that, we
should also work on protecting data in case of disasters. Flume is not exactly
designed for that and replicating a channel on multiple machines was never a
design principle. Having an HDFS or Cassandra cluster to backup a flume
pipeline seems like overkill.
Overall, I don't think adding a channel that writes to a remote cluster is a
good idea and is unlikely to be used. If I use a cluster to back Flume up, it
is the same as having a sink connected to the channel, no?
> CassandraChannel - A Distributed Channel Backed By Apache Cassandra as a
> Persistent Store for Events
> ----------------------------------------------------------------------------------------------------
>
> Key: FLUME-1995
> URL: https://issues.apache.org/jira/browse/FLUME-1995
> Project: Flume
> Issue Type: New Feature
> Components: Channel
> Affects Versions: v1.4.0
> Reporter: Israel Ekpo
> Assignee: Israel Ekpo
>
> Apache Cassandra Channel
> The events received by this channel are queued up in Cassandra to be picked
> up later when sinks send pickup requests to the channel.
> This type of channel is suitable for use cases where recoverability in the
> event of a hardware failure on the agent machine is important.
> The Cassandra cluster can be located on a remote machine.
> Cassandra also supports replication which could back up and replicate the
> events further to other nodes.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
