[ 
https://issues.apache.org/jira/browse/FLUME-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949733#comment-14949733
 ] 

ASF subversion and git services commented on FLUME-2781:
--------------------------------------------------------

Commit 67ed62aa18df3675b68369d0d00c8f0dcbdfb970 in flume's branch 
refs/heads/trunk from [~hshreedharan]
[ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=67ed62a ]

FLUME-2781. Kafka Channel with parseAsFlumeEvent=true should write data as is, 
not as flume events.

(Gonzalo Herreros via Hari)


> A Kafka Channel defined as parseAsFlumeEvent=false cannot be correctly used 
> by a Flume source
> ---------------------------------------------------------------------------------------------
>
>                 Key: FLUME-2781
>                 URL: https://issues.apache.org/jira/browse/FLUME-2781
>             Project: Flume
>          Issue Type: Improvement
>    Affects Versions: v1.6.0
>            Reporter: Gonzalo Herreros
>            Assignee: Gonzalo Herreros
>              Labels: easyfix, patch
>         Attachments: FLUME-2781.patch
>
>
> When a Kafka channel is configured as parseAsFlumeEvent=false, the channel 
> will read events from the topic as text instead of serialized Avro Flume 
> events.
> This is useful so Flume can read from an existing Kafka topic, where other 
> Kafka clients publish as text.
> However, if you use a Flume source on that channel, it will still write the 
> events as Avro so it will create an inconsistency and those events will fail 
> to be read correctly.
> Also, this would allow a Flume source to write to a Kafka channel and any 
> Kafka subscriber to listen to Flume events passing through without binary 
> dependencies.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to