[
https://issues.apache.org/jira/browse/FLUME-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209874#comment-15209874
]
Ambud Sharma commented on FLUME-2874:
-------------------------------------
Can you leverage the Morphline interceptor
http://flume.apache.org/FlumeUserGuide.html#morphline-interceptor.
If not then we recently worked on a simple copy header interceptor that I will
need to see if we could open source.
> A new interceptor called Key Interceptor should be created to insert a header
> with key "key" which will be used in Kakfa Sink
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: FLUME-2874
> URL: https://issues.apache.org/jira/browse/FLUME-2874
> Project: Flume
> Issue Type: New Feature
> Affects Versions: v1.6.0
> Reporter: Li Ye
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Kafka Sink uses the topic and key properties from the FlumeEvent headers to
> send events to Kafka. If topic exists in the headers, the event will be sent
> to that specific topic, overriding the topic configured for the Sink. If key
> exists in the headers, the key will used by Kafka to partition the data
> between the topic partitions. Events with same key will be sent to the same
> partition. If the key is null, events will be sent to random partitions.
> If there is a new interceptor called Key Interceptor to insert a header with
> key "key", much convienience will be brought to Kafka Sink users.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
