[
https://issues.apache.org/jira/browse/FLUME-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16688180#comment-16688180
]
ASF GitHub Bot commented on FLUME-2799:
---------------------------------------
GitHub user jbruggem opened a pull request:
https://github.com/apache/flume/pull/238
FLUME-2799 Kafka Source - Add message offset to headers
It seems we solving https://issues.apache.org/jira/browse/FLUME-2799 , an
oversight resulted in the message offset not being added to the header. This
change corrects this.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/euranova/flume
kafka_source_add_message_offset_to_headers
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flume/pull/238.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #238
----
commit 8cf06db69a7bb62d6e9064eebe375861a1d324ce
Author: Jehan Bruggeman <jehan.bruggeman@...>
Date: 2018-11-15T15:03:38Z
FLUME-2799 Kafka Source - Add message offset to headers
----
> Kafka Source - Message Offset and Partition add to headers
> ----------------------------------------------------------
>
> Key: FLUME-2799
> URL: https://issues.apache.org/jira/browse/FLUME-2799
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: 1.6.0
> Reporter: Michael Andre Pearce
> Priority: Minor
> Labels: easyfix, patch
> Fix For: 1.7.0
>
> Attachments: FLUME-2799-0.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> Currently Kafka source only persists the original kafka message's topic into
> the Flume event headers.
> For downstream interceptors and sinks that may want to have available to them
> the partition and the offset , we need to add these.
> Also it is noted that the conversion from MessageAndMetaData to FlumeEvent is
> not configurable unlike other sources such as JMS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
