Will Funnell created KAFKA-1977:
-----------------------------------
Summary: Make logEndOffset available in the Zookeeper consumer
Key: KAFKA-1977
URL: https://issues.apache.org/jira/browse/KAFKA-1977
Project: Kafka
Issue Type: Improvement
Components: core
Reporter: Will Funnell
Priority: Minor
The requirement is to create a snapshot from the Kafka topic but NOT do
continual reads after that point. For example you might be creating a backup of
the data to a file.
In order to achieve that, a recommended solution by Joel Koshy and Jay Kreps
was to expose the high watermark, as maxEndOffset, from the FetchResponse
object through to each MessageAndMetadata object in order to be aware when the
consumer has reached the end of each partition.
The submitted patch achieves this by adding the maxEndOffset to the
PartitionTopicInfo, which is updated when a new message arrives in the
ConsumerFetcherThread and then exposed in MessageAndMetadata.
See here for discussion:
http://search-hadoop.com/m/4TaT4TpJy71
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
