[
https://issues.apache.org/jira/browse/FLINK-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15420438#comment-15420438
]
ASF GitHub Bot commented on FLINK-4035:
---------------------------------------
GitHub user rmetzger opened a pull request:
https://github.com/apache/flink/pull/2369
[FLINK-4035] Add a streaming connector for Apache Kafka 0.10.x
This pull request subsumes https://github.com/apache/flink/pull/2231.
Compared to #2231, I've based the connector on the existing 0.9 code (by
extending it, reducing the amount of copied code), added a test case for the
timestamp functionality and updated the documentation.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rmetzger/flink flink4035_rebased
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2369.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2369
----
commit e3b2ede004b3c4ab6e37df1d6a268a52c1565316
Author: radekg <[email protected]>
Date: 2016-07-12T17:19:01Z
[FLINK-4035] Add support for Kafka 0.10.x.
commit 9d358a9ad5bcdd1ea644bc5b902240423586faf3
Author: Robert Metzger <[email protected]>
Date: 2016-08-09T14:38:21Z
[FLINK-4035] Refactor the Kafka 0.10 connector to be based upon the 0.9
connector
Add a test case for Kafka's new timestamp functionality and update the
documentation.
----
> Bump Kafka producer in Kafka sink to Kafka 0.10.0.0
> ---------------------------------------------------
>
> Key: FLINK-4035
> URL: https://issues.apache.org/jira/browse/FLINK-4035
> Project: Flink
> Issue Type: Bug
> Components: Kafka Connector
> Affects Versions: 1.0.3
> Reporter: Elias Levy
> Assignee: Robert Metzger
> Priority: Minor
>
> Kafka 0.10.0.0 introduced protocol changes related to the producer.
> Published messages now include timestamps and compressed messages now include
> relative offsets. As it is now, brokers must decompress publisher compressed
> messages, assign offset to them, and recompress them, which is wasteful and
> makes it less likely that compression will be used at all.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
