[
https://issues.apache.org/jira/browse/FLINK-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706761#comment-14706761
]
ASF GitHub Bot commented on FLINK-2386:
---------------------------------------
GitHub user rmetzger opened a pull request:
https://github.com/apache/flink/pull/1039
[FLINK-2386] Add new KafkaConsumer, based on Kafka's Simple Consumer API
This pull request is based on https://github.com/apache/flink/pull/1028.
I'm creating another pull request because I rebased everything to the
current master.
Since there were no -1 votes #1028, I assume that this PR is close to be
mergeable.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rmetzger/flink kafka_no_copy_rebased
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1039.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1039
----
commit cbdb7d6031486b42686d0006fe1726dd58c975c3
Author: Robert Metzger <[email protected]>
Date: 2015-07-20T19:39:46Z
[FLINK-2386] [kafka connector] Add new Kafka Consumer for Flink
This closes #996
commit cb0bc7c9a067881c2d0113684646f302014aca79
Author: Stephan Ewen <[email protected]>
Date: 2015-08-11T12:21:33Z
[streaming] Cleanup de-/serialization schema, add
TypeInformationSerializationSchema prominent, add tests.
commit a62688bd7717e3d4cc79f6378209c7e4e4c83924
Author: Stephan Ewen <[email protected]>
Date: 2015-08-11T14:48:26Z
[FLINK-2386] [kafka connector] Add comments to all backported kafka sources
and move them to 'org.apache.flink.kafka_backport'
commit 8a8003ba86f89faa15fd96fcfe6a19b54782d875
Author: Stephan Ewen <[email protected]>
Date: 2015-08-11T20:21:53Z
[FLINK-2386] [kafka connector] Refactor, cleanup, and fix kafka consumers
commit ac9114c76a7323c48110439e65e2f554d16c18c4
Author: Stephan Ewen <[email protected]>
Date: 2015-08-16T14:52:16Z
[tests] Reinforce StateCheckpoinedITCase to make sure actual checkpointing
has happened before a failure.
commit 1ec61b4041dc7fb0e014a74f1cac502ae3c4e5d9
Author: Robert Metzger <[email protected]>
Date: 2015-08-17T19:16:43Z
[FLINK-2386] Remove copied Kafka code again. Implemented our own topic
metadata retrieval.
----
> Implement Kafka connector using the new Kafka Consumer API
> ----------------------------------------------------------
>
> Key: FLINK-2386
> URL: https://issues.apache.org/jira/browse/FLINK-2386
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: Robert Metzger
> Assignee: Robert Metzger
>
> Once Kafka has released its new consumer API, we should provide a connector
> for that version.
> The release will probably be called 0.9 or 0.8.3.
> The connector will be mostly compatible with Kafka 0.8.2.x, except for
> committing offsets to the broker (the new connector expects a coordinator to
> be available on Kafka). To work around that, we can provide a configuration
> option to commit offsets to zookeeper (managed by flink code).
> For 0.9/0.8.3 it will be fully compatible.
> It will not be compatible with 0.8.1 because of mismatching Kafka messages.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
