[
https://issues.apache.org/jira/browse/KAFKA-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643087#comment-14643087
]
Neha Narkhede commented on KAFKA-2365:
--------------------------------------
Worth discussing a process for including a connector in Kafka core, but I think
we went through this in the KIP discussion and here is what I think. To keep
packaging, review and code management easier, it is better to just include a
couple lightweight connectors enough to show the usage of the copypcat APIs
(file in/file out). Any connector that requires depending on an external system
(HDFS, Elasticsearch) should really live elsewhere. We should also delete the
ones under contrib, they never ended up getting supported by the community.
Since there will always be connectors that need to live outside Kafka, I think
we should instead focus on how to make tooling easier for discovering and using
these federated connectors.
> Copycat checklist
> -----------------
>
> Key: KAFKA-2365
> URL: https://issues.apache.org/jira/browse/KAFKA-2365
> Project: Kafka
> Issue Type: New Feature
> Components: copycat
> Reporter: Ewen Cheslack-Postava
> Assignee: Ewen Cheslack-Postava
> Labels: feature
> Fix For: 0.8.3
>
>
> This covers the development plan for
> [KIP-26|https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=58851767].
> There are a number of features that can be developed in sequence to make
> incremental progress, and often in parallel:
> * Initial patch - connector API and core implementation
> * Runtime data API
> * Standalone CLI
> * REST API
> * Distributed copycat - CLI
> * Distributed copycat - coordinator
> * Distributed copycat - config storage
> * Distributed copycat - offset storage
> * Log/file connector (sample source/sink connector)
> * Elasticsearch sink connector (sample sink connector for full log -> Kafka
> -> Elasticsearch sample pipeline)
> * Copycat metrics
> * System tests (including connector tests)
> * Mirrormaker connector
> * Copycat documentation
> This is an initial list, but it might need refinement to allow for more
> incremental progress and may be missing features we find we want before the
> initial release.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
