[
https://issues.apache.org/jira/browse/KAFKA-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437761#comment-15437761
]
ASF GitHub Bot commented on KAFKA-3008:
---------------------------------------
GitHub user kkonstantine opened a pull request:
https://github.com/apache/kafka/pull/1788
KAFKA-3008: Parallel start and stop of connectors and tasks in Connect
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kkonstantine/kafka
KAFKA-3008-Parallel-start-and-stop-of-connectors-and-tasks
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/1788.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1788
----
commit d1f876d4be7394688f6070169cded7748f8492cf
Author: Konstantine Karantasis <[email protected]>
Date: 2016-08-25T05:38:45Z
KAFKA-3008: Parallel start and stop of connectors and tasks in Connect
Refactoring Worker to make start and stop methods thread safe.
commit 938b8ad2cba770dad71d3749b26ae59a3c4c3425
Author: Konstantine Karantasis <[email protected]>
Date: 2016-08-25T21:31:57Z
Parallelizing start and stop of connectors and tasks in Distributed Herder
----
> Connect should parallelize task start/stop
> ------------------------------------------
>
> Key: KAFKA-3008
> URL: https://issues.apache.org/jira/browse/KAFKA-3008
> Project: Kafka
> Issue Type: Improvement
> Components: KafkaConnect
> Affects Versions: 0.9.0.0
> Reporter: Ewen Cheslack-Postava
> Assignee: Liquan Pei
> Priority: Minor
>
> The Herder implementations currently iterate over all connectors/tasks and
> sequentially start/stop them. We should parallelize this. This is less
> critical for {{StandaloneHerder}}, but pretty important for
> {{DistributedHerder}} since it will generally be managing more tasks and any
> delay starting/stopping a single task will impact every other task on the
> node (and can ultimately result in incorrect behavior in the case of a single
> offset commit in one connector taking too long preventing all of the rest
> from committing offsets).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
