Randall Hauch created KAFKA-5741:
------------------------------------

             Summary: Prioritize threads in Connect distributed worker process
                 Key: KAFKA-5741
                 URL: https://issues.apache.org/jira/browse/KAFKA-5741
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
    Affects Versions: 0.11.0.0
            Reporter: Randall Hauch
            Priority: Blocker


Connect's distributed worker process uses the {{DistributedHerder}} to perform 
all administrative operations, including: starting, stopping, pausing, 
resuming, reconfiguring connectors; rebalancing; etc. The {{DistributedHerder}} 
uses a single threaded executor service to do all this work and to do it 
sequentially. If this thread gets preempted for any reason (e.g., connector 
tasks are bogging down the process, DoS, etc.), then the herder's membership in 
the group may be dropped, causing a rebalance.

This herder thread should be run at a much higher priority than all of the 
other threads in the system.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to