Re: Kafka Connect Connector Tasks Uneven Division

2020-06-09 Thread Deepak Raghav
Hi Robin Can you please reply. I just want to add one more thing, that yesterday I tried with connect.protocal=eager. Task distribution was balanced after that. Regards and Thanks Deepak Raghav On Tue, Jun 9, 2020 at 2:37 PM Deepak Raghav wrote: > Hi Robin > > Thanks for your reply and acc

回复: Unused options in ConsumerPerformance

2020-06-09 Thread Jiamei Xie
Hi Ricardo, I was a little confused about the function of Jira tickets and mailing list. Thanks for your clarify. I have created one, https://issues.apache.org/jira/browse/KAFKA-10126 发件人: Ricardo Ferreira 发送时间: 2020年6月9日 19:58 收件人: users@kafka.apache.org; Jiamei Xie 主题: Re: Unused options i

Protocol evolution/versioning docs are missing

2020-06-09 Thread Haruki Okada
Hi, Kafka. While reading through protocol docs, I found that doc about protocol evolution and versioning are missing in protocol.html, while toc contains a section for it. https://github.com/apache/kafka/blob/trunk/docs/protocol.html#L47-L50 Is there any plan to add a doc about protocol evolutio

Re: Unused options in ConsumerPerformance

2020-06-09 Thread Ricardo Ferreira
Hi Jiamei, Changes in Apache Kafka need to be handled via JIRA tickets . The best way to get started with this is joining the developer mailing list . Thanks, -- Ricardo On 6/9/20 4:00 AM, Jiamei Xie wrote: Hi It seems that Option num

Re: Kafka Connect Connector Tasks Uneven Division

2020-06-09 Thread Deepak Raghav
Hi Robin Thanks for your reply and accept my apology for the delayed response. As you suggested that we should have a separate worker cluster based on workload pattern. But as you said, task allocation is nondeterministic, so same things can happen in the new cluster. Please let me know if my un

Unused options in ConsumerPerformance

2020-06-09 Thread Jiamei Xie
Hi It seems that Option numThreadsOpt and numFetchersOpt are unused in ConsumerPerformance. Could it be removed? I have done benchmarks to get consumer performance vs threads and there were no big differences with different thread number. I read source code core/src/main/scala/kafka/tools/Con