Re: Apache Kafka blog on more partitions support
Thanks Jun for sharing the post. Minor Nit: Date says December 16, 2019. Did this test measured the replication affects on the overall cluster health and performance? It looks like we are suggesting with 200k partitions and 4k per broker max size of a cluster should be around 50 brokers? Thanks, Harsha On Nov 2, 2018, 11:50 AM -0700, Jun Rao , wrote: > Hi, Everyone, > > The follow is the preview of a blog on Kafka supporting more partitions. > > https://drive.google.com/file/d/122TK0oCoforc2cBWfW_yaEBjTMoX6yMt > > Please let me know if you have any comments by Tuesday. > > Thanks, > > Jun
Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection
Having Round-robin partitioner as default makes sense. +1 (binding). Thanks, Harsha On Oct 19, 2018, 9:54 AM -0700, Matthias J. Sax , wrote: > People a currently quite busy with 2.1.0 and 2.0.1 releases. That's why > the vote might go slow. > > Just keep bumping the vote thread on a weekly bases... Thanks for your > patients. > > > -Matthias > > On 10/19/18 1:08 AM, M. Manna wrote: > > Since this has gone quiet, could I prequest 1 more vote here - if anyone > > thinks it's worth doing? > > > > Thanks, > > > > > > > > On Wed, 3 Oct 2018 at 16:14, M. Manna wrote: > > > > > Thanks for reminding me about the "Binding" vote Bill. I remember some > > > people with non-binding vote, so jumped the gun a bit too early. > > > We will wait for 2 more as you stated. > > > > > > Regards, > > > > > > On Wed, 3 Oct 2018 at 16:07, Bill Bejeck wrote: > > > > > > > +1 from me. > > > > > > > > As for closing the vote, it needs to be open for a minimum of 72 and > > > > requires three binding +1 votes. Additionally, there needs more +1 > > > > binding > > > > votes than -1 votes. The description for the lazy majority vote process > > > > is > > > > described here > > > > https://cwiki.apache.org/confluence/display/KAFKA/Bylaws#Bylaws-Approvals > > > > . > > > > > > > > I haven't been tracking the vote results, but from what I can see in the > > > > voting thread, this KIP still requires two more +1 binding votes. > > > > > > > > HTH, > > > > BIll > > > > > > > > On Wed, Oct 3, 2018 at 8:58 AM M. Manna wrote: > > > > > > > > > Since this has been open for a while, I am assuming that it's good to > > > > go? > > > > > > > > > > if so, I will update the KIP page - and start coding this. I would > > > > prefer > > > > > re-using existing tests written for DefaultPartitioner, so that we > > > > > don't > > > > > need to write new tests. > > > > > > > > > > Regards, > > > > > > > > > > On Sun, 30 Sep 2018 at 19:34, Matthias J. Sax > > > > > wrote: > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > @Abhimanyu: can you please update the table in > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > > > > > > and add a link to the KIP. Thanks. > > > > > > > > > > > > -Matthias > > > > > > > > > > > > On 9/4/18 9:56 PM, Abhimanyu Nagrath wrote: > > > > > > > +1 > > > > > > > > > > > > > > On Wed, Sep 5, 2018 at 2:39 AM Magesh Nandakumar < > > > > mage...@confluent.io > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > +1 ( non-binding) > > > > > > > > > > > > > > > > On Tue, Sep 4, 2018 at 3:39 AM M. Manna > > > > wrote: > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > > > > > > > > > > I have made necessary changes as per the original discussion > > > > thread, > > > > > > and > > > > > > > > > would like to put it for votes. > > > > > > > > > > > > > > > > > > Thank you very much for your suggestion and guidance so far. > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
[GitHub] kafka pull request #1510: Minor: warn if the TGT cannot be renewed.
GitHub user harshach opened a pull request: https://github.com/apache/kafka/pull/1510 Minor: warn if the TGT cannot be renewed. You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/kafka KerberosLogin-Log Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1510.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1510 commit 1f2f8f40e5f3c9d86708943233cd66f5cb30a3dd Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2016-06-15T16:03:41Z Minor: warn if the TGT cannot be renewed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: Specifiy keyalg RSA for SSL key generation.
GitHub user harshach opened a pull request: https://github.com/apache/kafka/pull/1416 Specifiy keyalg RSA for SSL key generation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/kafka ssl-doc-fix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1416.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1416 commit 2131452fac8f7a7a037d1e09d4258995f5335d9b Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2016-05-20T16:46:04Z Specifiy keyalg RSA for SSL key generation. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: Missing License.
GitHub user harshach opened a pull request: https://github.com/apache/kafka/pull/524 Missing License. You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/kafka missing-license Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/524.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #524 commit 03f6bfd3888c2a3b16c2ab09e5a17d12c922c475 Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2015-11-13T17:55:38Z Missing License. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-1686: Implement SASL/Kerberos.
Github user harshach closed the pull request at: https://github.com/apache/kafka/pull/191 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: Kafka 1686. Implement SASL/Kerberos.
Github user harshach closed the pull request at: https://github.com/apache/kafka/pull/190 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-1686: Implement SASL/Kerberos.
GitHub user harshach opened a pull request: https://github.com/apache/kafka/pull/191 KAFKA-1686: Implement SASL/Kerberos. You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/kafka KAFKA-1686-V1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/191.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #191 commit 82737e5bb71f67271d90c059dede74935f8a5e56 Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2015-08-31T23:07:15Z KAFKA-1686. Implement SASL/Kerberos. commit a3417d7f2c558c0082799b117a3c62c706ad519d Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2015-09-03T03:31:34Z KAFKA-1686. Implement SASL/Kerberos. commit 8f718ce6b03a9c86712dc8f960af2b739b8ed510 Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2015-09-03T04:10:40Z KAFKA-1686. Implement SASL/Kerberos. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: Kafka 1686. Implement SASL/Kerberos.
GitHub user harshach opened a pull request: https://github.com/apache/kafka/pull/190 Kafka 1686. Implement SASL/Kerberos. You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/kafka KAFKA-1686 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/190.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #190 commit 85a36d1c669e9c397083927caa22f8722989ccfe Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2015-08-31T23:07:15Z KAFKA-1686. Implement SASL/Kerberos. commit 5258682b0ca0cb765fd8bab33f57001ce5e72bec Author: Sriharsha Chintalapani <har...@hortonworks.com> Date: 2015-09-03T03:31:34Z KAFKA-1686. Implement SASL/Kerberos. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-1566: Kafka environment configuration (k...
GitHub user harshach opened a pull request: https://github.com/apache/kafka/pull/156 KAFKA-1566: Kafka environment configuration (kafka-env.sh) You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/kafka KAFKA-1566 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/156.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #156 commit 42b0acdb392494984b6928d94f0c611d4e1925de Author: Sriharsha Chintalapani har...@hortonworks.com Date: 2015-01-08T15:50:20Z KAFKA-1566. Kafka environment configuration (kafka-env.sh). commit 31d0dcab655b37864c207a08d5c77b9d27fff7bc Author: Sriharsha Chintalapani har...@hortonworks.com Date: 2015-03-18T00:14:41Z KAFKA-1566. Kafka environment configuration (kafka-env.sh). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] kafka pull request: KAFKA-2438: add maxParallelForks to build.grad...
GitHub user harshach opened a pull request: https://github.com/apache/kafka/pull/143 KAFKA-2438: add maxParallelForks to build.gradle to speedup tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/kafka KAFKA-2438 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/143.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #143 commit 69b0edecc9becebc08c2a8a21777e8707fb3a564 Author: Sriharsha Chintalapani har...@hortonworks.com Date: 2015-08-17T03:29:46Z KAFKA-2438: add maxParallelForks to build.gradle to speedup tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
