Re: [DISCUSS] bug fix to allow dynamically change some log configs

2024-09-24 Thread Colin McCabe
Thanks for posting this here, Luke. Thinking about this more, I'll just go back to the old behavior where the synonyms are ignored if you set them as dynamic configurations. I will fix the problem where static synonyms are ignored sometimes, though, since that seems more "surprising" and bad. M

Re: [VOTE] 3.9.0 RC0

2024-09-18 Thread Colin McCabe
gt; missing all the configuration options for brokers, producers, consumers etc. > > Not sure if that is normal for RCs or if this is some bug in the docs > generator. > > Thanks & Regards > Jakub > > On Wed, Sep 18, 2024 at 5:07 AM Colin McCabe wrote: > >

Re: [kafka-clients] Re: [VOTE] 3.9.0 RC0

2024-09-18 Thread Colin McCabe
gt; >> > Thanks for the RC. >> > >> > It looks like the Maven artifacts are missing for 3.9.0 in the staging >> > repo. Are we still waiting for some staging job to complete? Or is that >> > some CDN issue and I'm the only one not seeing them? O

[VOTE] 3.9.0 RC0

2024-09-17 Thread Colin McCabe
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.9.0.

Re: [DISCUSS] `unclean.leader.election.enable` in KRaft behavior change

2024-08-29 Thread Colin McCabe
Thanks, Luke. Both the static and dynamic options for configuring unclean leader election now work in 3.9, thanks to your help. Dima, if you have only a transient need to do an unclean leader election, using the kafka-leader-election.sh script is still the best way. It avoids the risk for forge

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.8.0

2024-07-29 Thread Colin McCabe
+1. Thanks, Josep! Colin On Mon, Jul 29, 2024, at 10:32, Chris Egerton wrote: > Thanks for running the release, Josep! > > > On Mon, Jul 29, 2024, 13:31 'Josep Prat' via kafka-clients > wrote: >> The Apache Kafka community is pleased to announce the release for Apache >> Kafka 3.8.0 >> >> T

Re: Supported Kafka/Zookeeper Version with ELK 8.4.3

2022-12-05 Thread Colin McCabe
Hi, Sorry, we do not develop ELK. In fact, I'm not sure what that acronym refers to. I would suggest checking in with support for that product / project, since it is not part of Apache Kafka. best, Colin On Fri, Oct 28, 2022, at 06:23, Kumar, Sudip wrote: > Hi Team, > > We are still waiting

Re: [ANNOUNCE] Apache Kafka 3.2.1

2022-08-02 Thread Colin McCabe
Thanks, David, for running this release. C. On Tue, Aug 2, 2022, at 12:09, Matthew Benedict de Detrich wrote: > Thanks for organising the release! > > -- > Matthew de Detrich > Aiven Deutschland GmbH > Immanuelkirchstraße 26, 10405 Berlin > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsfüh

Re: [EXTERNAL] Re: Security vulnerabilities in kafka:2.13-2.6.0/2.7.0 docker image

2021-11-01 Thread Colin McCabe
It seems like your image does not show up on the mailing list. best, Colin On Wed, Sep 1, 2021, at 06:26, Ashish Patil wrote: > Hi Team > > I tried upgrading it to 2.13_2.8.0 but still have these vulnerabilities. > > > > What is your suggestion on this? > > Thanks > Ashish > > *From:*

Re: [ANNOUNCE] New Kafka PMC Member: Randall Hauch

2021-04-22 Thread Colin McCabe
Congratulations, Randall! best, Colin On Wed, Apr 21, 2021, at 09:51, Mickael Maison wrote: > Congratulations Randall, well deserved! > > On Mon, Apr 19, 2021 at 10:55 PM Konstantine Karantasis > wrote: > > > > Congratulations Randall! > > > > Konstantine > > > > On Mon, Apr 19, 2021 at 1:14 A

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 2.8.0

2021-04-22 Thread Colin McCabe
Hi Ran, As part of the KRaft work outlined in KIP-500, we are planning on creating an authorizer that does not rely on ZooKeeper. This work is not included in the 2.8 release, however. regards, Colin On Mon, Apr 19, 2021, at 13:02, Ran Lupovich wrote: > Hello, Maybe I missed it in the docume

Re: [ANNOUNCE] New committer: Boyang Chen

2020-06-22 Thread Colin McCabe
Congratulations, Boyang! cheers, Colin On Mon, Jun 22, 2020, at 16:26, Guozhang Wang wrote: > The PMC for Apache Kafka has invited Boyang Chen as a committer and we are > pleased to announce that he has accepted! > > Boyang has been active in the Kafka community more than two years ago. > Since

Re: [kafka-clients] [VOTE] 2.5.0 RC3

2020-04-13 Thread Colin McCabe
+1 (binding) verified checksums ran unitTest ran check best, Colin On Tue, Apr 7, 2020, at 21:03, David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the forth candidate for release of Apache Kafka 2.5.0. > > * TLS 1.3 support (1.2 is now the default) > * Co-

Re: Kafka trunk vs master branch

2019-12-30 Thread Colin McCabe
+1. Colin On Fri, Dec 27, 2019 at 12:29 PM Guozhang Wang wrote: > Hmm, I think that's pushed by someone by mistake, we can delete it. > > > Guozhang > > > On Thu, Dec 26, 2019 at 12:18 PM Matthias J. Sax > wrote: > >> Should we delete `master` ? (Was not even aware it exists...) >> >> >> -Matt

Re: [ANNOUNCE] New committer: Mickael Maison

2019-11-07 Thread Colin McCabe
Congratulations, Mickael! cheers, Colin On Thu, Nov 7, 2019, at 13:53, Bill Bejeck wrote: > Congratulations Mickael! Well deserved! > > -Bill > > On Thu, Nov 7, 2019 at 4:38 PM Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > >

Re: [VOTE] 2.3.1 RC2

2019-10-23 Thread Colin McCabe
+ d...@kafka.apache.org On Tue, Oct 22, 2019, at 15:48, Colin McCabe wrote: > +1. I ran the broker, producer, consumer, etc. > > best, > Colin > > On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > > +1. I've ran the quick start and unit tests. > > >

Re: [VOTE] 2.3.1 RC2

2019-10-22 Thread Colin McCabe
+1. I ran the broker, producer, consumer, etc. best, Colin On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > +1. I've ran the quick start and unit tests. > > > Guozhang > > On Tue, Oct 22, 2019 at 12:57 PM David Arthur wrote: > > > Thanks, Jonathon and Jason. I've updated the release n

Re: PR review

2019-07-08 Thread Colin McCabe
Hi M. Manna, I left a review. Take a look. Sorry for the delays. best, Colin On Mon, Jul 8, 2019, at 14:38, M. Manna wrote: > Hello, > > A few requests have been sent already. Could this please be reviewed ? Our > business implementation is holding due to this change. > > > > On Thu, 4 Ju

Re: [ANNOUNCE] Apache Kafka 2.3.0

2019-06-25 Thread Colin McCabe
video about 2.3 here: https://www.youtube.com/watch?v=YutjYKSGd64 cheers, Colin On Tue, Jun 25, 2019, at 09:40, Colin McCabe wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 2.3.0. > This release includes several new features, including: >

[ANNOUNCE] Apache Kafka 2.3.0

2019-06-25 Thread Colin McCabe
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.3.0. This release includes several new features, including: - There have been several improvements to the Kafka Connect REST API. - Kafka Connect now supports incremental cooperative rebalancing. - Kafka Streams now

[RESULT] [VOTE] 2.3.0 RC3

2019-06-24 Thread Colin McCabe
anyway and ran quickstart on the 2.11 binary. > > > > Looks good! > > > > On Sun, Jun 23, 2019 at 3:06 PM Jakub Scholz wrote: > > > > > > +1 (non-binding). I used the binaries and run some of my tests against > > > them. > > > > > > On Thu

[VOTE] 2.3.0 RC3

2019-06-19 Thread Colin McCabe
Hi all, We discovered some problems with the second release candidate (RC2) of 2.3.0. Specifically, KAFKA-8564. I've created a new RC which includes the fix for this issue. Check out the release notes for the 2.3.0 release here: https://home.apache.org/~cmccabe/kafka-2.3.0-rc3/RELEASE_NOTES.h

Re: [kafka-clients] [VOTE] 2.3.0 RC1

2019-06-04 Thread Colin McCabe
On Tue, Jun 4, 2019, at 23:17, Colin McCabe wrote: > Hi all, > > This is the first candidate for the release of Apache Kafka 2.3.0. > > This release includes many new features, including: > * Support for incremental cooperative rebalancing > * An in-memory session store

[VOTE] 2.3.0 RC1

2019-06-04 Thread Colin McCabe
Hi all, This is the first candidate for the release of Apache Kafka 2.3.0. This release includes many new features, including: * Support for incremental cooperative rebalancing * An in-memory session store and window store for Kafka Streams * An API for allowing users to determine what operations

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-19 Thread Colin McCabe
Congratulations, Matthias! best, Colin On Fri, Apr 19, 2019, at 14:55, James Cheng wrote: > Congrats!! > > -James > > Sent from my iPhone > > > On Apr 18, 2019, at 2:35 PM, Guozhang Wang wrote: > > > > Hello Everyone, > > > > I'm glad to announce that Matthias J. Sax is now a member of Kafk

[ANNOUNCE] Apache Kafka 2.1.1

2019-02-19 Thread Colin McCabe
Dagostino, slim, Stig Rohde Døssing, Vahid Hashemian, and Xi Yang. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kafka.apache.org/ Thank you! Regards, Colin McCabe

Re: [kafka-clients] [VOTE] 2.1.1 RC2

2019-02-15 Thread Colin McCabe
P.S. I have added KAFKA-7897 to the release notes. Good catch, Jason. best, Colin On Fri, Feb 15, 2019, at 00:49, Colin McCabe wrote: > Hi all, > > With 7 non-binding +1 votes, 3 binding +1 votes, no +0 votes, and no -1 > votes, the vote passes. > > Thanks, all! &g

Re: [kafka-clients] [VOTE] 2.1.1 RC2

2019-02-15 Thread Colin McCabe
me. >> >> Thanks Colin! >> >> On Thu, Feb 14, 2019 at 3:32 PM Jun Rao wrote: >> >> > Hi, Colin, >> > >> > Thanks for running the release. Verified the quickstart for 2.12 binary. +1 >> > from me. >> > >> > Jun

Re: [VOTE] 2.1.1 RC2

2019-02-11 Thread Colin McCabe
gt; > > > > +1 (non-binding). I built it from source and run my tests. Everything > > > > seems > > > > to be fine. > > > > > > > > On Sat, Feb 9, 2019 at 12:10 AM Magnus Edenhill > > > > wrote: > > > > > > > >

[VOTE] 2.1.1 RC2

2019-02-08 Thread Colin McCabe
Hi all, This is the third candidate for release of Apache Kafka 2.1.1. This release includes many bug fixes for Apache Kafka 2.1. Compared to rc1, this release includes the following changes: * MINOR: release.py: fix some compatibility problems. * KAFKA-7897; Disable leader epoch cache when old

Re: [VOTE] 2.1.1 RC1

2019-01-30 Thread Colin McCabe
artitions FAILED > kafka.server.ReplicaManagerQuotasTest > > shouldIncludeInSyncThrottledReplicas FAILED > > Thanks > Eno > > On Sun, Jan 27, 2019 at 9:46 PM Colin McCabe wrote: > > > Hi all, > > > > This is the second candidate for release of Apache Kafka 2.1.1. This >

Re: [VOTE] 2.1.1 RC1

2019-01-30 Thread Colin McCabe
artitions FAILED > kafka.server.ReplicaManagerQuotasTest > > shouldIncludeInSyncThrottledReplicas FAILED > > Thanks > Eno > > On Sun, Jan 27, 2019 at 9:46 PM Colin McCabe wrote: > > > Hi all, > > > > This is the second candidate for release of Apache Kafka 2.1.1. This > > release

[VOTE] 2.1.1 RC1

2019-01-27 Thread Colin McCabe
Hi all, This is the second candidate for release of Apache Kafka 2.1.1. This release includes many bug fixes for Apache Kafka 2.1. Compared to rc0, this release includes the following changes: * MINOR: Upgrade ducktape to 0.7.5 (#6197) * KAFKA-7837: Ensure offline partitions are picked up as so

[VOTE] 2.1.1 RC0

2019-01-25 Thread Colin McCabe
Hi all, This is the first candidate for release of Apache Kafka 2.1.1. This release includes many bug fixes for Apache Kafka 2.1. Check out the release notes here: http://home.apache.org/~cmccabe/kafka-2.1.1-rc0/RELEASE_NOTES.html The vote will go until Wednesday, January 30th. * Release arti

Re: ConsumerGroupCommand tool improvement?

2018-08-06 Thread Colin McCabe
n why I am pushing back on this is that regular expressions add a lot of complexity to the API and make it harder for us to meet our backwards compatibility guarantees. For example, Java regular expressions changed slightly between Java 7 and Java 8 best, Colin > > Thanks again! >

Re: ConsumerGroupCommand tool improvement?

2018-08-03 Thread Colin McCabe
Hi Vahid, Interesting idea. It seems like if you're using the AdminClient APIs programmatically, you can just do the filtering yourself in a more flexible way than what we could provide. On the other hand, if you're using the ./bin/consumer-groups.sh command-line tool, why not use grep or a s

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

2018-01-16 Thread Colin McCabe
Thanks, Matthias, this looks great. It seems like these APIs could either be used against mock objects, or against real brokers running in the same process. Is there a way for the user to select which they want when using the API? Sorry if it's in the KIP and I missed it. cheers, Colin On

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-19 Thread Colin McCabe
gt;> heartbeatPurgatory, see completeAndScheduleNextHeartbeatExpiration() > >> called from handleHeartbeat() > >> > >> NB added dev mailing list back into CC as it seems to have been lost along > >> the way. > >> > >> Cheers, > >

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-12 Thread Colin McCabe
Hi Vahid, I think you make a valid point that the ACLs controlling group operations are not very intuitive. This is probably a dumb question, but why are we using Read for mutating APIs? Shouldn't that be Write? The distinction between Describe and Read makes a lot of sense for Topics. A group

Re: Kafka exception

2017-02-17 Thread Colin McCabe
Can you reproduce this with the latest version of Kafka? best, Colin On Wed, Feb 15, 2017, at 22:29, 揣立武 wrote: > > Hi,all! Our program uses the high level consumer api(the version is > 0.8.x). Sometimes the program will throw an exception in the 42th row in > kafka.utils.IteratorTemplate class

Re: Reg: Kafka HDFS Connector with (HDFS SSL enabled)

2017-02-17 Thread Colin McCabe
Hi, Just to be clear, HDFS doesn't use HTTP or HTTPS as its primary transport mechanism. Instead, HDFS uses the Hadoop RPC transport mechanism. So in general, it should not be necessary to configure SSL to connect a client to HDFS. HDFS does "support SSL" in the sense that the HDFS web UI can b

Re: log.flush.interval.messages setting of Kafka 0.9.0.0

2017-02-17 Thread Colin McCabe
Hi, Based on a quick look at the code, the log.flush.interval.messages setting affects how frequently we call fsync on the underlying filesystem. As you mentioned, by default this is set to Long.MAX_VALUE, which effectively disables it. Keep in mind that the underlying operating system will flus

Re: KIP-119: Drop Support for Scala 2.10 in Kafka 0.11

2017-02-06 Thread Colin McCabe
+1 (non-binding) for KIP-119 I agree that supporting the 2 most recently release versions of Java and Scala is a reasonable guideline. However, I think it makes sense to have a brief discussion when dropping support for an old Java or Scala version. It's a fairly infrequent event, and it's worth