Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #628

See

Re: [DISCUSS] KIP-815: Replace KafkaConsumer with AdminClient in GetOffsetShell

Thank you Luke, I already changed the file name. > On Jan 20, 2022, at 10:08 AM, Luke Chen wrote: > > Hi Ziming, > > Thanks for the update! It looks good now. > > Only 1 minor comment: > The file name in example can change to `kafka_admin_client.properties`, > which should be much clear. > >

Re: [ANNOUNCE] Apache Kafka 3.1.0

Thanks David for driving the release! @Deepti, no, this release doesn't include the log4j2 upgrade feature. Luke On Tue, Jan 25, 2022 at 11:43 AM Gwen Shapira wrote: > Exciting! Thanks for driving the release, David. > > On Mon, Jan 24, 2022 at 9:04 AM David Jacot wrote: > > > > The Apache

Re: [ANNOUNCE] Apache Kafka 3.1.0

Exciting! Thanks for driving the release, David. On Mon, Jan 24, 2022 at 9:04 AM David Jacot wrote: > > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.1.0. > > It is a major release that includes many new features, including: > > * Apache Kafka supports Java

Re: __consumer_offsets auto creation with `auto.create.topics.enable = false`

Hi Colin, Let's discuss this issue in KAFKA-13612 with Jason and Dom. (and anyone who is interested) Thank you. Luke On Tue, Jan 25, 2022 at 2:43 AM Colin McCabe wrote: > Kafka internal topics are… well… internal, and we don’t guarantee

Re: [VOTE] KIP-591: Add Kafka Streams config to set default state store

Hi Matthias, I didn't "save" the change. >.< Anyway, you can refer to this WIP PR to have better understanding why/what the new API is: https://github.com/apache/kafka/pull/11705/files#diff-c552e58e01169886c5d8b8b149f5c8cd48ea1fc1c3d7b932d055d3df9a00e1b5R464-R477 It's not necessary, actually,

Re: [DISCUSS] KIP-814: Static membership protocol should let the leader skip assignment

Hi David, Is the idea here to skip calling performAssignment(...) on the AbstractCoordinator.onJoinLeader(...) method, or adding a new boolean parameter to the performAssignment(...) method? The reason I ask is because I raised KIP-795 a few weeks back, which aims to add a public API for

Re: [DISCUSS] KIP-704: Send a hint to broker if it is an unclean leader

Thanks for the additional context regarding AlterIsrResponse. Jason wrote: > In regard to the naming of `IsLeaderRecovering`, I agree it still seems a > bit awkward. I kind of liked the idea of turning it into a `PartitionState` > field instead. That would also address the inconsistent type in

[jira] [Created] (KAFKA-13615) Kafka Streams does not transition state on LeaveGroup due to poll interval being exceeded

Tim Costa created KAFKA-13615: - Summary: Kafka Streams does not transition state on LeaveGroup due to poll interval being exceeded Key: KAFKA-13615 URL: https://issues.apache.org/jira/browse/KAFKA-13615

RE: [ANNOUNCE] Apache Kafka 3.1.0

Congratulations! One thing would like to confirm, if we have upgraded the Log4J version from 1.x to 2.x in this release? Regards, Deepti Sharma PMP® & ITIL -Original Message- From: David Jacot Sent: Monday, January 24, 2022 10:34 PM To: annou...@apache.org; dev@kafka.apache.org;

Re: __consumer_offsets auto creation with `auto.create.topics.enable = false`

Kafka internal topics are… well… internal, and we don’t guarantee anything about their format or whether or not they are present, etc. There is no guarantee that Kafka will always use __consumer-offsets to manage offsets — it could change in the future. I think the big mistake we made is making

Re: [VOTE] KIP-591: Add Kafka Streams config to set default state store

I don't see the KIP update? Did you hit "save"? Also, the formatting in your email for the new methods is hard to read. Not sure atm why we need the API change? Can you elaborate? what does I found it'd be better -Matthias On 1/24/22 2:29 AM, Luke Chen wrote: Thanks for all your votes.

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.1 #69

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #627

See

Re: [ANNOUNCE] Apache Kafka 3.1.0

Thanks David for driving this release! On Mon, Jan 24, 2022 at 6:07 PM Deepti Sharma S wrote: > > Congratulations! > > One thing would like to confirm, if we have upgraded the Log4J version from > 1.x to 2.x in this release? > > > Regards, > Deepti Sharma > PMP® & ITIL > > > -Original

[ANNOUNCE] Apache Kafka 3.1.0

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.1.0. It is a major release that includes many new features, including: * Apache Kafka supports Java 17 * The FetchRequest supports Topic IDs (KIP-516) * Extend SASL/OAUTHBEARER with support for OIDC (KIP-768) * Add

Re: KIP-769: Connect API to retrieve connector configuration definitions

Hi Tom, Thanks for the feedback. You're right we don't have any contracts around the version field. Like Chris I've only used the current field to find the exact source code of connectors. Even if it's a limited use, I think that's enough to justify adding it to all plugins and making them

[GitHub] [kafka-site] dajac merged pull request #393: MINOR: Update site for Apache Kafka 3.1.0 release

dajac merged pull request #393: URL: https://github.com/apache/kafka-site/pull/393 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-13614) Leader replication quota is applied to consumer fetches

David Mao created KAFKA-13614: - Summary: Leader replication quota is applied to consumer fetches Key: KAFKA-13614 URL: https://issues.apache.org/jira/browse/KAFKA-13614 Project: Kafka Issue

Re: [DISCUSS] KIP-814: Static membership protocol should let the leader skip assignment

Hey Jason, Thanks for your comments. Regarding your first point. Yes, you have it right. Let me complement the KIP to be clearer. Regarding your second point. That is right. New partitions would not be detected while the leader is down. It is definitely not ideal but that seems acceptable to

Re: [VOTE] KIP-719: Deprecate Log4J Appender

Hi All, As of present: - Binding: +3 (Mickael, Ismael, Tom) - Non-binding: +3 (Viktor, Edoardo, Luke) This KIP is now accepted. Thanks for your votes! On Mon, Jan 24, 2022 at 7:13 PM Luke Chen wrote: > Hi Dongjin, > > Thanks for the work on log4j2. > > +1 (non-binding) > > Luke > > On Mon,

[jira] [Created] (KAFKA-13613) Kafka Connect has a hard dependency on KeyGenerator.HmacSHA256

Guy Pascarella created KAFKA-13613: -- Summary: Kafka Connect has a hard dependency on KeyGenerator.HmacSHA256 Key: KAFKA-13613 URL: https://issues.apache.org/jira/browse/KAFKA-13613 Project: Kafka

Re: [VOTE] KIP-591: Add Kafka Streams config to set default state store

Thanks for all your votes. During the implementation, I found it'd be better to have helper methods in `Stores`, to be able to get the store supplier by the store type: *public static SessionBytesStoreSupplier sessionStoreSupplierByStoreType()public static WindowBytesStoreSupplier

Re: [DISCUSS] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

Hi Tom, Thanks for your review. My original intent was to use the naming available in TimeUnit doc : https://docs.oracle.com/javase/7/docs/api/java/util/concurrent/TimeUnit.html This led me to follow their logic : "toMicros", "toNanos", etc. By looking around the kafka code to see if there was

Re: [VOTE] KIP-719: Deprecate Log4J Appender

Hi Dongjin, Thanks for the work on log4j2. +1 (non-binding) Luke On Mon, Jan 24, 2022 at 5:30 PM Tom Bentley wrote: > Thanks Dongjin, +1 (binding). > > Kind regards, > > Tom > > > On Thu, 20 Jan 2022 at 17:20, Ismael Juma wrote: > > > Thanks for the KIP, +1 (binding). > > > > Ismael > > > >

Proposal to add IBM Power (ppc64le) to apache kafka jenkins CI

Hello, We would like to work with the community to enable IBM Power (ppc64le) architecture support for Apache Jenkins CI so we can enable Apache Kafka on IBM Power systems. An IBM Power (ppc64le) VM available to the community for integrating into Jenkins cluster. The VM has also been set up as

Re: [VOTE] KIP-719: Deprecate Log4J Appender

Thanks Dongjin, +1 (binding). Kind regards, Tom On Thu, 20 Jan 2022 at 17:20, Ismael Juma wrote: > Thanks for the KIP, +1 (binding). > > Ismael > > On Tue, Dec 21, 2021 at 1:00 AM Dongjin Lee wrote: > > > Hi All, > > > > I hope to reboot the voting for KIP-719: Deprecate Log4J Appender. > >