Re: Compatibility with jdk 21

Apache Kafka supports building with JDK 21 with version >= 3.7.0 https://issues.apache.org/jira/browse/KAFKA-15485 is the reference ticket. -- Divij Vaidya On Thu, Jun 6, 2024 at 6:46 AM Sahil Sharma D wrote: > Hi team, > > Which version of Kafka is compatible with jdk 21 or

Re: [DISCUSS] Minimum constraint for segment.ms

be adjusted. Please reply in this thread directly. -- Divij Vaidya Apache Kafka PMC On Wed, Mar 13, 2024 at 12:56 PM Divij Vaidya wrote: > Thanks for the discussion folks. I have started a KIP > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1030%3A+Change+constraints+and+default+

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0

ful changes in this release but the one closest to my heart is https://issues.apache.org/jira/browse/KAFKA-15046. I am very glad this is fixed. The P999 latency spikes were driving me crazy for a long time now. -- Divij Vaidya On Wed, Feb 28, 2024 at 10:06 AM Satish Duggana wrote: > Thanks Sta

Re: [PROPOSAL] Add commercial support page on website

them or not? If we keep a blanket criteria of accepting all PRs, then we may end up in a situation where the llink redirects to a phishing page or nefarious website. Hence, we might have to at least perform some basic due diligence which adds overhead to the resources of the community. -- Divij

Important Security Notice for Apache Kafka Users

questions regarding this, please don't hesitate to reach out to us at secur...@kafka.apache.org or post a comment at https://issues.apache.org/jira/browse/KAFKA-15658 Best Regards, Divij Vaidya On behalf of Apache Kafka PMC [1] https://zookeeper.apache.org/security.html#CVE-2023-44981 [2] https

Re: Please add to mailing list

Hey Subhijith Subscribing to the mailing list(s) is self service and you will be able to do it yourself. See https://kafka.apache.org/contact for detailed instructions. -- Divij Vaidya On Fri, Oct 13, 2023 at 11:16 AM Subhijith Tharayil wrote: > Hi Community, > Please add t

Re: [ANNOUNCE] Apache Kafka 3.6.0

users so that we can fix the paper cuts in 3.7.0. -- Divij Vaidya On Wed, Oct 11, 2023 at 9:32 AM Viktor Somogyi-Vass wrote: > Thanks for the release Satish! :) > > On Wed, Oct 11, 2023, 09:30 Bruno Cadonna wrote: > > > Thanks for the release, Satish! > > > > Best,

Re: [VOTE] 3.6.0 RC2

but we should add it as a fast follow-up. 2. Metric added in https://github.com/apache/kafka/commit/a900794ace4dcf1f9dadee27fbd8b63979532a18 isn't available in documentation (cc: David). I don't consider this as a release blocker but we should add it as a fast follow-up. -- Divij Vaidya On Mon

Re: No RSS available on the new Kafka Blog

in adding this feature. -- Divij Vaidya On Fri, Sep 22, 2023 at 8:13 PM Alexander Kilian wrote: > > Hi all, > > The old Kafka blog on https://blogs.apache.org/kafka was RSS friendly and > could be subscribed to in e.g. Feedly. > > The new Kafka blog on https://kafka.apache.org/

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hey Satish My comments about documentation misses from RC0 vote thread [1] are still not addressed (such as missing metric documentation, formatting problems etc). Could you please mention why we shouldn't consider them as blockers to make RC1 as the final release? [1]

Re: Single Broker Constantly Reaches 100% CPU

napshot. I recently gave a talk during Kafka Summit on how you could use flamegraphs obtained via profiler to find hotspots in your code. See: https://www.confluent.io/events/kafka-summit-london-2023/unveiling-the-inner-workings-of-apache-kafka-r-with-flamegraphs/ -- Divij Vaidya On Wed, Aug 9, 20

Re: Lag in one of Kafka broker partition

direction on what all you need to monitor to identify the root cause. -- Divij Vaidya On Wed, Aug 9, 2023 at 3:33 PM Karnam, Sudheer wrote: > > Hi team, > We are using kafka version-2.6.0,has 6brokers and cluster is running for last > 3 years. > We have a topic with 30 p

[ANNOUNCE] Apache Kafka 3.5.1

Huang, Aman Singh, andymg3, Bo Gao, Calvin Liu, Chia-Ping Tsai, Chris Egerton, d00791190, Damon Xie, David Arthur, David Jacot, Divij Vaidya, DL1231, ezio, Manikumar Reddy, Manyanda Chitimbo, Mickael Maison, minjian.cai, Proven Provenzano, Sambhav Jain, vamossagar12, Yash Mayya We welco

[RESULTS] [VOTE] Release Kafka version 3.5.1

continue with the release process and the release announcement will follow in the next few days. -- Divij Vaidya Release Manager for Apache Kafka 3.5.1

Re: [VOTE] 3.5.1 RC1

Thank you for testing folks. Although, we already have 3 binding votes, as per Apache's release approval process [1], I am going to keep the vote open for 72 hours, i.e. until July 20th 10:30 AM (CEST) [1] https://www.apache.org/legal/release-policy.html#release-approval -- Divij Vaidya

Re: Release plan required for version 3.5.1

contribution here and in future release, would be greatly welcome. Let me know if you have any questions. -- Divij Vaidya On Wed, Jul 12, 2023 at 12:16 PM Divij Vaidya wrote: > Hey Sahil > > https://cwiki.apache.org/confluence/display/KAFKA/Release+plan+3.5.1 is > the relea

[VOTE] 3.5.1 RC1

e to believe that they are flaky. I have also verified that unit/integration tests on my local machine successfully pass (JDK 17 + Scala 2.13) System tests: Not planning to run system tests since this is a patch release. Thank you. -- Divij Vaidya Release Manager for Apache Kafka 3.5.1

Re: [VOTE] 3.5.1 RC0

Please ignore this. I need to re-send this email with the correct release canddiate in this email. -- Divij Vaidya On Mon, Jul 17, 2023 at 10:07 AM Divij Vaidya wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate (RC1) for release of Apa

[VOTE] 3.5.1 RC0

e to believe that they are flaky. I have also verified that unit/integration tests on my local machine successfully pass (JDK 17 + Scala 2.13) System tests: Not planning to run system tests since this is a patch release. Thank you. -- Divij Vaidya Release Manager for Apache Kafka 3.5.1

Re: [VOTE] 3.5.1 RC0

Thank you both for testing this. Fede, that's a good catch. My bad on not catching it earlier during release prep. I will create a new RC containing the fix - https://github.com/apache/kafka/pull/14016 -- Divij Vaidya On Fri, Jul 14, 2023 at 9:29 AM Jakub Scholz wrote: > +1 (non-binding)

Re: Release plan required for version 3.5.1

to it at https://kafka.apache.org/contact -- Divij Vaidya On Wed, Jul 12, 2023 at 6:22 AM Sahil Sharma D wrote: > Gentle reminder! > > -Original Message- > From: Sahil Sharma D > Sent: 03 July 2023 04:39 PM > To: users@kafka.apache.org > Subject: RE: Release plan requi

Re: [VOTE] 3.5.1 RC0

+ kafka-clie...@googlegroups.com -- Divij Vaidya On Wed, Jul 12, 2023 at 12:03 PM Divij Vaidya wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache Kafka 3.5.1. > > This release is a security patch relea

[VOTE] 3.5.1 RC0

ns to ensure that there are no consistently failing tests. I have verified that unit/integration tests on my local machine successfully pass. System tests: Not planning to run system tests since this is a patch release. Thank you. -- Divij Vaidya Release Manager for Apache Kafka 3.5.1

Re: [ANNOUNCE] New committer: Greg Harris

Congratulations Greg! I am going through a new committer teething process right now and would be happy to get you up to speed. Looking forward to working with you in your new role. -- Divij Vaidya On Mon, Jul 10, 2023 at 5:51 PM Josep Prat wrote: > Congrats Greg! > > > ———

Re: required dependent jars on kafka-clients-3.3.1.jar

adle#L1331 -- Divij Vaidya On Mon, Jun 19, 2023 at 9:28 AM Sahil Sharma D wrote: > Hi Team, > > We are using Kafka 3.3.1 in our product, there are multiple jars bundled > in it. We are using only kafka-clients-3.3.1.jar out of those jars. > > Can you please help us in identifying t

Re: Process to Upgrade Zookeeper from 2.7.0 to 3.4.1

[1] https://zookeeper.apache.org/releases.html -- Divij Vaidya On Wed, Jun 14, 2023 at 2:41 PM Gaurav Pande wrote: > Hi Luke, > > Thanks for helping here , iam using Zookeeper that comes with Apache > kafka itself , is the same ? So not using external zk binary. > > Regards, > Gaur

Re: Addition to Kafka contributor group

Hi Santosh You can use ASF's self service portal to request an account. It would be approved by a committer and they will provide you with the necessary permissions. You can also find this documented at https://kafka.apache.org/contributing -- Divij Vaidya On Tue, Apr 25, 2023 at 7:28 PM

Re: "Recreating" Zookeeper with KRaft

Hey Doug Yes. You can choose to have nodes which act as "controllers-only" by setting "process.roles=controller". You can find this information at https://kafka.apache.org/documentation.html#kraft_role -- Divij Vaidya On Tue, Apr 18, 2023 at 5:28 PM Doug Whitfield

Re: Facing new leader election issues in zookeeper-less kafka cluster having version 3.3.2

n't able to produce/consume from it but it still has a leader? -- Divij Vaidya On Fri, Apr 14, 2023 at 12:32 PM Kunal Jadhav wrote: > Hello All, > > We have implemented 3 brokers cluster on a single node server in the > kubernetes environment, which is a zookeeper-less cluster having

Re: Missing Message folder in the git 3.4 branches.

to file", type "message" and you will notice a bunch of directories with this name get populated. -- Divij Vaidya On Fri, Mar 31, 2023 at 6:09 PM Kelvin.Ni wrote: > Hi Kafka Dev Team， > > > > Today we try to learn the source code, we found that the message folder &

Re: consumer_offest partition increased.

, Divij [1] leader_of_partition(abs(hash(CONSUMER_GROUP_NAME)) % __CONSUMER_OFFSETS_PARTITION_COUNT) [2] https://cwiki.apache.org/confluence/display/KAFKA/KIP-895%3A+Dynamically+refresh+partition+count+of+__consumer_offsets Divij Vaidya On Mon, Apr 3, 2023 at 7:42 PM David Ballano Fernandez

Re: Kafka cluster rolling restart

num io & network threads etc.), their request processing will slow down leading to increased latency. Could you analyze your cluster based on the above explanation and let us know if you are facing one of the bottlenecks described above? -- Divij Vaidya On Mon, Mar 6, 2023 at 7:18 PM Peter Bukowins

Re: Question about REQUEST QUEUE size

tion errors? You can verify this by looking at "kafka.network:type=RequestMetrics,name=ErrorsPerSec,request=([-.\w]+),error=([-.\w]+)" -- Divij Vaidya On Tue, Mar 7, 2023 at 11:43 AM Huân La Quốc Nhựt wrote: > Hi guys, > According to the document we can get the request queue siz

Re: Kafka issues related 3.2.3 version zookeeper less cluster

are correlated with this time frame? Thanks! Regards, Divij Vaidya On Thu, Jan 12, 2023 at 3:13 PM Kunal Jadhav wrote: > Hello All, > > We are facing some issues in the 3.2.3 kafka version cluster. We have > implemented 3 brokers cluster on a single node server in the kubernetes > environme

Re: [SUSPECTED SPAM] Re: Critical bug in Kafka 2.8.1 | topic Id in memory: <> does not match the topic Id for partition <> provided in the request: <>.

. (state.change.logger) -- Divij Vaidya On Thu, Dec 22, 2022 at 11:32 AM Divij Vaidya wrote: > Oh yes! You can run a script which checks that the topic IDs in Zk are > consistent with the ones that are available on partition.metadata. > > An example script would look something like t

Re: [SUSPECTED SPAM] Re: Critical bug in Kafka 2.8.1 | topic Id in memory: <> does not match the topic Id for partition <> provided in the request: <>.

I linked earlier. Please add a +1 to the JIRA since it would help measure the impact of this bug and hence, will help drive prioritization of a fix in the community. -- Divij Vaidya On Mon, Dec 19, 2022 at 1:23 PM Atul Kumar (atkumar3) wrote: > Hi Divij, > > As this issue manife

Re: Join mailing list

Hey Tom Joining the mailing list is self service. You can read the instructions here: https://kafka.apache.org/contact. The summary is that you need to send an email to the corresponding subscribe email address that you wish to subscribe to. -- Divij Vaidya On Mon, Dec 19, 2022 at 5:03 PM Tom

Re: Network threads monitoring

ons here: https://kafka.apache.org/33/documentation.html#rep-throttle Let us know what you found! -- Divij Vaidya On Tue, Nov 29, 2022 at 5:09 PM Péter Sinóros-Szabó wrote: > Hi, > > How can I know if I have enough network threads configured with > num.network.threads? >

Re: Critical bug in Kafka 2.8.1 | topic Id in memory: <> does not match the topic Id for partition <> provided in the request: <>.

ead of `--zookeeper`. Does the above explanation match your Kafka setup? -- Divij Vaidya On Thu, Dec 8, 2022 at 1:16 PM Atul Kumar (atkumar3) wrote: > Hello everyone, > > We are using Kafka 2.8.1, and recently while rolling restart of one of our > clusters, we encountered the

Re: Topic Compaction

ean application log files. -- Divij Vaidya On Thu, Oct 27, 2022 at 11:31 PM Navneeth Krishnan wrote: > Hi All, > > We are using AWS MSK with kafka version 2.6.1. There is a compacted topic > with the below configurations. After reading the documentation my > understanding wa

Re: [VOTE] 3.3.0 RC2

Please ignore my previous email. Seems like that is a known issue and we plan to fix it after the release. Divij Vaidya On Wed, Sep 28, 2022 at 3:08 PM Divij Vaidya wrote: > Hey folks > > I noticed a non-blocking bug with the documentation page where the arrow > to left

Re: [VOTE] 3.3.0 RC2

this bug. Reproducer: 1. Visit https://kafka.apache.org/33/documentation.html on a chrome browser. 2. Observe that arrow to expand left nav overlaps with text. 3. Remove "33/" from the url to observe the current documentation. 4. Observe that the current website does not have this bug. Di

Re: Unexpected loss of Offsets

.2. I will be happy to assist / perform the release process for 2.8.2 or assist in any other way I can. Luke, please let me know how we want to proceed ahead on this. Regards, Divij Vaidya On Fri, Apr 29, 2022 at 5:09 AM James Olsen wrote: > Luke, > > I would argue that https://issues.apache.