would still perform filtering at the client-side, just
in a more managed way than manually writing a consumer to do so.
—
Divij Vaidya
On Thu 29. Aug 2024 at 20:51, vaidya nathan wrote:
> Hi Kafka users,
> I have a producer consumer setup where I want the consumer to get only a
>
situation?
--
Divij Vaidya
On Fri, Aug 23, 2024 at 12:01 PM Atul Sharma
wrote:
> Hi Akash, thanks for the quick reply.
>
> By the term leader i mean partition leader.
>
>
> I agree with you as upgrading to Kraft based cluster will help in reducing
> the partitions leader ele
Apache Kafka supports building with JDK 21 with version >= 3.7.0
https://issues.apache.org/jira/browse/KAFKA-15485 is the reference ticket.
--
Divij Vaidya
On Thu, Jun 6, 2024 at 6:46 AM Sahil Sharma D
wrote:
> Hi team,
>
> Which version of Kafka is compatible with jdk 21 or
adjusted. Please reply in this
thread directly.
--
Divij Vaidya
Apache Kafka PMC
On Wed, Mar 13, 2024 at 12:56 PM Divij Vaidya
wrote:
> Thanks for the discussion folks. I have started a KIP
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-1030%3A+Change+constraints+and+default+valu
ful changes in this release but the one closest to my
heart is https://issues.apache.org/jira/browse/KAFKA-15046. I am very glad
this is fixed. The P999 latency spikes were driving me crazy for a long
time now.
--
Divij Vaidya
On Wed, Feb 28, 2024 at 10:06 AM Satish Duggana
wrote:
> Thanks Sta
her to add them or not? If we keep a blanket criteria of
accepting all PRs, then we may end up in a situation where the llink
redirects to a phishing page or nefarious website. Hence, we might have to
at least perform some basic due diligence which adds overhead to the
resources of the community.
ny further questions regarding this, please don't hesitate to
reach out to us at secur...@kafka.apache.org or post a comment at
https://issues.apache.org/jira/browse/KAFKA-15658
Best Regards,
Divij Vaidya
On behalf of Apache Kafka PMC
[1] https://zookeeper.apache.org/security.html#CVE-2023-
Hey Subhijith
Subscribing to the mailing list(s) is self service and you will be able to
do it yourself. See https://kafka.apache.org/contact for detailed
instructions.
--
Divij Vaidya
On Fri, Oct 13, 2023 at 11:16 AM Subhijith Tharayil
wrote:
> Hi Community,
> Please add t
from users so that we can fix the paper
cuts in 3.7.0.
--
Divij Vaidya
On Wed, Oct 11, 2023 at 9:32 AM Viktor Somogyi-Vass
wrote:
> Thanks for the release Satish! :)
>
> On Wed, Oct 11, 2023, 09:30 Bruno Cadonna wrote:
>
> > Thanks for the release, Satish!
> >
> >
se blocker but we should add it as a fast follow-up.
2. Metric added in
https://github.com/apache/kafka/commit/a900794ace4dcf1f9dadee27fbd8b63979532a18
isn't available in documentation (cc: David). I don't consider this as a
release blocker but we should add it as a fast follow-up.
--
Di
adding this feature.
--
Divij Vaidya
On Fri, Sep 22, 2023 at 8:13 PM Alexander Kilian
wrote:
>
> Hi all,
>
> The old Kafka blog on https://blogs.apache.org/kafka was RSS friendly and
> could be subscribed to in e.g. Feedly.
>
> The new Kafka blog on https://kafka.apache.org/blog
Hey Satish
My comments about documentation misses from RC0 vote thread [1] are
still not addressed (such as missing metric documentation, formatting
problems etc). Could you please mention why we shouldn't consider them
as blockers to make RC1 as the final release?
[1] https://lists.apache.org/th
t a snapshot. I
recently gave a talk during Kafka Summit on how you could use
flamegraphs obtained via profiler to find hotspots in your code. See:
https://www.confluent.io/events/kafka-summit-london-2023/unveiling-the-inner-workings-of-apache-kafka-r-with-flamegraphs/
--
Divij Vaidya
On Wed, A
a direction on
what all you need to monitor to identify the root cause.
--
Divij Vaidya
On Wed, Aug 9, 2023 at 3:33 PM Karnam, Sudheer wrote:
>
> Hi team,
> We are using kafka version-2.6.0,has 6brokers and cluster is running for last
> 3 years.
> We have a topic with 30
Huang, Aman Singh, andymg3, Bo Gao, Calvin Liu, Chia-Ping Tsai,
Chris Egerton, d00791190, Damon Xie, David Arthur, David Jacot, Divij
Vaidya, DL1231, ezio, Manikumar Reddy, Manyanda Chitimbo, Mickael Maison,
minjian.cai, Proven Provenzano, Sambhav Jain, vamossagar12, Yash Mayya
We welcome y
27;ll continue with the release process and the release announcement
will follow in the next few days.
--
Divij Vaidya
Release Manager for Apache Kafka 3.5.1
Thank you for testing folks.
Although, we already have 3 binding votes, as per Apache's release approval
process [1], I am going to keep the vote open for 72 hours, i.e. until July
20th 10:30 AM (CEST)
[1] https://www.apache.org/legal/release-policy.html#release-approval
--
Divij Vaidya
contribution
here and in future release, would be greatly welcome. Let me know if you
have any questions.
--
Divij Vaidya
On Wed, Jul 12, 2023 at 12:16 PM Divij Vaidya
wrote:
> Hey Sahil
>
> https://cwiki.apache.org/confluence/display/KAFKA/Release+plan+3.5.1 is
> the release
eve that they are flaky. I have also verified that
unit/integration tests on my local machine successfully pass (JDK 17 +
Scala 2.13)
System tests:
Not planning to run system tests since this is a patch release.
Thank you.
--
Divij Vaidya
Release Manager for Apache Kafka 3.5.1
Please ignore this. I need to re-send this email with the correct release
canddiate in this email.
--
Divij Vaidya
On Mon, Jul 17, 2023 at 10:07 AM Divij Vaidya
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the second candidate (RC1) for release of Apa
eve that they are flaky. I have also verified that
unit/integration tests on my local machine successfully pass (JDK 17 +
Scala 2.13)
System tests:
Not planning to run system tests since this is a patch release.
Thank you.
--
Divij Vaidya
Release Manager for Apache Kafka 3.5.1
Thank you both for testing this.
Fede, that's a good catch. My bad on not catching it earlier during release
prep. I will create a new RC containing the fix -
https://github.com/apache/kafka/pull/14016
--
Divij Vaidya
On Fri, Jul 14, 2023 at 9:29 AM Jakub Scholz wrote:
> +1 (non-bin
it at https://kafka.apache.org/contact
--
Divij Vaidya
On Wed, Jul 12, 2023 at 6:22 AM Sahil Sharma D
wrote:
> Gentle reminder!
>
> -Original Message-
> From: Sahil Sharma D
> Sent: 03 July 2023 04:39 PM
> To: users@kafka.apache.org
> Subject: RE: Release plan requi
+ kafka-clie...@googlegroups.com
--
Divij Vaidya
On Wed, Jul 12, 2023 at 12:03 PM Divij Vaidya
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the first candidate for release of Apache Kafka 3.5.1.
>
> This release is a security patch release.
that there are no
consistently failing tests. I have verified that unit/integration tests on
my local machine successfully pass.
System tests:
Not planning to run system tests since this is a patch release.
Thank you.
--
Divij Vaidya
Release Manager for Apache Kafka 3.5.1
Congratulations Greg! I am going through a new committer teething process
right now and would be happy to get you up to speed. Looking forward to
working with you in your new role.
--
Divij Vaidya
On Mon, Jul 10, 2023 at 5:51 PM Josep Prat
wrote:
> Congrats Greg!
>
>
> ———
3/build.gradle#L1331
--
Divij Vaidya
On Mon, Jun 19, 2023 at 9:28 AM Sahil Sharma D
wrote:
> Hi Team,
>
> We are using Kafka 3.3.1 in our product, there are multiple jars bundled
> in it. We are using only kafka-clients-3.3.1.jar out of those jars.
>
> Can you please help us in ide
lps.
[1] https://zookeeper.apache.org/releases.html
--
Divij Vaidya
On Wed, Jun 14, 2023 at 2:41 PM Gaurav Pande wrote:
> Hi Luke,
>
> Thanks for helping here , iam using Zookeeper that comes with Apache
> kafka itself , is the same ? So not using external zk binary.
>
> Regards,
>
Hi Santosh
You can use ASF's self service portal to request an account. It would be
approved by a committer and they will provide you with the necessary
permissions. You can also find this documented at
https://kafka.apache.org/contributing
--
Divij Vaidya
On Tue, Apr 25, 2023 at 7:
Hey Doug
Yes. You can choose to have nodes which act as "controllers-only" by
setting "process.roles=controller". You can find this information at
https://kafka.apache.org/documentation.html#kraft_role
--
Divij Vaidya
On Tue, Apr 18, 2023 at 5:28 PM Doug Whitfield
wrote:
u aren't
able to produce/consume from it but it still has a leader?
--
Divij Vaidya
On Fri, Apr 14, 2023 at 12:32 PM Kunal Jadhav
wrote:
> Hello All,
>
> We have implemented 3 brokers cluster on a single node server in the
> kubernetes environment, which is a zookeeper-less clust
to file", type "message" and you
will notice a bunch of directories with this name get populated.
--
Divij Vaidya
On Fri, Mar 31, 2023 at 6:09 PM Kelvin.Ni wrote:
> Hi Kafka Dev Team,
>
>
>
> Today we try to learn the source code, we found that the message folder
&
gards,
Divij
[1] leader_of_partition(abs(hash(CONSUMER_GROUP_NAME)) %
__CONSUMER_OFFSETS_PARTITION_COUNT)
[2]
https://cwiki.apache.org/confluence/display/KAFKA/KIP-895%3A+Dynamically+refresh+partition+count+of+__consumer_offsets
Divij Vaidya
On Mon, Apr 3, 2023 at 7:42 PM David Ballano Fern
num io &
network threads etc.), their request processing will slow down leading to
increased latency.
Could you analyze your cluster based on the above explanation and let us
know if you are facing one of the bottlenecks described above?
--
Divij Vaidya
On Mon, Mar 6, 2023 at 7:18 PM Pete
orization errors? You can verify this by looking at
"kafka.network:type=RequestMetrics,name=ErrorsPerSec,request=([-.\w]+),error=([-.\w]+)"
--
Divij Vaidya
On Tue, Mar 7, 2023 at 11:43 AM Huân La Quốc Nhựt
wrote:
> Hi guys,
> According to the document we can get the request queu
correlated
with this time frame?
Thanks!
Regards,
Divij Vaidya
On Thu, Jan 12, 2023 at 3:13 PM Kunal Jadhav
wrote:
> Hello All,
>
> We are facing some issues in the 3.2.3 kafka version cluster. We have
> implemented 3 brokers cluster on a single node server in the kubernetes
> environme
.
(state.change.logger)
--
Divij Vaidya
On Thu, Dec 22, 2022 at 11:32 AM Divij Vaidya
wrote:
> Oh yes! You can run a script which checks that the topic IDs in Zk are
> consistent with the ones that are available on partition.metadata.
>
> An example script would look something like t
I linked earlier. Please add a +1
to the JIRA since it would help measure the impact of this bug and hence,
will help drive prioritization of a fix in the community.
--
Divij Vaidya
On Mon, Dec 19, 2022 at 1:23 PM Atul Kumar (atkumar3)
wrote:
> Hi Divij,
>
> As this issue manifests
Hey Tom
Joining the mailing list is self service. You can read the instructions
here: https://kafka.apache.org/contact. The summary is that you need to
send an email to the corresponding subscribe email address that you wish to
subscribe to.
--
Divij Vaidya
On Mon, Dec 19, 2022 at 5:03 PM Tom
ructions here:
https://kafka.apache.org/33/documentation.html#rep-throttle
Let us know what you found!
--
Divij Vaidya
On Tue, Nov 29, 2022 at 5:09 PM Péter Sinóros-Szabó
wrote:
> Hi,
>
> How can I know if I have enough network threads configured with
> num.network.threads?
>
of `--zookeeper`.
Does the above explanation match your Kafka setup?
--
Divij Vaidya
On Thu, Dec 8, 2022 at 1:16 PM Atul Kumar (atkumar3)
wrote:
> Hello everyone,
>
> We are using Kafka 2.8.1, and recently while rolling restart of one of our
> clusters, we encountered the followi
ean application log
files.
--
Divij Vaidya
On Thu, Oct 27, 2022 at 11:31 PM Navneeth Krishnan
wrote:
> Hi All,
>
> We are using AWS MSK with kafka version 2.6.1. There is a compacted topic
> with the below configurations. After reading the documentation my
> understanding was that
Please ignore my previous email. Seems like that is a known issue and we
plan to fix it after the release.
Divij Vaidya
On Wed, Sep 28, 2022 at 3:08 PM Divij Vaidya
wrote:
> Hey folks
>
> I noticed a non-blocking bug with the documentation page where the arrow
> to left nav overl
bug.
Reproducer:
1. Visit https://kafka.apache.org/33/documentation.html on a chrome browser.
2. Observe that arrow to expand left nav overlaps with text.
3. Remove "33/" from the url to observe the current documentation.
4. Observe that the current website does not have this bug.
Di
ill be happy to assist / perform the release process for 2.8.2 or assist
in any other way I can. Luke, please let me know how we want to proceed
ahead on this.
Regards,
Divij Vaidya
On Fri, Apr 29, 2022 at 5:09 AM James Olsen wrote:
> Luke,
>
> I would argue that https://issues.apache.
45 matches
Mail list logo