Re: [DISCUSS] Re-visit end of life policy

2023-04-25 Thread Matthias J. Sax
Adding the user-mailing list. Seems relevant to everybody. On 4/20/23 2:45 AM, Divij Vaidya wrote: Thank you Matthias for your comments. I agree with you that the decision should be driven based on strong community ask as it introduces a significant overhead on the maintainers. I was hoping

Re: Addition to Kafka contributor group

2023-04-25 Thread Divij Vaidya
Hi Santosh You can use ASF's self service portal to request an account. It would be approved by a committer and they will provide you with the necessary permissions. You can also find this documented at https://kafka.apache.org/contributing -- Divij Vaidya On Tue, Apr 25, 2023 at 7:28 PM

Re: "Recreating" Zookeeper with KRaft

2023-04-25 Thread Santhosh Kumar
Yes, it is possible to have a separate Kraft controller from the brokers in Apache Kafka. The Kraft controller is responsible for managing the overall state of the Kafka cluster, such as managing topics, partitions, and replica assignments. To set up a separate Kraft controller, you will need to

Re: Addition to Kafka contributor group

2023-04-25 Thread Santhosh Kumar
Hi Team, I would also like to contribute to open source Kafka, can you please add me to Kafka contributor group.Please find my details below: Username: Santhosh_Gopal Email: greetsanth...@gmail.com Thanks Santhosh Gopal On Tue, Apr 25, 2023 at 1:19 PM wrote: > On 2023-04-22 02:58, Luke Chen

Re: "Recreating" Zookeeper with KRaft

2023-04-25 Thread info
On 2023-04-19 03:53, Fabio Pardi wrote: Is it possible to have a separate Kraft controller from the brokers? Is there any documentation on setting this up? Hi, you should be able to achieve such setup running kafka in 'controller' mode.

Re: [ANNOUNCE] New PMC chair: Mickael Maison

2023-04-25 Thread info
On 2023-04-21 15:51, Matthias J. Sax wrote: Congrats Mickael! And thanks a lot for taking on this additional task! Glad to have you! -Matthias On 4/21/23 9:40 AM, Viktor Somogyi-Vass wrote: Jun, thank you for all your hard work! Also, congrats Mickael, it is very well deserved :) Best,

Re: Kafka Node Shutting Down Automatically

2023-04-25 Thread info
On 2023-04-22 02:53, Luke Chen wrote: Hi Akshay, Thanks for reporting the issue. It looks like a bug. Could you open a JIRA ticket to track it? Thank you. Luke On Fri, Apr 21, 2023 at 10:16 PM Akshay Kumar wrote: Hello team, - We are

Re: Addition to Kafka contributor group

2023-04-25 Thread info
On 2023-04-22 02:58, Luke Chen wrote: Hi Atul, I've added you to the contribution group in JIRA. I didn't find your account in wiki system. Let me know if you need wiki permission to create a KIP. Thank you. Luke On Fri, Apr 21, 2023 at 10:15 PM Atul Sharma wrote: Hi Team, I would like to

Re: Kafka Node Shutting Down Automatically

2023-04-25 Thread info
On 2023-04-22 11:23, David Arthur wrote: Akshay, this looks a lot like https://issues.apache.org/jira/browse/KAFKA-14035 which was fixed for 3.3.0. Can you upload complete controller logs to that JIRA (or a new one if you prefer)? Thanks! David On Sat, Apr 22, 2023 at 2:54 AM Luke Chen

Re: Producer Application Utilizing Multiple Threads

2023-04-25 Thread info
On 2023-04-24 11:19, Margaret Figura wrote: Hi Arvid, Just as another user of Kafka, I suspect the claim has to do with the producer's ability to perform batching and compression across produced data, so it should be more efficient in some cases, especially with smaller volumes of data and

Re: Producer Application Utilizing Multiple Threads

2023-04-25 Thread info
On 2023-04-24 11:48, Santhosh Kumar wrote: Hi Arvind Yes, there is data to support the claim that sharing a single producer instance across threads in Apache Kafka is generally faster than having multiple instances. The reason for this is that a single producer instance can take advantage of

Re: Consumer Lag Metrics/ Topic level metrics

2023-04-25 Thread info
On 2023-04-25 11:32, Samuel Delepiere wrote: Hi, I use a combination of the Prometheus JMX exporter (https://github.com/prometheus/jmx_exporter) and the Prometheus Kafka exporter (https://github.com/danielqsj/kafka_exporter). The consumer lag metrics come from the latter. I can then output the

Re: Consumer Lag Metrics/ Topic level metrics

2023-04-25 Thread Samuel Delepiere
Hi, I use a combination of the Prometheus JMX exporter (https://github.com/prometheus/jmx_exporter) and the Prometheus Kafka exporter (https://github.com/danielqsj/kafka_exporter). The consumer lag metrics come from the latter. I can then output the data in Grafana Regards, Sam. > On 25

Consumer Lag Metrics/ Topic level metrics

2023-04-25 Thread Kafka Life
Dear Kafka Experts Could you please suggest good metrics exporter for consumer lag and topic level metrics apart from Linkedin kafka burrow for the kafka broker cluster.