Kafka : Version Upgrade

[Kafka Life]

Dear Kafka Experts

1- Can any one share the upgrade plan with steps /Plan /tracker or any
useful documentation please.

2- upgrading kafka from old version of 0.11 to 2.5 .Any
suggestions/directions is highly appreciated.

Thanks

Re: Kafka : Version Upgrade

[Kafka Life]

Thank you Luke.will check

<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Virus-free.
www.avg.com
<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

On Tue, Jun 8, 2021 at 3:41 PM Luke Chen  wrote:

> Hi,
> About the upgrade documentation, please read here:
> https://kafka.apache.org/documentation/#upgrade
>
> It should answer your 2 questions.
>
> Thanks.
> Luke
>
> On Tue, Jun 8, 2021 at 6:01 PM Kafka Life  wrote:
>
> > Dear Kafka Experts
> >
> > 1- Can any one share the upgrade plan with steps /Plan /tracker or any
> > useful documentation please.
> >
> > 2- upgrading kafka from old version of 0.11 to 2.5 .Any
> > suggestions/directions is highly appreciated.
> >
> > Thanks
> >
>

Zookeeper issue : production

[Kafka Life]

Dear Experts.. the zookeeper ensemble is creating issues in production..
zookeeper logs print as below.. can any one please suggest why this error
occurs and wht is the solution for the same.

- ERROR [CommitProcessor:1:NIOServerCnxn@178] - Unexpected Exception:
java.nio.channels.CancelledKeyException
at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
at
org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
at
org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1082)
at
org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
at
org.apache.zookeeper.server.quorum.CommitProcessor.run(CommitProcessor.java:77)

Re: Zookeeper issue : production

[Kafka Life]

Hello Brahma, the zookeeper version is 3.4.8 . I went through that, but
could not really get the picture on what is the impact and why actually
such response to closed client connection happens. Could you please throw
some light kindly.


Thanks

On Wed, Jun 9, 2021 at 6:21 PM Battula, Brahma Reddy
 wrote:

> It’s better to mention which version you are using.
>
>
> Hope the following link will help you.
> https://www.programmersought.com/article/5376340/
>
>
> From: Kafka Life 
> Date: Wednesday, 9 June 2021 at 4:12 PM
> To: users@kafka.apache.org 
> Subject: Zookeeper issue : production
> Dear Experts.. the zookeeper ensemble is creating issues in production..
> zookeeper logs print as below.. can any one please suggest why this error
> occurs and wht is the solution for the same.
>
> - ERROR [CommitProcessor:1:NIOServerCnxn@178] - Unexpected Exception:
> java.nio.channels.CancelledKeyException
> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
> at
>
> org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
> at
>
> org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1082)
> at
>
> org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
> at
>
> org.apache.zookeeper.server.quorum.CommitProcessor.run(CommitProcessor.java:77)
>

Consumer Reporting error

[Kafka Life]

Hello Kafka experts

The consumer team is reporting issue while consuming the data from the
topic as Singularity Header issue.
Can some one please tell on how to resolve this issue.
Error looks like ;

Starting offset: 1226716

offset: 1226716 position: 0 CreateTime: 1583780622665 isvalid: true
keysize: -1 valuesize: 346 magic: 2 compresscodec: NONE producerId: -1
producerEpoch: -1 sequence: -1 isT*ransactional: false headerKeys:
[singularityheader]* payload: ^@^@^@^A^@^@^@

5.0.0.1246^T5.0.0.1246???\^B,AzLJC6OMQFemD1qRiUdTbg^B^@^BH0aa8db3c-6967-41a3-a7e5-395a5b70a59b^B^P79637040^@^@^@?^C^@^@^B$137@10
@avor-abb113???\??^A^@^@?^A^B^@^BH0186bf9c-53d8-4ec1-ae0b-3f9f6c98c4f4^Rundefined^B?8?>^B^FSIC

consumer group exit :explanation

[Kafka Life]

Dear kafka Experts

Could one of you please help to explain what this below log in broker
instance mean..and what scenarios it would occur when there is no change
done .

 INFO [GroupCoordinator 9610]: Member
webhooks-retry-app-840d3107-833f-4908-90bc-ea8c394c07c3-StreamThread-2-consumer-f87c3b85-5aa1-40f5-a42f-58927421b89e
in group webhooks-retry-app has failed, removing it from the group
(kafka.coordinator.group.GroupCoordinator)


 INFO [GroupCoordinator 9611]: Member
cm.consumer.9-d65d39d3-703f-408b-bf4b-fbf087321d8c in group
cm_group_apac_sy_cu_01 has failed, removing it from the group
(kafka.coordinator.group.GroupCoordinator)


Please help to explain .

thanks

Zookeeper : Throttling connections

[Kafka Life]

Dear KAFKA & Zookeeper experts.

1/ What is zookeeper Throttling ? Is it done at zookeepr ? How is it set
configured ?
2/ Is it helpful ?

Re: Zookeeper : Throttling connections

[Kafka Life]

Thank you very much Mr. Israel Ekpo. Really appreciate it.

We are using the 0.10 version of kafka and in the process of upgrading to
2.6.1 . Planning in process and Yes, these connections to zookeepers are
for Kafka functionality.

frequently there are incidents where zookeepers get bombarded with around
8,000 to 10,000 connections from multiple clients.
Do you suggest we can configure globalOutstandingLimit to 8000 ?
should this be set in zoo.cfg file in Zookeeper ?


On Fri, Jul 16, 2021 at 7:11 PM Israel Ekpo  wrote:

> Hello,
>
> I am assuming you are using Zookeeper because of your Kafka brokers. What
> version of Kafka are you using.
>
> I would like to start by stating that very soon this will no longer be an
> issue as the project is taking steps to decouple Kafka from Zookeeper. Take
> a look at KIP-500 for additional information. In Kafka 2.8.0 you should be
> able to configure the early access version of running Kafka without
> Zookeeper.
>
> When running Kafka in KRaft Mode (Without Zookeeper) you do not need to
> worry about this throttling since Zookeeper is not part of the
> architecture.
>
> To answer you questions, some changes were made to prevent Zookeeper from
> getting overwhelmed hence to avoid recurring crashes during stressful loads
> restrictions can be configured to manage the load on Zookeeper via the
> throttling settings
>
> https://issues.apache.org/jira/plugins/servlet/mobile#issue/ZOOKEEPER-3243
>
> You should be able to see additional information in the administration
> guides on how this is configured
>
> https://zookeeper.apache.org/doc/r3.2.2/zookeeperAdmin.html
>
> For example, the configuration setting below
>
> globalOutstandingLimit
>
> (Java system property: *zookeeper.globalOutstandingLimit.*)
>
> Clients can submit requests faster than ZooKeeper can process them,
> especially if there are a lot of clients. To prevent ZooKeeper from running
> out of memory due to queued requests, ZooKeeper will throttle clients so
> that there is no more than globalOutstandingLimit outstanding requests in
> the system. The default limit is 1,000.
>
> I hope this gets you started
>
> Feel free to reach out if you have additional questions
>
> Have a great day
>
>
> On Fri, Jul 16, 2021 at 7:44 AM Kafka Life  wrote:
>
> > Dear KAFKA & Zookeeper experts.
> >
> > 1/ What is zookeeper Throttling ? Is it done at zookeepr ? How is it set
> > configured ?
> > 2/ Is it helpful ?
> >
>

Apache Kafka : start up scripts

[Kafka Life]

Dear Kafka experts

when an broker is started using start script , could any of you please let
me know the sequence of steps that happens in the back ground when the node
UP

like : when the script is initiated to start ,
1/ is it checking indexes .. ?
2/ is it checking isr ?
3/ is URP being made to zero.. ?

i tried to look in ther server log but could not under the sequence of
events  performed till the node was up .. could some one please help ..

Thanks

New Kafka Consumer : unknown member id

[Kafka Life]

Dear Kafka Experts

We have set up a group.id (consumer ) = YYY
But when tried to connect to kafka instance : i get this error message. I
am sure this consumer (group id does not exist in kafka) .We user plain
text protocol to connect to kafka 2.8.0. Please suggest how to resolve this
issue.

DEBUG AbstractCoordinator:557 - [Consumer clientId=X, groupId=YYY]
Attempt to join group failed due to unknown member id.

Re: New Kafka Consumer : unknown member id

[Kafka Life]

Hello Luke

i have build a new kafka environment with kafka 2.8.0

the consumer is a new consumer set up to this environment is throwing the
below error... the old consumers for the same applications for the same
environment -2.8.0 is working fine.. .

could you please advise

2021-11-02 12:25:24 DEBUG AbstractCoordinator:557 - [Consumer
clientId=, groupId=] Attempt to join group failed due to unknown
member id.

On Fri, Oct 29, 2021 at 7:36 AM Luke Chen  wrote:

> Hi,
> Which version of kafka client are you using?
> I can't find this error message in the source code.
> When googling this error message, it showed the error is in Kafka v0.9.
>
> Could you try to use the V3.0.0 and see if that issue still exist?
>
> Thank you.
> Luke
>
> On Thu, Oct 28, 2021 at 11:15 PM Kafka Life 
> wrote:
>
> > Dear Kafka Experts
> >
> > We have set up a group.id (consumer ) = YYY
> > But when tried to connect to kafka instance : i get this error message. I
> > am sure this consumer (group id does not exist in kafka) .We user plain
> > text protocol to connect to kafka 2.8.0. Please suggest how to resolve
> this
> > issue.
> >
> > DEBUG AbstractCoordinator:557 - [Consumer clientId=X,
> groupId=YYY]
> > Attempt to join group failed due to unknown member id.
> >
>

Automation Script : Kafka topic creation

[Kafka Life]

Dear Kafka experts

does anyone have ready /automated script to create /delete /alter topics in
different environments?
taking Configuration parameter as input .

if yes i request you to kindly share it with me .. please

Re: Automation Script : Kafka topic creation

[Kafka Life]

Thank you Men and Ran



On Sat, Nov 6, 2021 at 7:23 PM Men Lim  wrote:

> I'm currently using Kafka-gitops.
>
> On Sat, Nov 6, 2021 at 3:35 AM Kafka Life  wrote:
>
> > Dear Kafka experts
> >
> > does anyone have ready /automated script to create /delete /alter topics
> in
> > different environments?
> > taking Configuration parameter as input .
> >
> > if yes i request you to kindly share it with me .. please
> >
>

Kafka : High avaialability settings

[Kafka Life]

Dear Kafka experts

i have a 10 broker kafka cluster with all topics having replication factor
as 3 and partition 50

min.in.synch replicas is 2.


One broker went down for a hardware failure, but many applications
complained they are not able to produce /consume messages.

I request you to please suggest, how do i overcome this problem and make
kafka high available even during broker being down or during rolling
restarts.

IS there a configuration at a topic level i can set it up to have new
partition created in active and running brokers when a node is down ?
i read through ack -0/1/all to be set at application /producer end .But
applications are not ready to change ack all .
Can you please suggest .

many thanks in advance

Mirror Maker Issue : Huge difference in topic size on disk

[Kafka Life]

Dear Kafka Experts , Need your advice please

I am running a mirror maker in kafka 2.8 to replicate a topic from kafka
0.11 instance.
The size of each partition for a topic on 0.11 is always in 5 to 6 GB but
the replicated topic in 2.8 instances is in 40 GB for the same partition.

The topic configuration in terms of retention, topic partition max size is
same across both the instances. Is there any issue with MM on 2.8 kafka or
any other pointers to look at please.

Many thanks in advance .

KAFKA- UNDER_REPLICATED_PARTIONS - AUTOMATE

[Kafka Life]

Dear Kafka Experts

Does anyone have a dynamically generated Json file based on the Under
replicated partition in the kafka cluster.
Everytime when the URP is increased to over 500 , it is a tedious job to
manually create a Json file .

I request you to share any such dynamically generated script /json file.

Thanks in advance.

>

Re: KAFKA- UNDER_REPLICATED_PARTIONS - AUTOMATE

[Kafka Life]

Dear Experts

do you have any solution for this please

On Tue, Feb 22, 2022 at 8:31 PM Kafka Life  wrote:

> Dear Kafka Experts
>
> Does anyone have a dynamically generated Json file based on the Under
> replicated partition in the kafka cluster.
> Everytime when the URP is increased to over 500 , it is a tedious job to
> manually create a Json file .
>
> I request you to share any such dynamically generated script /json file.
>
> Thanks in advance.
>
>>

Re: KAFKA- UNDER_REPLICATED_PARTIONS - AUTOMATE

[Kafka Life]

Thank you Malcolm. Will go through this.

On Sat, Feb 26, 2022 at 2:22 AM Malcolm McFarland 
wrote:

> Maybe this could help?
> https://github.com/dimas/kafka-reassign-tool
>
> Cheers,
> Malcolm McFarland
> Cavulus
>
>
> On Fri, Feb 25, 2022 at 9:00 AM Kafka Life  wrote:
>
> > Dear Experts
> >
> > do you have any solution for this please
> >
> > On Tue, Feb 22, 2022 at 8:31 PM Kafka Life 
> wrote:
> >
> > > Dear Kafka Experts
> > >
> > > Does anyone have a dynamically generated Json file based on the Under
> > > replicated partition in the kafka cluster.
> > > Everytime when the URP is increased to over 500 , it is a tedious job
> to
> > > manually create a Json file .
> > >
> > > I request you to share any such dynamically generated script /json
> file.
> > >
> > > Thanks in advance.
> > >
> > >>
> >
>

HACKING vulnerability is SpringBoot (Java) for apache kafka

[Kafka Life]

Hi Kafka Experts

Regarding the recent threat of vulnerability in spring framework ,
CVE-2022-22965 vulnerability is SpringBoot (Java) for apache kafka and
Zookeeper. Could one of you suggest how Apache kafka and zk are impacted
and what should be the ideal fix for this .

Vulnerability in the Spring Framework (CVE-2022-22965) | Information
Security Office (berkeley.edu)


Critical alert – Spring4Shell RCE (CVE-2022-22965 in Spring) | Acunetix



Thanks in advance

Re: HACKING vulnerability is SpringBoot (Java) for apache kafka

[Kafka Life]

Dear Luke , Thank you for your kind and prompt response.


On Mon, Apr 4, 2022 at 1:23 PM Luke Chen  wrote:

> Hi,
>
> The impact for the CVE-2022-22965? Since this is a RCE vulnerability, which
> means the whole system (including Kafka and ZK) is under the attackers'
> control, and can do whatever they want.
>
> The ideal fix for this is to upgrade Spring Framework 5.3.18 and 5.2.20 or
> greater. Alternatively, you can have workarounds:
> 1. Upgrading Tomcat
> 2. Downgrading to Java 8
> 3. Disallowed Fields
>
> I think this blog from Spring community is very clear:
> https://spring.io/blog/2022/03/31/spring-framework-rce-early-announcement
>
> Thank you.
> Luke
>
> On Mon, Apr 4, 2022 at 3:32 PM Kafka Life  wrote:
>
> > Hi Kafka Experts
> >
> > Regarding the recent threat of vulnerability in spring framework ,
> > CVE-2022-22965 vulnerability is SpringBoot (Java) for apache kafka and
> > Zookeeper. Could one of you suggest how Apache kafka and zk are impacted
> > and what should be the ideal fix for this .
> >
> > Vulnerability in the Spring Framework (CVE-2022-22965) | Information
> > Security Office (berkeley.edu)
> > <
> >
> https://security.berkeley.edu/news/vulnerability-spring-framework-cve-2022-22965
> > >
> >
> > Critical alert – Spring4Shell RCE (CVE-2022-22965 in Spring) | Acunetix
> > <
> >
> https://www.acunetix.com/blog/web-security-zone/critical-alert-spring4shell-rce-cve-2022-22965-in-spring/
> > >
> >
> >
> > Thanks in advance
> >
>

Consumer Lag-Apache_kafka_JMX metrics

[Kafka Life]

Dear Kafka Experts
we need to monitor the consumer lag in kafka clusters 2.5.1 and 2.8.0
versions of kafka in Grafana.

1/ What is the correct path for JMX metrics to evaluate Consumer Lag in
kafka cluster.

2/ I had thought it is FetcherLag  but it looks like it is not as per the
link below.
https://www.instaclustr.com/support/documentation/kafka/monitoring-information/fetcher-lag-metrics/#:~:text=Aggregated%20Fetcher%20Consumer%20Lag%20This%20metric%20aggregates%20lag,in%20sync%20with%20partitions%20that%20it%20is%20replicating
.

Could one of you experts please guide on which JMX i should use for
consumer lag apart from kafka burrow or such intermediate tools

Thanking you in advance

Re: Consumer Lag-Apache_kafka_JMX metrics

[Kafka Life]

Hello Experts, Any info or pointers on my query please.



On Mon, Aug 15, 2022 at 11:36 PM Kafka Life  wrote:

> Dear Kafka Experts
> we need to monitor the consumer lag in kafka clusters 2.5.1 and 2.8.0
> versions of kafka in Grafana.
>
> 1/ What is the correct path for JMX metrics to evaluate Consumer Lag in
> kafka cluster.
>
> 2/ I had thought it is FetcherLag  but it looks like it is not as per the
> link below.
>
> https://www.instaclustr.com/support/documentation/kafka/monitoring-information/fetcher-lag-metrics/#:~:text=Aggregated%20Fetcher%20Consumer%20Lag%20This%20metric%20aggregates%20lag,in%20sync%20with%20partitions%20that%20it%20is%20replicating
> .
>
> Could one of you experts please guide on which JMX i should use for
> consumer lag apart from kafka burrow or such intermediate tools
>
> Thanking you in advance
>
>

Re: Consumer Lag-Apache_kafka_JMX metrics

[Kafka Life]

Thank you Sunil ,Peter Raph and Richard for your kind inputs.Much
appreciated.

On Wed, Aug 17, 2022 at 6:46 AM sunil chaudhari 
wrote:

> You can try this, if you know what prometheus and how its installed
> configured.
>
>
> https://www.confluent.io/blog/monitor-kafka-clusters-with-prometheus-grafana-and-confluent/
>
>
> On Wed, 17 Aug 2022 at 2:25 AM, Peter Bukowinski  wrote:
>
> > Richard recently answered your query. A kafka cluster does not keep track
> > of lag on behalf of external consumers and it therefore is not available
> in
> > JMX. This is why tools like Burrow were written. The java kafka consumer
> > published consumer lag metrics, and perhaps some other third-party
> clients
> > do, as well.
> >
> > > On Aug 16, 2022, at 12:05 PM, Kafka Life 
> wrote:
> > >
> > > Hello Experts, Any info or pointers on my query please.
> > >
> > >
> > >
> > > On Mon, Aug 15, 2022 at 11:36 PM Kafka Life 
> > wrote:
> > >
> > >> Dear Kafka Experts
> > >> we need to monitor the consumer lag in kafka clusters 2.5.1 and 2.8.0
> > >> versions of kafka in Grafana.
> > >>
> > >> 1/ What is the correct path for JMX metrics to evaluate Consumer Lag
> in
> > >> kafka cluster.
> > >>
> > >> 2/ I had thought it is FetcherLag  but it looks like it is not as per
> > the
> > >> link below.
> > >>
> > >>
> >
> https://www.instaclustr.com/support/documentation/kafka/monitoring-information/fetcher-lag-metrics/#:~:text=Aggregated%20Fetcher%20Consumer%20Lag%20This%20metric%20aggregates%20lag,in%20sync%20with%20partitions%20that%20it%20is%20replicating
> > >> .
> > >>
> > >> Could one of you experts please guide on which JMX i should use for
> > >> consumer lag apart from kafka burrow or such intermediate tools
> > >>
> > >> Thanking you in advance
> > >>
> > >>
> >
> >
>

Kafka Cluster WITHOUT Zookeeper

[Kafka Life]

Hello  Kafka experts

Is there a way where we can have Kafka Cluster be functional serving
producers and consumers without having Zookeeper cluster manage the
instance .

Any particular version of kafka for this or how can we achieve this please

Apache Kafka version - End of support

[Kafka Life]

Hello Kafka experts

where can i see the end of support for apache kafka versions? i would like
to know about 0.11 Kafka version on when was this deprecated

Apache Kafka version - End of support

[Kafka Life]

>
>
> Hello Kafka experts
>
> where can i see the end of support for apache kafka versions? i would like
> to know about 0.11 Kafka version on when was this deprecated
>

Re: Apache Kafka version - End of support

[Kafka Life]

Many thanks Joseph for your response

On Mon, Mar 27, 2023 at 4:50 PM Josep Prat 
wrote:

> Hello there,
>
> You can find the general policy here:
>
> https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan#TimeBasedReleasePlan-WhatIsOurEOLPolicy
>
> Basically, the last 3 releases are covered and one can upgrade to the
> latest version from the last previous 3. Bug fixes are ported to the last 3
> versions on a 'best effort basis'. Current latest release is 3.4.0.
> Version 0.11 reached "end of support" (or EOL) a long time ago.
>
> Hope this helps,
>
> On Mon, Mar 27, 2023 at 12:44 PM Kafka Life 
> wrote:
>
> > >
> > >
> > > Hello Kafka experts
> > >
> > > where can i see the end of support for apache kafka versions? i would
> > like
> > > to know about 0.11 Kafka version on when was this deprecated
> > >
> >
>
>
> --
> [image: Aiven] <https://www.aiven.io>
>
> *Josep Prat*
> Open Source Engineering Director, *Aiven*
> josep.p...@aiven.io   |   +491715557497
> aiven.io <https://www.aiven.io>   |   <https://www.facebook.com/aivencloud
> >
>   <https://www.linkedin.com/company/aiven/>   <
> https://twitter.com/aiven_io>
> *Aiven Deutschland GmbH*
> Alexanderufer 3-7, 10117 Berlin
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> Amtsgericht Charlottenburg, HRB 209739 B
>

Re: Kafka Cluster WITHOUT Zookeeper

[Kafka Life]

This is really great information Paul . Thank you .

On Tue, Mar 28, 2023 at 4:01 AM Brebner, Paul
 wrote:

> I have a recent 3 part blog series on Kraft (expanded version of ApacheCon
> 2022 talk):
>
>
>
>
> https://www.instaclustr.com/blog/apache-kafka-kraft-abandons-the-zookeeper-part-1-partitions-and-data-performance/
>
>
> https://www.instaclustr.com/blog/apache-kafka-kraft-abandons-the-zookeeper-part-2-partitions-and-meta-data-performance/
>
>
> https://www.instaclustr.com/blog/apache-kafka-kraft-abandons-the-zookeeper-part-3-maximum-partitions-and-conclusions/
>
>
>
> Regards, Paul
>
>
>
> *From: *Chia-Ping Tsai 
> *Date: *Monday, 27 March 2023 at 5:37 pm
> *To: *d...@kafka.apache.org 
> *Cc: *users@kafka.apache.org ,
> mmcfarl...@cavulus.com , Israel Ekpo <
> israele...@gmail.com>, ranlupov...@gmail.com ,
> scante...@gmail.com , show...@gmail.com <
> show...@gmail.com>, sunilmchaudhar...@gmail.com <
> sunilmchaudhar...@gmail.com>
> *Subject: *Re: Kafka Cluster WITHOUT Zookeeper
>
> *NetApp Security WARNING*: This is an external email. Do not click links
> or open attachments unless you recognize the sender and know the content is
> safe.
>
>
>
> hi
>
>
>
> You can use the keyword “kraft” to get the answer by google or chatgpt.
> For example:
>
>
>
> Introduction:
>
> KRaft - Apache Kafka Without ZooKeeper
> <https://developer.confluent.io/learn/kraft/>
>
> developer.confluent.io <https://developer.confluent.io/learn/kraft/>
>
>
>
>
>
> QuickStart:
>
> Apache Kafka <https://kafka.apache.org/quickstart>
>
> kafka.apache.org <https://kafka.apache.org/quickstart>
>
>
>
>
>
> —
>
> Chia-Ping
>
>
>
>
>
>
>
> Kafka Life  於 2023年3月27日 下午1:33 寫道：
>
> Hello  Kafka experts
>
> Is there a way where we can have Kafka Cluster be functional serving
> producers and consumers without having Zookeeper cluster manage the
> instance .
>
> Any particular version of kafka for this or how can we achieve this please
>
>

Kafka (apache or confluent) - Subject of Work (SOW)

[Kafka Life]

Respected Kafka experts/managers

Do anyone have Subject of work -Activities related to Kafka cluster
management for Apache or Confluent kafka . Something to assess and propose
to an enterprise for kafka cluster management. Request you to kindly share
any such documentation please.

Re: Kafka (apache or confluent) - Subject of Work (SOW)

[Kafka Life]

Hi experts.. any pointers or guidance for this

On Wed, Apr 5, 2023 at 8:35 PM Kafka Life  wrote:

> Respected Kafka experts/managers
>
> Do anyone have Subject of work -Activities related to Kafka cluster
> management for Apache or Confluent kafka . Something to assess and propose
> to an enterprise for kafka cluster management. Request you to kindly share
> any such documentation please.
>

Kafka Metrics to Grafana Labs

[Kafka Life]

Hello Kafka Experts

Need a help . Currently the grafana agent
triggering kafka/3.2.3/config/kafka_metrics.yml is sending over 5 thousand
metrics. Is there a way to limit these many metrics to be sent and send
only what is required .Any pointers or such customized script is much
appreciated.kafka/3.2.3/config/kafka_metrics.yml
kafka/3.2.3/config/kafka_metrics.ymlkafka/3.2.3/config/kafka_metrics.yml

Re: Kafka Metrics to Grafana Labs

[Kafka Life]

Any help from these experts ?

On Sat, Apr 8, 2023 at 2:23 PM Kafka Life  wrote:

> Hello Kafka Experts
>
> Need a help . Currently the grafana agent
> triggering kafka/3.2.3/config/kafka_metrics.yml is sending over 5 thousand
> metrics. Is there a way to limit these many metrics to be sent and send
> only what is required .Any pointers or such customized script is much
> appreciated.kafka/3.2.3/config/kafka_metrics.yml
> kafka/3.2.3/config/kafka_metrics.ymlkafka/3.2.3/config/kafka_metrics.yml
>

Zookeeper upgrade 3.4.14 to 3.5.7

[Kafka Life]

Hi Kafka , zookeeper experts

Is it possible to upgrade the 3.4.14 version of zookeeper cluster in a
rolling fashion (one by one node) to 3.5.7 zookeeper version. Would the
cluster work with a possible combination of 3.4.14 and 3.5.7 . Please
advise .

Consumer Lag Metrics/ Topic level metrics

[Kafka Life]

Dear Kafka Experts

Could you please suggest good metrics exporter for consumer lag and topic
level metrics apart from Linkedin kafka burrow for the kafka broker cluster.

Re: Consumer Lag Metrics/ Topic level metrics

[Kafka Life]

Many thanks Samuel. Will go thru this.

On Tue, Apr 25, 2023 at 9:03 PM Samuel Delepiere <
samuel.delepi...@celer-tech.com> wrote:

> Hi,
>
> I use a combination of the Prometheus JMX exporter (
> https://github.com/prometheus/jmx_exporter) and the Prometheus Kafka
> exporter (https://github.com/danielqsj/kafka_exporter).
> The consumer lag metrics come from the latter.
>
> I can then output the data in Grafana
>
>
> Regards,
>
> Sam.
>
>
>
> On 25 Apr 2023, at 16:26, Kafka Life  wrote:
>
> Dear Kafka Experts
>
> Could you please suggest good metrics exporter for consumer lag and topic
> level metrics apart from Linkedin kafka burrow for the kafka broker
> cluster.
>
>
>
> *This message, including any attachments, may include private, privileged
> and confidential information and is intended only for the personal and
> confidential use of the intended recipient(s). If the reader of this
> message is not an intended recipient, you are hereby notified that any
> review, use, dissemination, distribution, printing or copying of this
> message or its contents is strictly prohibited and may be unlawful. If you
> are not an intended recipient or have received this communication in error,
> please immediately notify the sender by telephone and/or a reply email and
> permanently delete the original message, including any attachments, without
> making a copy.*
>

Consumer offset value -Apache kafka 3.2.3

[Kafka Life]

Dear Kafka Experts

How can we check for a particular offset number in Apache kafka 3.2.3
version.Could you please share some light.
The kafka_console_consumer tool is throwing class not found error.

./kafka-run-class.sh kafka.tools.ConsumerOffsetChecker
--topic your-topic
--group your-consumer-group
--zookeeper localhost:2181

Kafka capabilities

[Kafka Life]

Hi Kafka users

Does any one have a document or ppt that showcases the capabilities of
Kafka along with any cost management capability?
i have a customer who is still using IBM MQM and rabbit MQ. I want the
client to consider kafka for messaging and data streaming. I wanted to seek
your expert help if you have any document or ppt i can propose it as an
example. could you pls help.

thanks and regards
KrisG

Re: Kafka capabilities

[Kafka Life]

Dear Kafka experts , Could anyone having this data share the details please

On Wed, Apr 3, 2024 at 3:42 PM Kafka Life  wrote:

> Hi Kafka users
>
> Does any one have a document or ppt that showcases the capabilities of
> Kafka along with any cost management capability?
> i have a customer who is still using IBM MQM and rabbit MQ. I want the
> client to consider kafka for messaging and data streaming. I wanted to seek
> your expert help if you have any document or ppt i can propose it as an
> example. could you pls help.
>
> thanks and regards
> KrisG
>