Re: zookeeper not starting

2023-05-12 Thread Brian @ Rickabaugh.Net
Lemi, You screenshots are not passing through the distribution list. Would you be able to paste the text from the terminal into your message? Brian > On May 12, 2023, at 9:27 PM, Lemi Odidi wrote: > >  > Hello I need help in troubleshooting why the zookeeper is not starting on my > AWS

Broken Cluster after Updating to Version 3.3.1

2023-05-12 Thread Strebin, Lennart
Hello Kafka Team, we are currently trying to update our Kafka Cluster (3 Nodes with ZK) from Version 3.2.3 to Version 3.3.1. After starting the broker with the new binaries we get the following log output and the 3 brokers are not able to connect to each other: DEBUG

zookeeper not starting

2023-05-12 Thread Lemi Odidi
Hello I need help in troubleshooting why the zookeeper is not starting on my AWS kafka instance. What are the possible reasons. The instance is a CentOS linux. [image: image.png] [image: image.png] How do I get it to start? Regards, Lemi About Ascential plc Ascential delivers specialist

Re: Some questions on Kafka on order of messages with mutiple partitions

2023-05-12 Thread Lemi Odidi
zookeeper not starting, what could be the problem see screen shots below [image: image.png] [image: image.png] Please Help! On Fri, May 12, 2023 at 1:47 PM Matthias J. Sax wrote: > This email was sent from an external source so please treat with caution. > > > Does having 9

Re: Some questions on Kafka on order of messages with mutiple partitions

2023-05-12 Thread Mich Talebzadeh
My bad. Only need 3 partitions { "version":1, "partitions":[ {"topic":"md","partition":0,"replicas":[12,10,8,2,9,11,1,7,3]}, {"topic":"md","partition":1,"replicas":[9,8,2,12,11,1,7,3,10]}, {"topic":"md","partition":2,"replicas":[11,2,12,9,1,7,3,10,8]} ] } Mich Talebzadeh, Lead Solutions

Re: Some questions on Kafka on order of messages with mutiple partitions

2023-05-12 Thread Mich Talebzadeh
This json file seemed to work cat reduce_replication_factor.json { "version":1, "partitions":[ {"topic":"md","partition":0,"replicas":[12,10,8,2,9,11,1,7,3]}, {"topic":"md","partition":1,"replicas":[9,8,2,12,11,1,7,3,10]}, {"topic":"md","partition":2,"replicas":[11,2,12,9,1,7,3,10,8]},

Re: Some questions on Kafka on order of messages with mutiple partitions

2023-05-12 Thread Mich Talebzadeh
Thanks Matthias. with regard to your point below: A replication factor of 9 sounds very high. For production, a replication factor of 3 is recommended. Is it possible to dynamically reduce this number to 3 when the topic is actively consumed)? *Disclaimer:* Use it at your own risk. Any and

Re: Some questions on Kafka on order of messages with mutiple partitions

2023-05-12 Thread Matthias J. Sax
Does having 9 partitions with 9 replication factors make sense here? A replication factor of 9 sounds very high. For production, replication factor of 3 is recommended. How many partitions you want/need is a different question, and cannot be answered in a general way. "Yes" to all other

Some questions on Kafka on order of messages with mutiple partitions

2023-05-12 Thread Mich Talebzadeh
Hi, I have used Apache Kafka in conjunction with Spark as a messaging source. This rather dated diagram describes it I have two physical hosts each 64 GB, running RHES 7.6, these are called rhes75 and rhes76 respectively. The Zookeeper version is 3.7.1 and kafka version is 3.4.0 [image: