Thanks Peter.
This is my modified Json file
{
"version":1,
"partitions":[
{"topic":"md","partition":0,"replicas":[1,3,7]},
{"topic":"md","partition":1,"replicas":[2,8,9]},
{"topic":"md","partition":2,"replicas":[7,10,12]},
{"topic":"md","partition":3,"replicas":[1,12,9]},
It looks like you successfully removed replicas from partitions 0, 1, and 2,
but partitons 3 - 8 still show 9 replicas. You probably intended to remove them
from all 9 partitions? You’ll need to create another json file with partitions
3 - 8 to complete the task.
—
Peter
> On May 17, 2023,
Thanks Miguel, I did that
Based on the following Json file
{
"version":1,
"partitions":[
{"topic":"md","partition":0,"replicas":[1,3,7]},
{"topic":"md","partition":1,"replicas":[2,8,9]},
{"topic":"md","partition":2,"replicas":[7,10,12]}
]
}
I ran this command
kafka-reassign-partitions.sh
Hi Mich,
You can use the script `kafka-reassign-partitions.sh` to re-locate or
change the number of replicas
Regards
Miguel
El mar, 16 may 2023 a las 18:44, Mich Talebzadeh ()
escribió:
> Thanks Peter. I meant reduce replication from 9 to 3 and Not partitions.
> Apologies for any confusion
>
>
Thanks Peter. I meant reduce replication from 9 to 3 and Not partitions.
Apologies for any confusion
Cheers
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical
Mich,
It is not possible to reduce the number of partitions for a kafka topic without
deleting and recreating the topic. What previous responders to your inquiry
noted is that your topic replication of 9 is high. What you want to do is
reduce your replication, not the partitions. You can do
zookeeper not starting, what could be the problem see screen shots below
[image: image.png]
[image: image.png]
Please Help!
On Fri, May 12, 2023 at 1:47 PM Matthias J. Sax wrote:
> This email was sent from an external source so please treat with caution.
>
> > Does having 9
My bad. Only need 3 partitions
{
"version":1,
"partitions":[
{"topic":"md","partition":0,"replicas":[12,10,8,2,9,11,1,7,3]},
{"topic":"md","partition":1,"replicas":[9,8,2,12,11,1,7,3,10]},
{"topic":"md","partition":2,"replicas":[11,2,12,9,1,7,3,10,8]}
]
}
Mich Talebzadeh,
Lead Solutions
This json file seemed to work
cat reduce_replication_factor.json
{
"version":1,
"partitions":[
{"topic":"md","partition":0,"replicas":[12,10,8,2,9,11,1,7,3]},
{"topic":"md","partition":1,"replicas":[9,8,2,12,11,1,7,3,10]},
{"topic":"md","partition":2,"replicas":[11,2,12,9,1,7,3,10,8]},
Thanks Matthias.
with regard to your point below:
A replication factor of 9 sounds very high. For production, a replication
factor of 3 is recommended.
Is it possible to dynamically reduce this number to 3 when the topic is
actively consumed)?
*Disclaimer:* Use it at your own risk. Any and
Does having 9 partitions with 9 replication factors make sense here?
A replication factor of 9 sounds very high. For production, replication
factor of 3 is recommended.
How many partitions you want/need is a different question, and cannot be
answered in a general way.
"Yes" to all other
Hi,
I have used Apache Kafka in conjunction with Spark as a messaging source.
This rather dated diagram describes it
I have two physical hosts each 64 GB, running RHES 7.6, these are called
rhes75 and rhes76 respectively. The Zookeeper version is 3.7.1 and kafka
version is 3.4.0
[image:
12 matches
Mail list logo
