Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Thanks all for this. Las question around this. If I write scripts for topics, I am afraid it will change partitions for some default/internal system created topics which I don't want, In that Case, I guess, I have to filter topic list first and then provide it to the script... is that correct?

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Manoj.Agrawal2
Or if you don’t want to automate then , use the excel sheet and generate below command for all topic . Put all 350 statement in script and run it . On 6/21/20, 9:28 PM, "Peter Bukowinski" wrote: [External] You can’t use a wildcard and must address each topic individually. You can

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Liam Clarke-Hutchinson
Hi Sunil, You'd want to do a bit of shell scripting for this. for topic in $(./kafka-topics.sh --bootstrap-server your-kafka-here:9092 --list); do ./kafka-topics.sh --bootstrap-server your-kafka-here:9092 --topic $topic --partitions X --alter done Etc. etc. And yep, to make sure further auto c

RE: How to Change number of partitions without Rolling restart?

2020-06-21 Thread JOHN, BIBIN
Please execute by looping through your topic list. Change partition number based on your requirement. for topic in `kafka-topics --zookeeper localhost:2181 --list` ./bin/kafka-topics.sh --alter --zookeeper localhost:2181 --topic $topic --partition done -Original Message- From:

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Peter Bukowinski
You can’t use a wildcard and must address each topic individually. You can automate it with a for loop that takes an array/list of topics as the item to iterate over. -- Peter Bukowinski > On Jun 21, 2020, at 9:16 PM, sunil chaudhari > wrote: > > Manoj, > You mean I have execute this comman

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Manoj, You mean I have execute this command manually for all 350 Topics which I already have? Is there any possibility I can use any wild cards? On Mon, 22 Jun 2020 at 9:28 AM, wrote: > You can use below command to alter to partition > > ./bin/kafka-topics.sh --alter --zookeeper localhost:2181

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Manoj.Agrawal2
You can use below command to alter to partition ./bin/kafka-topics.sh --alter --zookeeper localhost:2181 --topic my-topic --partitions 6 Thanks Manoj On 6/21/20, 7:38 PM, "sunil chaudhari" wrote: [External] Hi, I already have 350 topics created. Please guide me how can I do

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Hi, I already have 350 topics created. Please guide me how can I do that for these many topics? Also I want each new topic to be created with more number partitions automatically than previous number 3, which I had set in properties. Regards, Sunil. On Mon, 22 Jun 2020 at 6:31 AM, Liam Clarke-Hut

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Liam Clarke-Hutchinson
Hi Sunil, The broker setting num.partitions only applies to automatically created topics (if that is enabled) at the time of creation. To change partitions for a topic you need to use kafka-topics.sh to do so for each topic. Kind regards, Liam Clarke-Hutchinson On Mon, Jun 22, 2020 at 3:16 AM s

ssl certificates

2020-06-21 Thread Harry k
Hi, We got SSL certificates renewed on 3 linux kafka servers.Can anyone please advice me how to install these new certificates. Thanks and regards, Harry.

Re: Consumer Group got stuck in CompletingRebalance

2020-06-21 Thread Karolis Pocius
Don't mean to resurrect an old thread, but in case you haven't found the answer, this sounds exactly like the issue I've encountered after upgrading to 2.4.0 It was caused by this https://issues.apache.org/jira/browse/KAFKA-9752 On Tue, Apr 14, 2020 at 10:08 AM James Brown wrote: > We had a con

How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Hi, I want to change number of partitions for all topics. How can I change that? Is it server.properties which I need to change? Then, in that case I have to restart broker right? I checked from confluent control center, there is no option to change partitions. Please advise. Regards, Sunil

Re: Highwater mark interpretation

2020-06-21 Thread Nag Y
Thanks Liam Clarke-Hutchinson for inputs. Yes, the case that i described is very rare as it is expected *like you mentioned already *the replica failures are transient and eventually caught up once they are back . And the kind of infrastructure we have today, this could eventually be supported by