Re: Performance degradations

2020-09-16 Thread Ashutosh singh
st we simply accept 10% of the messages sent during this > time period and the rest are delayed and some of them can reach timeout. > > On Wed, Sep 16, 2020 at 1:30 PM Ashutosh singh wrote: > > > If the cluster is busy then it will have lots of data to rebalance once > the > > b

Re: Performance degradations

2020-09-16 Thread Ashutosh singh
> > We also try to increase broker nodes to 5 (rebalanced) and run with > https://kafka.apache.org/081/documentation.html#prodconfig and still see > ~35% performance degradation. > > Thanks in advance. > > Best regards, > Miroslav > -- Thanx & Regard Ashutosh Singh 08151945559

_consumer_offsets topic produce rate is dam high

2020-06-20 Thread Ashutosh singh
on here ? Any help will be appreciated. -- Thanx & Regard Ashutosh Singh 08151945559

Re: High write operations rate on disk

2020-05-16 Thread Ashutosh singh
> On Tue, Apr 7, 2020 at 11:59 AM Soumyajit Sahu < > > > > > soumyajit.s...@gmail.com > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > We are running Kafka on AWS EC2 instances (m5.2xlarge) with > > > mounted > > > > > EBS > > > > > > > st1 > > > > > > > > volume (one on each machine). > > > > > > > > Occasionally, we have noticed that the write ops/second goes > > > > through > > > > > > the > > > > > > > > roof and we get throttled by AWS while the data throughput > > > wouldn't > > > > > > have > > > > > > > > changed much. As far as our observation goes, it happens > usually > > > > > after > > > > > > a > > > > > > > > broker restart. > > > > > > > > > > > > > > > > Has anyone else come across this behavior? > > > > > > > > > > > > > > > > Thanks! > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > *Suman* > > > > > > > *OlaCabs* > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Seva Feldman > > > > > VP R Mobile Delivery > > > > > [image: ironSource] <http://www.ironsrc.com/> > > > > > > > > > > email sev...@ironsrc.com > > > > > mobile +972544346089 > > > > > > > > > > ironSource HQ - 121 Derech Menachem Begin st. Tel Aviv > > > > > > > > > > > > > > > > > -- > > > > *Suman* > > > > *OlaCabs* > > > > > > > > > > > > > -- > > Seva Feldman > > VP R Mobile Delivery > > [image: ironSource] <http://www.ironsrc.com/> > > > > email sev...@ironsrc.com > > mobile +972544346089 > > > > ironSource HQ - 121 Derech Menachem Begin st. Tel Aviv > -- Thanx & Regard Ashutosh Singh 08151945559

Re: User interface for kafka: Management/administration

2020-01-22 Thread Ashutosh singh
> > privileged, confidential and exempt from disclosure under applicable law. > > If the reader of this message is not the intended recipient, you are > hereby > > notified that any dissemination, distribution or copying of this > > communication is strictly prohibite

Re: Number of leader partitions per broker

2019-12-02 Thread Ashutosh singh
? > > > > Regards, > > Rodoljub > > > > Does the below answer your question (or, hints to what you seek)? > > https://cwiki.apache.org/confluence/display/KAFKA/Finding+Topic+and+Partition+Leader > > > Thanks, > -- Thanx & Regard Ashutosh Singh 08151945559

Kafka Consulting and Support

2019-11-26 Thread Ashutosh singh
Hi All, Can someone suggest excellent Kafka Consultation and Support service ? Any company which provide nice kafka support which you are already using and we can rely on them ? This is required of big tech company in Bangalore Region. Thanks Ashu

Re: Last Stable Offset (LSO) stuck for specific topic partition after Broker issues

2019-11-20 Thread Ashutosh singh
e the same stuck LSO, so I > don't think deleting will the partition will help? It will then restore the > partition from another in-sync replica but that also has the incorrect LSO? > > Best, > > Pieter > ------ > *Van:* Ashutosh singh > *Verzond

Re: Last Stable Offset (LSO) stuck for specific topic partition after Broker issues

2019-11-20 Thread Ashutosh singh
> > Thank you in advance for any advice. > > Best, > > Pieter > -- Thanx & Regard Ashutosh Singh 08151945559

Clients need restart after broker

2019-11-19 Thread Ashutosh singh
Greetings All, Appreciate if someone can help to address the issue. Every time when we restart any of the broker some of the clients are getting stuck for hours and do not produce or consume messages. we have 8 node cluster and replication factor is set 2 and 3 for few topics. We are in

Re: help for regarding my question

2019-11-15 Thread Ashutosh singh
Developer Advocate | ro...@confluent.io | @rmoff > > > On Thu, 14 Nov 2019 at 05:04, prashanth sri > wrote: > > > i am new to kafka , can any one help me , regarding my problem. > > > -- Thanx & Regard Ashutosh Singh 08151945559

Re: Partition Reassignment is getting stuck

2019-11-14 Thread Ashutosh singh
ns an offline directory . > > > > > > -Original Message- > > From: M. Manna > > Sent: Wednesday, November 13, 2019 5:23 AM > > To: Kafka Users > > Subject: Re: Partition Reassignment is getting stuck > > > > On Wed, 13 Nov 2019 at 13:10, A

Re: Partition Reassignment is getting stuck

2019-11-13 Thread Ashutosh singh
, Nov 13, 2019 at 6:23 PM M. Manna wrote: > On Wed, 13 Nov 2019 at 12:41, Ashutosh singh wrote: > > > Hi, > > > > All of a sudden I see under replicated partition in our Kafka cluster > and > > it is not getting replicated. It seems it is getting stuck somewher

Partition Reassignment is getting stuck

2019-11-13 Thread Ashutosh singh
Hi, All of a sudden I see under replicated partition in our Kafka cluster and it is not getting replicated. It seems it is getting stuck somewhere. In sync replica is missing only form one of the broker it seems there is some issue with that broker but other hand there are many others topic on

Re: How to list/stop all current partition assignment which is running

2019-11-07 Thread Ashutosh singh
ake a note of the list of > partitions (get /kafka.primary/admin/reassign_partitions ), I think you > need to manually move those partitions to healthy brokers. > > --Senthil > > On Fri, Nov 8, 2019 at 11:30 AM Ashutosh singh wrote: > > > Hello All, > > > > We ran

How to list/stop all current partition assignment which is running

2019-11-07 Thread Ashutosh singh
Hello All, We ran kafka partition reassignment is using kafka manager. It seems it is stuck somewhere. How can I check what is current assignment which is running and how can I stop it ? its been more that 12 hours and some of the partitions are under replicated. Really appreciate your help.

Re: How to enable RACK awareness on Already Running Kafka Cluster

2019-09-19 Thread Ashutosh singh
? > > > > I have searched everywhere but couldn't find any place where it says if > can > > do it while kafka cluster is in operation. > > > > I really appreciate if someone can help on this. > > > > > > -- > > Regard > > Ashu > > -- Thanx & Regard Ashutosh Singh 08151945559

How to enable RACK awareness on Already Running Kafka Cluster

2019-09-19 Thread Ashutosh singh
Greetings, We have 8 nodes Brokers setup on AWS in 2 availability zones with 2 replication. Our plan is to add one more node and distribute 3 nodes in each AZ and change replication factor to 3. In order to replicate data in each AZ we need to enable Rack awareness. Can someone guide how can I