Producer/consumer JMX metrics

2017-06-14 Thread Tarun Garg
Hi, I stuck in a dump problem. it seems atleast like that. I have a collectd conf file ``` LoadPlugin java ObjectName "kafka.producer:type=producer-metrics,clientId=([-.\w]+)" InstancePrefix "all" InstancePrefix "kafka-producer-

Re: UNKNOWN_TOPIC_OR_PARTITION with SASL_PLAINTEXT ACL

2017-06-15 Thread Tarun Garg
Hi, This doesn't give any insite about the problem. please do two things first. 1. change the log level in config/log4j for authorization (i dont remeber exact property name but it is a buttom of the file) : this will give the broker log 2. change log level in config/tools-log4j file:

Re: ticketing system Design

2017-06-20 Thread Tarun Garg
need some more input on this. Kafka is a queue it doesn't take any action. sender(producer) sends data to kafka and consumer pulls data from kafka queue. so there is no assignment of data to any consumer. if a process/human cann't take any action then kafka cann't help in this case. hope it

consumer group offset lag

2017-07-25 Thread Tarun Garg
I am sending this mail to DEV because i think this is a bug in AdminClient while getting the group offset. Hi, I run through a issue. i am trying to get the status of a consumer group. for this i have consumer and producer with topic named test_7 with partition count 1. It is working fine. 1.

Kafka isync replica

2017-12-13 Thread Tarun Garg
Hi, I have a Kafka cluster and it is running from a long time, just today I realize that some of the topic partition are not in good state, there Isr is been reduced to 2 from 3 even though the node of the lost replica is working Like Topic: XYZ Partition 82 Leader: 1 Replicas:1,2,3 Isr:1,2 <

Re: Kafka isync replica

2017-12-14 Thread Tarun Garg
opic: XYZ Partition 82? Also > broker 3 is in isr for other partitions (at least 83,84) so I don't see any > broker issue in this. > > On Thu, 14 Dec 2017 at 01:23 Tarun Garg wrote: > >> Hi, >> >> I have a Kafka cluster and it is running from a long time,

Re: Kafka isync replica

2017-12-15 Thread Tarun Garg
d ? > > BTW which release of Kafka are you using ? > > Cheers > > On Thu, Dec 14, 2017 at 11:49 AM, Tarun Garg wrote: > >> I checked log.dir of the all nodes and found index, log and time index >> files are in sync(size and date of modification). >> This