rolling upgrade from 0.9 to 0.11

2018-03-05 Thread Sunil Parmar
of performance impact in production when done on scale. thoughts ? Sunil Parmar

Causes of partition leader re election

2018-02-12 Thread Sunil Parmar
lp us debug this partition leader re-election. Sunil Parmar

Re: monitor consumer offset lag script/code

2018-01-31 Thread Sunil Parmar
Thanks Kaufman .. Shubhash, We're using burrow but it has two issues. 1) The lag reported from command line tools and burrow is different often by big margin. 2) When consumer goes down it stops reporting the difference and shows constant value. Sunil Parmar On Tue, Jan 30, 2018 at 6:

monitor consumer offset lag script/code

2018-01-29 Thread Sunil Parmar
We're using 0.9 ( CDH ) and consumer offsets are stored within Kafka. What is the preferred way to get consumer offset from code or script for monitoring ? Is there any sample code/ script to do so ? Thanks, Sunil Parmar

Enable Kafka Authentication on 0.9

2018-01-18 Thread Sunil Parmar
something like LDAP. Thanks, Sunil Parmar

mirror maker producer thread dies with error

2018-01-11 Thread Sunil Parmar
this happens on the perticular day of the week but I coudln't locate any weekly scheduler in any configuration. Any pointers will be helpful Thanks, Sunil Parmar

Open file descriptors on a broker

2017-07-28 Thread Sunil Parmar
https://issues.apache.org/jira/browse/KAFKA-3619 which appears to found and fixed in 0.10. Can someone confirm if this is not an issue in 0.9. Thanks, Sunil Parmar

Tuning up mirror maker for high thruput

2017-07-21 Thread Sunil Parmar
message handler still try to process the other topics but let it pass thru. Thanks, Sunil Parmar

mirroring Kafka while preserving the order

2017-06-28 Thread Sunil Parmar
Is it possible to configure mirror maker using message handler to preserve the order of messages in each topic partition. In the particular use case we're looking at both source and destination topics have same number of partitions. Sunil

Preserve offset in Mirror Maker

2016-08-03 Thread Sunil Parmar
We're using mirror maker to mirror data from one data center to another data center ( 1 to 1 ). We noticed that by default the mirror maker by default start from latest offset. How to change mirror maker producer config to start from last check pointed offset in case of crash without losing dat