Re: Is adding paritition disabled in 0.8.1?

2014-04-01 Thread Neha Narkhede
The docs on adding partitions is here - http://kafka.apache.org/documentation.html#basic_ops_modify_topic. Hopefully you find it useful, let us know how we can improve the docs. Thanks, Neha On Tue, Apr 1, 2014 at 5:53 PM, Libo Yu wrote: > Hi team, > > The following link introduces a script fo

Is adding paritition disabled in 0.8.1?

2014-04-01 Thread Libo Yu
Hi team, The following link introduces a script for adding a partition. https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-5.AddPartitionTool However, in the downloaded package, I did not find kafka-add-partitions.sh. Is it disabled? It is desirable to add partit

Re: kafka cluster behind a hardware load balancer

2014-04-01 Thread Jun Rao
The second step can't be done through a LB. The produce will have to connect to the right broker directly. We don't do request forwarding in the brokers. Also, I added https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowshouldIsetmetadata.broker.list? See if that answers your other questi

Re: Kafka Queue Depth Metrics

2014-04-01 Thread Arnaud Lawson
Ok thank you. Arnaud- On Tue, Apr 1, 2014 at 10:50 AM, Jun Rao wrote: > Search for MaxLag in http://kafka.apache.org/documentation.html#monitoring > . > Note that this is only available in 0.8.0 and above. > > Thanks, > > Jun > > > On Tue, Apr 1, 2014 at 7:21 AM, Arnaud Lawson >wrote: > > > T

Re: Kafka Queue Depth Metrics

2014-04-01 Thread Jun Rao
Search for MaxLag in http://kafka.apache.org/documentation.html#monitoring. Note that this is only available in 0.8.0 and above. Thanks, Jun On Tue, Apr 1, 2014 at 7:21 AM, Arnaud Lawson wrote: > Thanks Jun, > > So on the consumer side is the metric (measuring the # of messages a > consumer is

Re: Kafka Queue Depth Metrics

2014-04-01 Thread Arnaud Lawson
Thanks Jun, So on the consumer side is the metric (measuring the # of messages a consumer is behind) called getOffsetLag? Reference: https://cwiki.apache.org/confluence/display/KAFKA/Operations#Operations-Monitoring Arnaud- On Tue, Apr 1, 2014 at 12:16 AM, Jun Rao wrote: > We also have a me