We are using Kafka 0.7.1 and i believe replication isn't available for this version (correct me if i am wrong)...
Basically we want to be able to measure the rate of consumption for some particular topic and make sure that this rate is about the same as the rate of production for that topic. Which JMX metrics could be appropriate for this - for Kafka 0.7? Thanks. On Tue, Apr 29, 2014 at 4:28 PM, Bae, Jae Hyeon <metac...@gmail.com> wrote: > Are you using 0.8? BytesOut will include the traffic for replication. If > you have no consumer and replication factor is 2, BytesOut should be > exactly double of BytesIn. > > > On Tue, Apr 29, 2014 at 1:26 PM, Arnaud Lawson <arnaud.law...@velos.io > >wrote: > > > Hello, > > > > After graphing the cumulative values of Bytesin and Bytesout for one of > our > > Kafka topics, we've noticed that the Bytesout values are sometimes > greater > > than the Bytesin values. We are not really sure how this would be > possible > > if the max that a consumer can consume would be what has been put on the > > queue for that topic. Any explanations? Thanks. > > > > -- > > > > Arnaud Lawson > > , > > > > Systems Operations Engineer > > *VELOS* > > Accelerating Machine Learning. > > > > 440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001 > > C: (240) 393 - 6703 > > F: 646.349.4063 > > E: arnaud.law...@velos.io > > W: www.velos.io > > > -- Arnaud Lawson , Systems Operations Engineer *VELOS* Accelerating Machine Learning. 440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001 C: (240) 393 - 6703 F: 646.349.4063 E: arnaud.law...@velos.io W: www.velos.io
