Which version of Kafka did you use? When you say latency, do you mean the latency between the producer and consumer? If so, are you using a timestamp within the message to compute this latency?
On Wed, Jun 18, 2014 at 8:15 AM, Magnus Edenhill <mag...@edenhill.se> wrote: > Hi, > > do these spikes happen to correlate with log.flush.interval.messages or > log.flush.interval.ms? > If so it's the file system sync blockage you are seeing. > > /Magnus > > > 2014-06-18 16:31 GMT+02:00 Supun Kamburugamuva <supu...@gmail.com>: > > > Hi, > > > > We are trying to evaluate Kafka for a real time application. We are > sending > > 50 Kb messages at a fixed rate. The normal messages have a reasonable > > latency. But then there are these outliers that takes unpredictable > amount > > of time. This causes the average latency to increase dramatically. We are > > running with basically the default configuration. Any suggestions for > > improving the latency? > > > > Thanks in advance, > > Supun.. > > > > -- > > Supun Kamburugamuva > > Member, Apache Software Foundation; http://www.apache.org > > E-mail: supu...@gmail.com; Mobile: +1 812 369 6762 > > Blog: http://supunk.blogspot.com > > >
