Given your high throughput on the consumer side, you might consider adding
more partitions than 6, so you can scale up beyond 6 consumers per group if
need be.
Ryanne
On Wed, Jan 9, 2019 at 10:37 AM Gioacchino Vino
wrote:
> Hi Ryanne,
>
>
> I just forgot to insert the "linger.ms=0" configuratio
Hi Ryanne,
I just forgot to insert the "linger.ms=0" configuration.
I got this result:
5000 records sent, 706793.701055 records/sec (67.41 MB/sec), 7.29 ms
avg latency, 1245.00 ms max latency, 0 ms 50th, 3 ms 95th, 197 ms 99th,
913 ms 99.9th.
it's pretty good but I would like to impr
Latency sounds high to me, maybe your JVMs are GC'ing a lot?
Ryanne
On Tue, Jan 8, 2019, 11:45 AM Gioacchino Vino Hi expert,
>
>
> I would ask you some guidelines, web-pages or comments regarding my
> use-case.
>
>
> *Requirements*:
>
> - 2000+ producers
>
> - input rate 600k messages/s
>
> - co
Hi expert,
I would ask you some guidelines, web-pages or comments regarding my
use-case.
*Requirements*:
- 2000+ producers
- input rate 600k messages/s
- consumers must write in 3 different databases (so i assume 3 consumer
groups) at 600k messages/s overall (200k messages/s/database)
Thanks Guozhang Wang.
Hamza
De : Guozhang Wang
Envoyé : jeudi 4 août 2016 06:58:22
À : users@kafka.apache.org
Objet : Re: Re : A specific use case
Yeah, if you can buffer yourself in the process() function and then rely on
punctuate() for generating the
ang Wang"
> Pour : "users@kafka.apache.org"
> Objet : A specific use case
> Date : mer., août 3, 2016 23:38
>
> Hello Hamza,
>
> By saying "broker" I think you are actually referring to a Kafka Streams
> instance?
>
>
> Guozhang
>
> On Mon, Au
Hi,
Yes in fact .
And ï found à solution.
It was in editing the method punctuate in kafka stream processor.
- Message de réponse -
De : "Guozhang Wang"
Pour : "users@kafka.apache.org"
Objet : A specific use case
Date : mer., août 3, 2016 23:38
Hello Hamza,
By say
Hello Hamza,
By saying "broker" I think you are actually referring to a Kafka Streams
instance?
Guozhang
On Mon, Aug 1, 2016 at 1:01 AM, Hamza HACHANI
wrote:
> Good morning,
>
> I'm working on a specific use case. In fact i'm receiving messages from an
> o
Good morning,
I'm working on a specific use case. In fact i'm receiving messages from an
operator network and trying to do statistics on their number per
minute,perhour,per day ...
I would like to create a broker that receives the messages and generates a
message every minute. These
