Re: Re: when will the messsages be sent to broker

2017-03-01 Thread Yuanjia
. Yuanjia Li From: Matthias J. Sax Date: 2017-03-02 13:11 To: users Subject: Re: when will the messsages be sent to broker That's weird. If batch.size=0 and linger.ms=0 records should get send out immediately. buffer.memory is an upper bound for the overall memory. If you write to multiple parti

Re: when will the messsages be sent to broker

2017-03-01 Thread Matthias J. Sax
> Thanks. > > Yuanjia Li > > From: Matthias J. Sax > Date: 2017-03-02 01:42 > To: users > Subject: Re: when will the messsages be sent to broker > There is also linger.ms parameter that is an upper bound how long a (not > yet filled) buffer is hold before sending it

Re: Re: when will the messsages be sent to broker

2017-03-01 Thread Yuanjia
ory=0? Thanks. Yuanjia Li From: Matthias J. Sax Date: 2017-03-02 01:42 To: users Subject: Re: when will the messsages be sent to broker There is also linger.ms parameter that is an upper bound how long a (not yet filled) buffer is hold before sending it even if it's not full. Furthermore, you c

Re: when will the messsages be sent to broker

2017-03-01 Thread Matthias J. Sax
There is also linger.ms parameter that is an upper bound how long a (not yet filled) buffer is hold before sending it even if it's not full. Furthermore, you can do sync writes and block until producer received all acks. But it might have a performance penalty. http://docs.confluent.io/current/cl

Re: when will the messsages be sent to broker

2017-03-01 Thread Kaufman Ng
By default producer batches records (into a buffer) until batch.size is reached, then records will be sent out. Try lowering batch.size in your producer config. You might want to look at the producer javadoc here: http://kafka.apache.org/0102/javadoc/index.html?org/apache/kafka/clients/producer/K

when will the messsages be sent to broker

2017-03-01 Thread Yuanjia
Hi all, When will the messsages be sent in kafka0.10.0?If I use KafkaProducer.send to send one message, the messsages isn't sent immediately except invoke flush or close. Thanks. Yuanjia Li