Re: async producer callback not reliable

Make sure you have inflight requests set to 1 if you want ordered messages. Thanks, Mayuresh On Tue, Sep 8, 2015 at 5:55 AM, Damian Guy wrote: > Can you do: > producer.send(...) > ... > producer.send(...) > producer.flush() > > By the time the flush returns all of your

async producer callback not reliable

if i wanna send the message syncronously i can do as below: future=producer.send(producerRecord, callback); future.get(); but the throughput decrease dramatically; is there a method to send the messages by batch but synchronously ?

Re: async producer callback not reliable

Can you do: producer.send(...) ... producer.send(...) producer.flush() By the time the flush returns all of your messages should have been sent On 8 September 2015 at 11:50, jinxing wrote: > if i wanna send the message syncronously i can do as below: >

Re: Async Producer Callback

Also you can use the other API that returns a Future and save those futures into a list and do get() on them to check which message has been sent and which returned an error so that they can be retried. Thanks, Mayuresh On Thu, Mar 19, 2015 at 9:19 AM, Steven Wu stevenz...@gmail.com wrote: in

Re: Async Producer Callback

Yes. Thats right. I misunderstood, my bad. Thanks, Mayuresh On Thu, Mar 19, 2015 at 11:05 AM, sunil kalva sambarc...@gmail.com wrote: future returns RecordMetadata class which contains only metadata not the actual message. But i think *steven* had a point like saving the reference in impl

Re: Async Producer Callback

What kind of exceptions are caught and sent to callback method, i think when there is IOException callback is not called ? in NetworkClient.java class, from the following code snippet i dont think callback is called for this exaception ? try { this.selector.poll(Math.min(timeout,

Re: Async Producer Callback

in your callback impl object, you can save a reference to the actual message. On Wed, Mar 18, 2015 at 10:45 PM, sunil kalva kalva.ka...@gmail.com wrote: Hi How do i access the actual message which is failed to send to cluster using Callback interface and onCompletion method. Basically if

Async Producer Callback

Hi How do i access the actual message which is failed to send to cluster using Callback interface and onCompletion method. Basically if the sender is failed to send, i want to add it to a temp queue and retry them later. --Sunil

Async producer callback?

Hi guys, So far, is there a way to track the asyn producer callback. My requirement is basically if all nodes of the topic goes down, can I pause the producer and after the broker comes back online, continue to produce from the failure point? Best, Siyuan

Re: Async producer callback?

We introduced callbacks in the new producer. It's only available in trunk though. Thanks, Jun On Tue, May 20, 2014 at 4:42 PM, hsy...@gmail.com hsy...@gmail.com wrote: Hi guys, So far, is there a way to track the asyn producer callback. My requirement is basically if all nodes of the