there is a flush api of the producer, you can call this to prevent messages
lost;
maybe it can help;
At 2015-11-12 16:43:54, "Hawin Jiang" wrote:
>Hi Jinxing
>
>I don't think we can resolve this issue by increasing producers. if I
>increased more producers, it should lost more message
yes, increase producer will trigger more messages lost;
that's what I wanted to say;
At 2015-11-12 16:43:54, "Hawin Jiang" wrote:
>Hi Jinxing
>
>I don't think we can resolve this issue by increasing producers. if I
>increased more producers, it should lost more messages.
>
>I just test two
for example the issue can be as below:
from the producer side, say 1000 messages is sent, and no exception found from
the callback;
from the kafka broker side, the log size only increase 900;
as a result only 900 messages received from the consumer;
conclusion:
the problem is we cannot
