Hi Jinxing
I am using kafka_2.10-0.9.0.0-SNAPSHOT. I have downloaded source code and
installed it last week.
I saw 97446 messages have been sent to kafka successfully.
So far, I have not found any failed messages.
Best regards
Hawin
On Thu, Nov 12, 2015 at 12:07 AM, jinxing <jinxing6...@126.com> wrote:
> Hi, what version are you using ?
>
>
> i am using 0.8.2.0, and I encountered this problem before;
>
>
> it seems that if the message rate of the producer side is to high, some of
> the messages will lost;
>
>
> also, i found that the callback method of the producer 'send' API is not
> reliable;
>
>
> only successful sent message will trigger the callback, but the failed
> ones don't;
>
>
> you saw this?
>
>
>
>
>
>
>
>
> At 2015-11-12 16:01:17, "Hawin Jiang" <hawin.ji...@gmail.com> wrote:
> >Hi All
> >
> >I have sent messages to Kafka for one minute. I found 97446 messages in
> >producer side and 96896 messages in consumer side for Case 1.
> >I also tried case 2. I have faced the same issues. The number is not
> match
> >between producer and consumer.
> >Can someone take a look at this issue?
> >Thanks.
> >
> >
> >Case 1:
> >
> >long startTime = System.currentTimeMillis();
> >long maxDurationInMilliseconds = 1 * 60 * 1000;
> >int messageNo = 0;
> >while (true) {
> >if (System.currentTimeMillis() <= startTime
> >+ maxDurationInMilliseconds) {
> >messageNo++;
> >String messageStr = "KAFKA_"+messageNo;
> >System.out.println("Message: "+messageNo);
> >producer.send(new KeyedMessage<Integer, String>(topic,messageStr));
> >} else {
> >producer.close();
> >System.out.println("Total kafka Message: "+messageNo);
> >break;
> >}
> >}
> >
> >
> >Case 2:
> >
> >for (int i=1;i<=12000;i++)
> >String messageStr = "KAFKA_"+i;
> >producer.send(new KeyedMessage<Integer, String>(topic,messageStr));
> >
> >
> >
> >Best regards
> >Hawin
>
