Hi team,
I am testing async publishing + acknowledgement.
Assume all settings are the default and queue.buffering.max.messages is 10k. I
use a simple for loop to publish 100k messages. In the process, I unplugged the
net cable.
What should I expect in this case?
I assume the send will be
This seems to be a bug of 0.8.1
More info:
queue.enqueue.timeout.ms is explicitly set to -1.
queue.buffering.max.messages is explicitly set o 1.
But still, when the net cable was unplugged, the producer did not block at all
and
all messages were sent.
From: yu_l...@hotmail.com
To:
Congrats! When do you think the final 0.82 will be released?
To: annou...@apache.org; users@kafka.apache.org; d...@kafka.apache.org
Subject: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released
Date: Tue, 28 Oct 2014 00:50:35 +
From: joest...@apache.org
The Apache Kafka community is pleased
is something like 1 or 3 so it will try a few times then give
up.
-Jay
On Mon, Oct 27, 2014 at 6:01 PM, Libo Yu yu_l...@hotmail.com wrote:
This seems to be a bug of 0.8.1
More info:
queue.enqueue.timeout.ms is explicitly set to -1.
queue.buffering.max.messages is explicitly set o
asynchronously.
Thanks,
Jun
On Thu, Oct 23, 2014 at 3:26 PM, Libo Yu yu_l...@hotmail.com wrote:
Hi,
If I use async publishing plus message acknowledgement,
is there any API to tell when all the messages in the queue
have been sent out?
This will be used in the shutdown hook
Hi,
If I use async publishing plus message acknowledgement,
is there any API to tell when all the messages in the queue
have been sent out?
This will be used in the shutdown hook to make sure when
the process is down there is no pending messages to be
published.
Thanks,
Libo
Hi all,
This config property does not appear in the table of broker config properties.
But it appears in the example on the Web page. So I wonder if this is still a
valid config property for 0.8.1. Thanks.
Libo
Which example are you referring to?
On Mon, Oct 20, 2014 at 7:47 AM, Libo Yu yu_l...@hotmail.com wrote:
Hi all,
This config property does not appear in the table of broker config
properties. But it appears in the example on the Web page. So I wonder if
this is still a valid config
as exceptions or logged in warning/error log entries.
Guozhang
On Thu, Jun 5, 2014 at 6:38 PM, Libo Yu yu_l...@hotmail.com wrote:
Not really. The issue was reported by a client. I added a lot of logging
to make sure no exception was thrown
from send() when the message was lost. It is not hard
:24 AM, Libo Yu yu_l...@hotmail.com wrote:
Hi Guozhang,
The issue is not constantly to reproduce but fairly easy to reproduce.
It seems there is some kind of failure that has not been captured by the
Kafka code and no exception has been thrown.
I did a new test
, Libo Yu yu_l...@hotmail.com wrote:
Hi team,
Assume I am using a synchronous producer and it has the following default
properties:
message.send.max.retries
3
retry.backoff.ms
100
I use java api Producer.send(message) to send a message.
While send() is being called
on the
floor. So when the broker is down for too long there will be data loss.
Guozhang
On Thu, Jun 5, 2014 at 6:20 AM, Libo Yu yu_l...@hotmail.com wrote:
I want to know why there will be message loss when brokers are down for
too long.
I've noticed message loss when brokers are restarted
time.
Date: Thu, 5 Jun 2014 16:53:29 -0700
Subject: Re: question about synchronous producer
From: wangg...@gmail.com
To: users@kafka.apache.org
Libo, did you see any exception/error entries on the producer log?
Guozhang
On Thu, Jun 5, 2014 at 10:33 AM, Libo Yu yu_l...@hotmail.com
, then data loss is
usually inevitable.
Guozhang
On Thu, May 29, 2014 at 2:55 PM, Libo Yu yu_l...@hotmail.com wrote:
Hi team,
Assume I am using a synchronous producer and it has the following default
properties:
message.send.max.retries
3
retry.backoff.ms
100
Hi team,
Assume I am using a synchronous producer and it has the following default
properties:
message.send.max.retries
3
retry.backoff.ms
100
I use java api Producer.send(message) to send a message.
While send() is being called, if the brokers are shutdown, what happens?
send()
Hi,
Assume I am using a synchronous producer and request.required.acks is set to 0
(default).
When java api Producer.send(message) returns, is the message acknowledged? Is
there any
chance of message loss in the case? Thanks.
Libo
Hi team,
We have noticed that the cpu usage of 0.8.1 has more than doubled compared to
beta1. I captured a thread dump and compared source code. I believe the higher
cpu usage is introduced by the change of timeout value used by
selector.select() in SocketServer.scala.In beta1 it is 500ms. In
Please forget the cause i found in my previous email. it is not true. i will
keep investigating this issue.
From: yu_l...@hotmail.com
To: users@kafka.apache.org
Subject: 0.8.1 cpu usage
Date: Wed, 30 Apr 2014 11:10:07 -0400
Hi team,
We have noticed that the cpu usage of 0.8.1 has more than
Hi all,
To test 0.8.1, I recently upgraded our kafka from 0.8-beta1 to 0.81 on three
clusters. On all three of them,
I've noticed high cpu usage (20% to more than 70%). Our production is using
0.8-beta with the
same configuration and does not have this issue. I wonder if other people have
Hi team,
The following link introduces a script for adding a partition.
https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-5.AddPartitionTool
However, in the downloaded package, I did not find kafka-add-partitions.sh.
Is it disabled? It is desirable to add
Hi team,
I remember for kafka 0.8, there is a kafka jar with all the dependencies in it.
0.81 does not seem to have a jar. Can anybody confirm that? Thanks.
Libo
Hi team,
We are using Kafka 0.8-beta1. The zookeeper in it is 3.3.3 (although the
version in the license file is 3.3.4).
I want to upgrade to a newer version. Any idea what I need to do in order to
compile broker with a newer version
of zookeeper? Thanks.
Libo
22 matches
Mail list logo
