There is a configurable max message size on the broker. Oversized messages
will be rejected.
Thanks,
Jun
On Tue, May 13, 2014 at 11:23 AM, Bhavesh Mistry mistry.p.bhav...@gmail.com
wrote:
Hi Kafka Team,
Is there any message size limitation from producer side ? If there, is
what happens
It looks like the log.cleanup.policy config option was changed from dedupe to
compact.
https://github.com/apache/kafka/blob/0.8.1.1/core/src/main/scala/kafka/log/LogConfig.scala#L68
-Jon
On May 13, 2014, at 1:08 PM, Jay Kreps jay.kr...@gmail.com wrote:
Hi,
The compaction is done to
Hi Kafka Team,
Is there any message size limitation from producer side ? If there, is
what happens to message, does it get truncated or message is lost ?
Thanks,
Bhavesh
The C# client you're using only supports 0.7 Kafka, where 0.8 kafka is
not backward compatible APIs anymore.
If you want to use the latest Kafka you'll have to change the binary
protocol yourself, or work with one of the other folks that has
mentioend about .NET client in the mailing list.
Tim
I understand Kafka supports keyed messages (I am using 0.8.1.1) and it is
possible to de-duplicate messages based on the message key.
(The log compaction section of the on-line documentation described how that
works.)
I am using a code example that come with Kafka (namely
Yes, there has been a few issues reported related to message latency. We
are fixing that in https://issues.apache.org/jira/browse/KAFKA-1430
Thanks,
Jun
On Wed, May 7, 2014 at 7:30 AM, Simon Cooper
simon.coo...@featurespace.co.uk wrote:
I've got a very strange bug doing a long poll using
Weide,
Kafka servers are heavily dependent on ZK, hence when it is down the
servers will be in a bad state, and handling produce/fetch requests could
be mal-functioned.
Guozhang
On Tue, May 13, 2014 at 1:02 PM, Weide Zhang weo...@gmail.com wrote:
Can kafka survive when zookeeper is down and
Take a look at ConsumerLag jmx in
http://kafka.apache.org/documentation.html#monitoring
Thanks,
Jun
On Wed, May 14, 2014 at 2:17 AM, Simon Cooper
simon.coo...@featurespace.co.uk wrote:
In the output of kafka-topics.sh -describe, it gives the ISR. What I want
to find out is why a particular
In 0.8, the servers and consumers are heavily dependent on ZK to function.
With ZK down, the servers cannot manage replicas and consumers cannot
assign partitions within the group.
In 0.9 we are going to remove the ZK dependency from consumer clients, but
Kafka servers would still be dependent on
Sure thing - https://issues.apache.org/jira/browse/KAFKA-1452
On May 13, 2014, at 8:33 PM, Jun Rao jun...@gmail.com wrote:
Yes, that seems like a real issue. Could you file a jira?
Thanks,
Jun
On Tue, May 13, 2014 at 11:58 AM, Alex Demidko
alexan...@metamarkets.comwrote:
Hi,
We decided to clear the old logs and start fresh. I'll run that app the next
time if we run into the same problem again.
Thanks Jun,
Xuyen
-Original Message-
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Monday, May 12, 2014 8:58 PM
To: users@kafka.apache.org
Subject: Re:
Hi All,
I have read this posting from linkedIn Team member;
http://geekmantra.wordpress.com/2013/03/28/compression-in-kafka-gzip-or-snappy/
; Thanks.
I have few questions and thoughts:
1) In asynchronous mode, you are compressing the batch, not the individual
send.
2) There is no way
Some emails don't seem to be delivered to the mailing list. This is just a
test to see if the mailing list still works.
Jun
13 matches
Mail list logo
