TotalBytesRead
TotalFetchRequestMs
TotalProduceRequestMs
-Original Message-
From: Xuyen On
Sent: Tuesday, May 20, 2014 11:30 AM
To: 'users@kafka.apache.org'
Subject: RE: SocketServerStats not reporting bytes written or read
To be more clear,
1. I am using jmxtrans to get th
kafka.SocketServerStats:BytesWrittenPerSecond and
kafka.SocketServerStats:BytesReadPerSecond stats. The other stats seem to
update fine.
Any ideas why this might be?
-Original Message-
From: Xuyen On
Sent: Tuesday, May 20, 2014 11:24 AM
To: users@kafka.apache.org
Subject: RE: SocketServerStats not reporting bytes
riginal Message-
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Monday, May 19, 2014 9:45 PM
To: users@kafka.apache.org
Subject: Re: SocketServerStats not reporting bytes written or read
Is the problem with the jmx beans themselves or jmxstats?
Thanks,
Jun
On Mon, May 19, 2014 at 2:48 PM, Xuyen O
Hi all,
I have an intermittent problem with the JMX SocketServer stats on my 0.7.2
Kafka cluster.
I'm collecting the SocketServerStats with jmxstats and everything seems to be
working fine except kafka.SocketServerStats:BytesWrittenPerSecond and
kafka.SocketServerStats:BytesReadPerSecond are no
t: Re: IndexOutOfBoundsException error
Could you run the DumpLogSegments tool to see if there are indeed corrupted
messages in the broker log?
Thanks,
Jun
On Mon, May 12, 2014 at 4:08 PM, Xuyen On wrote:
> Hi all,
>
> I am seeing some corrupt data on my 0.7.2 Kafka cluster. Every once in
> aw
Hi all,
I am seeing some corrupt data on my 0.7.2 Kafka cluster. Every once in awhile
I'll get the following message:
Exception in thread "kafka-consumer" java.lang.IndexOutOfBoundsException
at java.nio.Buffer.checkIndex(Unknown Source)
at java.nio.HeapByteBuffer.get(Unknown Sour
alled
kafka-ganglia but it doesn't support 0.7.2 Kafka which is what we're using
right now. Any suggestions to get real time reporting of consumer lag through a
tool that can export to ganglia would be appreciated.
Thanks,
Xuyen
-Original Message-----
From: Xuyen On [mailto:x.
Thanks for your response Joel.
I am currently trying out JMXTrans to get the stats from MBean and I can read
attributes fine but it doesn't support JMX Operations yet. What tool do you use
for your reporting? Is there another tool that supports JMX operations so that
I can use the getOffsetLag
I would like to know what these attributes mean in my Kafka 0.7.2 brokers. I
see the following in JConsole for my eventdata topic:
kafka.logs.eventdata-0
Attributes
Name // Name of partition
Size
hough, you shouldn't be seeing duplicates.
Thanks,
Joel
On Wed, Jan 8, 2014 at 5:21 PM, Xuyen On wrote:
> Hi,
>
> I would like to check to see if other people are seeing duplicate records
> with Kafka 0.7. I read the Jira's and I believe that duplicates are still
> possibl
Hi,
I would like to check to see if other people are seeing duplicate records with
Kafka 0.7. I read the Jira's and I believe that duplicates are still possible
when using message compression on Kafka 0.7. I'm seeing duplicate records from
the range of 6-13%. Is this normal?
If you're using K
I found out the problem. The ConsumerOffsetChecker code has a regex that checks
for ip only and not hostname. Once I replaced the ip check with al .* in the
regex. I was able to run ConsumerOffsetChecker fine.
-Original Message-
From: Xuyen On
Sent: Monday, December 16, 2013 9:42 AM
ay, December 13, 2013 8:00 PM
To: users@kafka.apache.org
Subject: Re: ConsumerOffsetChecker not able to parse broker info
The ZK format is for 0.7.2. Are you using 0.7.2 ConsumerOffsetChecker?
Thanks,
Jun
On Fri, Dec 13, 2013 at 4:36 PM, Xuyen On wrote:
> Hi all,
>
> I'm run
t: Re: ConsumerOffsetChecker not able to parse broker info
The tool expected the broker info string to be in the format of host:port, and
only 1 ":" in the string.
Guozhang
On Fri, Dec 13, 2013 at 4:36 PM, Xuyen On wrote:
> Hi all,
>
> I'm running Kafka 0.7 and I&
Hi all,
I'm running Kafka 0.7 and I'm having problems running the ConsumerOffsetChecker.
I have messages loaded in a topic called eventdata and I can consume the
messages fine but when I try to run ConsumerOffsetChecker I get the following
error:
[2013-12-13 12:24:48,034] INFO zookeeper state c
ns across
machines, so that works better.
Thanks,
Neha
On Thu, Sep 12, 2013 at 1:03 PM, Xuyen On wrote:
> Hi Neha,
>
> First I should mention that we are initially using Kafka 0.7, so I
> don't think we'll have access to the API to get metadata info from the
> broke
ducer Load balancing" section of the documentation -
http://kafka.apache.org/08/documentation.html#theproducer
Let us know how we can improve it to answer your question.
Thanks,
Neha
On Wed, Sep 11, 2013 at 4:45 PM, Xuyen On wrote:
> Hi Neha,
>
> How do you get metadata about
ed, Sep 11, 2013 at 12:38 PM, Xuyen On wrote:
> Can anyone from LinkedIn let me know if they are using Hardware
> Loadbalancer to distribute the producer messages or if they're using
> zookeeper?
> I'm trying to find out what the pros and cons are of using a hardware
>
Can anyone from LinkedIn let me know if they are using Hardware Loadbalancer to
distribute the producer messages or if they're using zookeeper?
I'm trying to find out what the pros and cons are of using a hardware
loadbalancer vs. using zookeeper to distribute the load of producers sending
messa
+mirroring+(MirrorMaker)
/***
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop
/
On Sep 9, 2013, at 8:39 PM, Xuyen On wrote:
> Hi eve
Hi everyone,
I am trying to setup a Kafka cluster and have a couple of questions about
failover.
Has anyone deployed more than one zookeeper for a single Kafka cluster and have
high availability so if one zookeeper node goes down, the cluster automatically
fails over to a backup zookeeper node
21 matches
Mail list logo
