Thank you very much for all the reply, I am able to connect jconsole now,
by set env JMX_PORT= start server. However, when I connect it I found
there is a port conflict with the kafka-run-class.sh,
Error: Exception thrown by the agent : java.rmi.server.ExportException:
Port already in use:
In addition, I found all the attributes in jconsole MBeans are cool, but
not being graphed, so again, if I want to view the real-time graphing,
jmxtrans + graphite is the solution?
thanks
AL
On Thu, Jan 8, 2015 at 1:35 PM, Sa Li sal...@gmail.com wrote:
Thank you very much for all the reply, I
There is a patch for KAFKA-1013 that has a tool for importing and exporting
offsets to and from kafka. Using that tool you can write
topic/partion/offset to a file and import it back to kafka.
Thanks,
Mayuresh
On Thu, Jan 8, 2015 at 1:21 PM, Kyle Banker kyleban...@gmail.com wrote:
We
I would like to test locally first as it is easier than setting up a test
cluster to model the production, yet the script kafka-producer-perf-test is
not available for windows.
Jun, what kind of basic I/O testing on the local FS did you have in mind?
Thanks,
Shlomi
On Tue, Jan 6, 2015 at 5:40
Hi all,
I have a topic with 3 partitions, and each partion has its sequency in kafka.
How to order message between different partion? Anyone has experiences about
that, thanks.
Thanks Regards
YuanJia Li
so consumer can not read the offset between leader.hw and min(followers.leo)?
Thanks，
Lax
Date: Tue, 6 Jan 2015 08:44:39 -0800
Subject: Re: The message would be consumed if message un-committed
From: gharatmayures...@gmail.com
To: users@kafka.apache.org
Only Committed messages are made
The messages are ordered per partition. No order between partitions.
If you really need ordering use one partition.
2015-01-08 9:44 GMT+01:00 YuanJia Li yuanjia8...@163.com:
Hi all,
I have a topic with 3 partitions, and each partion has its sequency in
kafka.
How to order message between
The consumer can only read up to leader High water mark.
Thanks,
Mayuresh
On Thu, Jan 8, 2015 at 2:53 AM, chenlax lax...@hotmail.com wrote:
so consumer can not read the offset between leader.hw and
min(followers.leo)?
Thanks，
Lax
Date: Tue, 6 Jan 2015 08:44:39 -0800
Subject: Re: The
I do see the Windows based scripts in the tar file - but haven't them
though.You should find them under bin/windows.
Also you can always use other Windows stress testing tools/suites to check your
local I/O performance..
From: Shlomi Hazan shl...@viber.com
To: users@kafka.apache.org;
Thanks, Jaikiran
I was trying to duplicate the same issue by running the same performance
test on master node of cluster , say exemplary-birds.master, and I did see
such error again
org.apache.kafka.common.errors.NotLeaderForPartitionException: This server
is not the leader for that
Hi,
you need to set jmx remote port.
you can set this by executing below line in terminal and start server.
(or) add below line to kafka-run-class.sh and start server.
export JMX_PORT= (jmx remote port)
and connect jconsole by giving brokerip:
On Fri, Jan 9, 2015 at 12:38 AM,
Hi all,
I'm trying to find an existing metric, or method to monitor for data
being sent to a topic that doesn't exist. Is there a JMX stat I
should look at now, or some other way you catch this sort of thing?
We'd like to get ahead of our users noticing a missing topic, or
sending data to a
Is there a firewall between your DEV and PROD environments? If so you will need
to open access on all ports, not just JMX port.
It gets complicated with JMX.
Gene Robichaux
Manager, Database Operations
Match.com
8300 Douglas Avenue I Suite 800 I Dallas, TX 75225
-Original Message-
The consumer can only read up to leader High water mark.
Thanks,
Mayuresh
From: chenlax [lax...@hotmail.com]
Sent: Thursday, January 08, 2015 2:53 AM
To: users kafka
Subject: RE: The message would be consumed if message un-committed
so consumer can not
We currently checkpoint partition offsets from ZK into an external
database, and we have a process for restoring those offsets to ZK in case
we ever need to replay data from Kafka.
Since offsets are now stored on the broker, the ConsumerOffsetChecker no
longer works. Is there a new way (tool) to
You need to export the JMX_PORT for kafka to use on startup before starting
up
/***
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop http://www.twitter.com/allthingshadoop
Hi Sa Li,
You need to set environment variable $JMX_PORT to enable jmx while starting
kafka. See to kafka-run-class.sh on how it is used. Then you can connect
to hostname:jmxport using Jconsole.
Thanks,
Raja.
On Thu, Jan 8, 2015 at 2:08 PM, Sa Li sal...@gmail.com wrote:
Hello, All
I
17 matches
Mail list logo
