Hello all,
I'm working on the next version of Kafka Web
Consolehttps://github.com/claudemamo/kafka-web-consoleand I'm
seeking feedback for the Topic
Feed
functionalityhttps://raw.githubusercontent.com/claudemamo/kafka-web-console/master/img/topic-feed.png.
Have you found this feature useful? If
Hi,
I just checked the list topic. There is data in the kafka logs directory.
My set up as said has 3 brokers, with replication factor 2.
One thing i see in the output of the list topic is, no partition has
this node as a leader. Is this the reason for bean not showing up anything?
Thanks
Hello folks,
anybody running kafka with scala 2.11.0?
KAFKA-1454 says it's possible.. i'm having problems though when running the
basic producer example from the wiki
The message is *NoClassDefFoundError:
scala/collection/GenTraversableOnce$class*
Thanks
Laszlo
Hello,
I hope all is well . I am reaching out to you in regards to a Kafka Opportunity
we currently have open. I wanted to reach out to introduce myself and to see if
you or anyone you may know would be interested in a 1 year+ contract
opportunity. My client is going to be implementing Kafka
The bytes-in-rate reported on the broker is the post-compression rate.
Thanks,
Jun
On Tue, May 27, 2014 at 9:16 PM, Maung Than maung_t...@apple.com wrote:
Any idea when and which release that could be included in?
We would like to have it sooner and can we do something about it?
Thanks,
Is Topic Feed supposed to include all logs related to a topic? One of the
things that could be useful is to also include the size of each
topic/partition (we added such a jmx in trunk).
Thanks,
Jun
On Wed, May 28, 2014 at 12:35 AM, Claude Mamo claude.m...@gmail.com wrote:
Hello all,
I'm
Only leaders report the message-in-rate metrics. For balancing the leaders,
take a look at
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whypartitionleadersmigratethemselvessometimes
?
Thanks,
Jun
On Wed, May 28, 2014 at 1:05 AM, Arjun ar...@socialtwist.com wrote:
Hi,
I just
Any error from the controller/state-change log?
Thanks,
Jun
On Wed, May 28, 2014 at 1:50 AM, Hemath Kumar hksrckmur...@gmail.comwrote:
even if i specify the topic its showing the same error.
/opt/kafka_2.10-0.8.1.1/bin/kafka-run-class.sh
kafka.tools.ConsumerOffsetChecker -zkconnect
Hello!
How can I get information about unfetched message per partition in topic?
I wish to use such information to create my custom partitioner.class to
balance messages between partitions
With best regards, Aleksey Ryabkov
How can I tell consumer to connect to one broker ...For example:
- I have 3 topic and 3 broker...also each topic have 6 partitions...
- I than start 6 consumers to listen this 3 topics...And in such case we can
found from 6 (each consumer connect only to one broker) to 18 (each consumer
Hello Laszlo,
Have you built Kafka with scala 2.11? You may read the README file to check
compiling Kafka with different scala versions.
Guozhang
On Wed, May 28, 2014 at 5:45 AM, Laszlo Fogas las...@falconsocial.com
wrote:
Hello folks,
anybody running kafka with scala 2.11.0?
KAFKA-1454
Also does this also include request handler logs and the controller logs? I
think it will be also useful to include these logs and arrange them in
time-line orders.
Guozhang
On Wed, May 28, 2014 at 7:42 AM, Jun Rao jun...@gmail.com wrote:
Is Topic Feed supposed to include all logs related to
With high-level consumers you cannot control the assignment of partitions
to consumers, and if partitions are located across all brokers each
consumer is likely to connect to each of the brokers.
One (little hacky) thing you can do is to manually assign the partitions to
brokers such that each
The bytes-in-rate reported on the broker is the post-compression rate.
Based on that fact, I am trying to calculate the volume by multiplying duration
and rate, i.e, (end.time - start.time) X MB.sec ,
but it does not give me the total.data.sent.in.MB.I put the duration in the
brackets
The size of topics and partitions will be included in the next release but
it will be separate from the topic feed.
Claude
On Wed, May 28, 2014 at 4:42 PM, Jun Rao jun...@gmail.com wrote:
Is Topic Feed supposed to include all logs related to a topic? One of the
things that could be useful is
I will see if I can fit this in the next release Guozhang. But I don't
think this falls under the topic feed's scope. Currently the topic feed
displays the latest published partition messages, although it's a little
buggy ;-).
Claude
On Wed, May 28, 2014 at 6:47 PM, Guozhang Wang
Hi Kafka Group,
I need to get following metrics from the producer side.
I am able to get following metric using the ProducerTopicMetrics class per
minute.
messageRate
byteRate
droppedMessageRate
I would like to know how to get above metric per topic per partition.
Also, how do I get count of
The new value is 25000 ms.
We still have the same issue.
Thanks,
Maung
On May 27, 2014, at 3:15 PM, Guozhang Wang wangg...@gmail.com wrote:
What is the new value you set? The new exception you saw seems not related
to Kafka network issues, you may want to, for example, check
Do you see any exceptions on the broker side request logs and server logs?
Guozhang
On Wed, May 28, 2014 at 12:25 PM, Maung Than maung_t...@apple.com wrote:
The new value is 25000 ms.
We still have the same issue.
Thanks,
Maung
On May 27, 2014, at 3:15 PM, Guozhang Wang
No.
Now we only have this exception in the terminal: It seems to be happening with
gzip or large volume of sends even without compression:
java.net.SocketTimeoutException
at
sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:201)
at
Hi,
According to the Kafka documentation, seems Java 1.7 is recommended. But
for our production environment we are still using java 1.6. Will that be a
problem of using java 1.6 and use Kafka 0.8.1.1 ?
Thanks a lot,
Weide
Yes, Kafka builds against 1.6.
/***
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop
/
On May 28, 2014, at 7:42 PM, Weide Zhang
There is a per-partition jmx (*-ConsumerLag) in the consumer that reports
unconsumed messages per partition.
Thanks,
Jun
On Wed, May 28, 2014 at 8:13 AM, Рябков Алексей Николаевич
a.ryab...@ntc-vulkan.ru wrote:
Hello!
How can I get information about unfetched message per partition in
The request log will show the total time that a broker takes to complete a
request. Could you see if that request takes more then request timeout to
complete?
Thanks,
Jun
On Wed, May 28, 2014 at 2:18 PM, Maung Than maung_t...@apple.com wrote:
No.
Now we only have this exception in the
Hi,
I am having trouble in getting my payload message back from the Kafka Message
in my consumer.
My producer is passing a byte[] stream Kafka.
If someone has an examle of how do I get the payload back, please share with
me. Really appreciate.
After iterating through the Kafka stream, I am
25 matches
Mail list logo
