Re: Consumer questions

AFAIK, we can not replay the messages with high level consumer. We need to use simple consumer. On Sun, Jan 18, 2015 at 12:15 AM, Christopher Piggott cpigg...@gmail.com wrote: Thanks. That helped clear a lot up in my mind. I'm trying to high-level consumer now. Occasionally I need to do a

Query regarding serialization

Hi, I am new to kafka and still learning .I have a query .. As per my understanding the serialization is happening before the partitioning and grouping of messages per broker . Is my understanding correct and what is the reason for the same? Regards, Liju John

In Apache Kafka, how can one achieve delay queue support (similar to what ActiveMQ has)?

Hi Kafka Users Community, In Apache Kafka, how can one achieve delay queue support (similar to what ActiveMQ has)? Has anyone solved similar problem before?  Thanks in advance? Regards,Vish

Re: Consumer questions

Thanks. That helped clear a lot up in my mind. I'm trying to high-level consumer now. Occasionally I need to do a replay of the stream. The example is: KafkaStream.iterator(); which starts at wherever zookeeper recorded as where you left off. With the high level interface, can you

Re: Consumer questions

You can replay the messages with the high level consumer you can even start at whatever position you want. Prior to your consumers starting call ZkUtils.maybeDeletePath(zkClientConnection, /consumers/ + groupId) make sure you have in your consumer properties auto.offset.reset=smallest

Re: dumping JMX data

JIRAs related to the issue are https://issues.apache.org/jira/browse/KAFKA-1680 https://issues.apache.org/jira/browse/KAFKA-1679 On Sun, Jan 18, 2015 at 3:12 AM, Scott Chapman sc...@woofplanet.com wrote: While I appreciate all the suggestions on other JMX related tools, my question is really

Re: dumping JMX data

Thanks, that second one might be material. I find that if I run without any arguments I get no output and it just keeps running. *sigh* On Sat Jan 17 2015 at 7:58:52 PM Manikumar Reddy ku...@nmsworks.co.in wrote: JIRAs related to the issue are https://issues.apache.org/jira/browse/KAFKA-1680

Re: dumping JMX data

So, related question. If I query for a specific object name, I always seem to get UNIX time: ./bin/kafka-run-class.sh kafka.tools.JmxTool --object-name 'kafka.server:name=UnderReplicatedPartitions,type=ReplicaManager' --jmx-url service:jmx:rmi:///jndi/rmi://localhost:/jmxrmi always returns:

kafka shutdown automatically

Hi， our kafka cluster is shut down automatically today, here is the log. I don't find any error log. Anything wrong? [2015-01-18 05:01:01,788] INFO [BrokerChangeListener on Controller 0]: Broker change listener fired for path /brokers/ids with children 0

Command to list my brokers

Hi all, I just want a way to query all of my brokers to see if they're all connected and online, without creating a topic. Or is creating a topic the best way to verify all my brokers are up and running??? Thanks

Re: dumping JMX data

On Fri, Jan 16, 2015 at 5:52 PM, Joe Stein joe.st...@stealth.ly wrote: Here are some more tools for that https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters depending on what you have in place and what you are trying todo different options exist. A lot of folks like JMX Trans.