Re: Kafka 0.8.2.0 Log4j

2016-02-12 Thread Ben Stopford
Check you’re setting the Kafka log4j properties. -Dlog4j.configuration=file:config/log4j.properties B > On 12 Feb 2016, at 07:33, Joe San wrote: > > How could I get rid of this warning? > > log4j:WARN No appenders could be found for logger > (kafka.utils.VerifiableProperties). > log4j:WARN

Re: Kafka 0.8.2.0 Log4j

2016-02-12 Thread Joe San
But still could not get rid of this annoying warning! On Fri, Feb 12, 2016 at 12:58 PM, Joe San wrote: > I have a logback.xml that I use when I do sbt run: > > sbt -Dlogback.configurationFile=app-logger.xml run > > On Fri, Feb 12, 2016 at 12:19 PM, Ben Stopford wrote: > >> Check you’re setting

Re: Kafka 0.8.2.0 Log4j

2016-02-12 Thread Joe San
I have a logback.xml that I use when I do sbt run: sbt -Dlogback.configurationFile=app-logger.xml run On Fri, Feb 12, 2016 at 12:19 PM, Ben Stopford wrote: > Check you’re setting the Kafka log4j properties. > > -Dlog4j.configuration=file:config/log4j.properties > > B > > On 12 Feb 2016, at 07:3

Re: Connection to kafka stalls

2016-02-12 Thread Maximiliano Patricio Méndez
Hi, An update about this. I've recreated the topic with different configuration and the problem doesn't seem to be happening anymore. I have 8 brokers. This topic was previously created (when the connections were stalling within the thread dump that I've attached) with 5 partitions, retetion poli

"Topic Created" event

2016-02-12 Thread Karan Gupta
Hello, I am learning how to use kafka as my personal project. I was wondering if there is a "topic created" event that kafka or zookeeper sends such that a simple scala/java program can listen to. I was not able to find any documentation on that. Thanks for any advice :) -- Best regards Karan

Re: "Topic Created" event

2016-02-12 Thread Christian Posta
Wonder if you can listen to the zkPath for topics via a zk watch ( https://zookeeper.apache.org/doc/r3.3.3/api/org/apache/zookeeper/Watcher.html) to let you know when the structure of the tree changes (ie, add/remove)? The zkPath for topics is "/brokers/topics" https://github.com/christian-posta/

Re: Consumer backwards compatibility

2016-02-12 Thread Alexis Midon
When porting an existing consumer group from 0.8.2 to 0.9 (clients and brokers), is there any impact on the last committed offsets? is the "native offset storage" feature enable by default? On Thu, Feb 11, 2016 at 4:52 PM Jason Gustafson wrote: > The new Java consumer in 0.9.0 will not work w

Re: Where can I find the document for consumer metrics

2016-02-12 Thread Avi Flax
On Thursday, February 11, 2016 at 19:53, Jason Gustafson wrote: > We have them in the Confluent docs: > http://docs.confluent.io/2.0.0/kafka/monitoring.html#new-consumer-metrics. Thanks Jason, that’s very helpful! Any chance this could be copied over to the canonical Kafka docs?