Re: Error running example

2014-10-13 Thread Mohit Anchlia
I ran it again but it seems to be hanging: [2014-10-13 20:43:36,341] INFO Closing socket connection to /10.231.154.117. (kafka.network.Processor) [ec2-user@ip-10-231-154-117 kafka_2.10-0.8.1.1]$ bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test SLF4J: Failed to load class "

Re: kafka-web-console

2014-10-13 Thread Joe Stein
rm -f /root/.ivy2/.sbt.ivy.lock On Mon, Oct 13, 2014 at 8:39 PM, Sa Li wrote: > All, > > Again, I am still unable to install, seems to stuck on ivy.lock, any ideas > to continue? > > thanks > > Alec > > On Oct 12, 2014, at 7:38 PM, Sa Li wrote: > > > Hi > >

Re: kafka-web-console

2014-10-13 Thread Sa Li
All, Again, I am still unable to install, seems to stuck on ivy.lock, any ideas to continue? thanks Alec On Oct 12, 2014, at 7:38 PM, Sa Li wrote: > Hi

Kafka - NotLeaderForPartitionException / LeaderNotAvailableException

2014-10-13 Thread Abraham Jacob
Hi All, I have a 8 node Kafka cluster (broker.id - 1..8). On this cluster I have a topic "wordcount", which was 8 partitions with a replication factor of 3. So a describe of topic wordcount # bin/kafka-topics.sh --describe --zookeeper tr-pan-hclstr-08.amers1b.ciscloud:2181/kafka/kafka-clstr-01 --

Re: Error running example

2014-10-13 Thread Jun Rao
Is that error transient or persistent? Thanks, Jun On Mon, Oct 13, 2014 at 5:07 PM, Mohit Anchlia wrote: > I am new to Kafka and I just installed Kafka. I am getting the following > error. Zookeeper seems to be running. > > [ec2-user@ip-10-231-154-117 kafka_2.10-0.8.1.1]$ > bin/kafka-console-p

Error running example

2014-10-13 Thread Mohit Anchlia
I am new to Kafka and I just installed Kafka. I am getting the following error. Zookeeper seems to be running. [ec2-user@ip-10-231-154-117 kafka_2.10-0.8.1.1]$ bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".

Re: kafka java api (written in 100% clojure)

2014-10-13 Thread Gerrit Jansen van Vuuren
Hi Gwen, For other reasons :), I've used zookeeper (from Java) in the past to store similar information and have found it doesnt work good enough for this use case in particular. Zk is great for config and locks but not for data that changes fast and can grow beyond a certain limit. In particular

Re: kafka java api (written in 100% clojure)

2014-10-13 Thread Gwen Shapira
Out of curiosity: did you choose Redis because ZooKeeper is not well supported in Clojure? Or were there other reasons? On Mon, Oct 13, 2014 at 2:04 PM, Gerrit Jansen van Vuuren wrote: > Hi Steven, > > Redis: > > I've had a discussion on redis today, and one architecture that does come > up is

Re: kafka java api (written in 100% clojure)

2014-10-13 Thread Gerrit Jansen van Vuuren
Hi Steven, Redis: I've had a discussion on redis today, and one architecture that does come up is using a master slave, then if the master fails the have the application start writing to the slave. Writing to a slave is possible in redis, albeit you cannot fail back to the master because writes

Re: Installation and Java Examples

2014-10-13 Thread Mohit Anchlia
By request/reply pattern I meant this: http://www.eaipatterns.com/RequestReply.html In this pattern client posts request on a queue and server sends the response on another queue. The jmsReplyTo property on a JMS message is commonly used to identify the response queue name. On Fri, Oct 10, 2014

Re: Create topic programmatically

2014-10-13 Thread Guozhang Wang
A side note is that you may want to use waitUntil to check the topic is created after using AdminUtils.createTopic since it is async. On Mon, Oct 13, 2014 at 10:07 AM, Jonathan Weeks wrote: > Sure — take a look at the kafka unit tests as well as admin.AdminUtils , > e.g.: > > import kafka.ad

Re: Create topic programmatically

2014-10-13 Thread Jonathan Weeks
Sure — take a look at the kafka unit tests as well as admin.AdminUtils , e.g.: import kafka.admin.AdminUtils AdminUtils.createTopic(zkClient, topicNameString, 10, 1) Best Regards, -Jonathan On Oct 13, 2014, at 9:58 AM, hsy...@gmail.com wrote: > Hi guys, > > Besides TopicCommand, which

Create topic programmatically

2014-10-13 Thread hsy...@gmail.com
Hi guys, Besides TopicCommand, which I believe is not provided to create topic programmatically, is there any other way to automate creating topic in code? Thanks! Best, Siyuan

Re: kafka java api (written in 100% clojure)

2014-10-13 Thread Steven Schlansker
Couple of mostly-uninformed comments inline, On Oct 13, 2014, at 2:00 AM, Gerrit Jansen van Vuuren wrote: > Hi Daniel, > > At the moment redis is a spof in the architecture, but you can setup > replication and I'm seriously looking into using redis cluster to eliminate > this. > Some docs t

Re: kafka java api (written in 100% clojure)

2014-10-13 Thread Gerrit Jansen van Vuuren
Hi Daniel, At the moment redis is a spof in the architecture, but you can setup replication and I'm seriously looking into using redis cluster to eliminate this. Some docs that point to this are: http://redis.io/topics/cluster-tutorial http://redis.io/topics/sentinel Consumer: Consumpt

Re: kafka java api (written in 100% clojure)

2014-10-13 Thread Daniel Compton
Hi Gerrit Thanks for your contribution, I'm sure everyone here appreciates it, especially Clojure developers like myself. I do have one question: what are the guarantees you offer to users of your library under failures, particularly when Redis fails? -- Daniel > On 13/10/2014, at 10:22 am, G