Re: Kafka 08 clients

2013-08-10 Thread Mark
Is there an *official* client out there? On Aug 10, 2013, at 4:10 PM, Scott Clasen wrote: > bpot/poseidon on github is a ruby 0.8 client, works fine for me > > Sent from my iPhone > > On Aug 10, 2013, at 3:08 PM, Timothy Chen wrote: > >> That's definitely means it's not up to date to the pro

Re: Kafka 08 clients

2013-08-10 Thread Scott Clasen
bpot/poseidon on github is a ruby 0.8 client, works fine for me Sent from my iPhone On Aug 10, 2013, at 3:08 PM, Timothy Chen wrote: > That's definitely means it's not up to date to the protocol, I'm tried the > java client and it was working with latest 0.8 api. > > Not sure about any other l

Re: Kafka/Hadoop consumers and producers

2013-08-10 Thread Jay Kreps
So guys, just to throw my 2 cents in: 1. We aren't deprecating anything. I just noticed that the Hadoop contrib package wasn't getting as much attention as it should. 2. Andrew or anyone--if there is anyone using the contrib package who would be willing to volunteer to kind of adopt it that would

Re: Zookeeper setup

2013-08-10 Thread Chris Hogue
Another note I'd suggest for the zookeeper name-spacing doc is that the path must exist in zookeeper before starting the brokers. There is an error message, but it's not always clear what the problem is (I think there is even a Jira issue to make the error more clear). -Chris On Sat, Aug 10, 201

Re: Zookeeper setup

2013-08-10 Thread Jay Kreps
Hey guys, I'm actively working on the docs. Any tips like this are much appreciated especially if you can be specific (as you have) about what is clear and what is unclear. I will attempt to clarify the zookeeper chroot info in the changes I'm making this weekend. Whenever possible if we can c

Re: Kafka 08 clients

2013-08-10 Thread Timothy Chen
That's definitely means it's not up to date to the protocol, I'm tried the java client and it was working with latest 0.8 api. Not sure about any other languages. Tim On Sat, Aug 10, 2013 at 2:55 PM, Mark wrote: > Are all Kafka clients working with the latest version of Kafka? > > I tried the

Kafka 08 clients

2013-08-10 Thread Mark
Are all Kafka clients working with the latest version of Kafka? I tried the kafka-rb client and a simple example listed in the README but I keep getting a nasty error require 'kafka' producer = Kafka::Producer.new message = Kafka::Message.new("some random message content") producer.push(message)

Re: Zookeeper setup

2013-08-10 Thread Jason Rosenberg
Philip, Agreed vis-a-vis the docs. But I also understand how you can sometimes find yourself with a seemingly basic question that doesn't present itself with an obvious reading list. You just want to get going with the basics, in the interest of learning by doing, and it's usually a huge time sa

Re: Zookeeper setup

2013-08-10 Thread Philip O'Toole
Jason - thanks. I am sure that extra information will be appreciated. Of course, when the list gets a message like this one, it helps everyone if it includes details about what has been already done. E.g. "I have read the docs but it is still not clear to me how X works when...". Perhaps Vadim

Re: Zookeeper setup

2013-08-10 Thread Jason Rosenberg
Yeah, the basics are there, e.g. in the doc for the zookeeper.connect property: "Specifies the zookeeper connection string in the form hostname:port/chroot. Here the chroot is a base directory which is prepended to all path operations (this effectively namespaces all kafka znodes to allow sharing

Re: commitOffsets() in multithreaded consumer process

2013-08-10 Thread Jan Rudert
Thank you! So I guess, you suggest a really really small timeout so that the other consuming threads don't get regularly blocked for the timeout period? My consumer use case does not allow having "longer" breaks because there are some high traffic topics. Thanks Jan 2013/8/10 Jun Rao > The co