Re: Improving the Kafka client ecosystem

2014-08-19 Thread Joe Stein
Great idea Gwen! I think it would go a long way to making this work. Issue created :) On Tue, Aug 19, 2014 at 4:33 PM, Gwen Shapira wrote: > Does it make sense to merge the Camus mailing list? (i.e. ask the > Camus community to merge?) Its a fairly large and popular client. > > On Tue, Aug 19,

Re: Improving the Kafka client ecosystem

2014-08-19 Thread Gwen Shapira
Does it make sense to merge the Camus mailing list? (i.e. ask the Camus community to merge?) Its a fairly large and popular client. On Tue, Aug 19, 2014 at 1:27 PM, Joe Stein wrote: > I also opened issues on 3 of the clients on github that I frequently > use/involved in often enough would be

Re: Improving the Kafka client ecosystem

2014-08-19 Thread Joe Stein
I also opened issues on 3 of the clients on github that I frequently use/involved in often enough would be great to get on the README as such. Thanks to the community for driving things along! /*** Joe Stein Founder, Principal Consultant Big Data Ope

Re: Improving the Kafka client ecosystem

2014-08-19 Thread Joe Stein
I just joined too, and tweeted. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop / On Tu

Re: Improving the Kafka client ecosystem

2014-08-19 Thread Jay Kreps
Cool. I just joined. I'll add it to the website so others can find it. If someone was willing to ping some of the other client developers and get them to join as well that would probably give us critical mass. -Jay On Tue, Aug 19, 2014 at 9:08 AM, Dana Powers wrote: > I created kafka-clie...@gro

Re: Improving the Kafka client ecosystem

2014-08-19 Thread Dana Powers
I created kafka-clie...@groups.google.com https://groups.google.com/forum/m/#!forum/kafka-clients No members and no guidelines yet, but it's a start. Would love to get this going. Dana On Aug 19, 2014 9:03 AM, "Mark Roberts" wrote: > Did this mailing list ever get created? Was there consensu

Re: Improving the Kafka client ecosystem

2014-08-19 Thread Mark Roberts
Did this mailing list ever get created? Was there consensus that it did or didn't need created? -Mark > On Jul 18, 2014, at 14:34, Jay Kreps wrote: > > A question was asked in another thread about what was an effective way > to contribute to the Kafka project for people who weren't very > enth

Re: Improving the Kafka client ecosystem

2014-07-20 Thread Philip O'Toole
On Saturday, July 19, 2014 4:41 PM, Jay Kreps wrote: >>The architecture design patterns idea is fantastic. That would be a great thing to do. To that end how important do you think the 0.7 release remains? I still have a bit more practical experience with that version (thought that is changin

Re: Improving the Kafka client ecosystem

2014-07-19 Thread Mark Roberts
Hi all, As a client engineer on the python client, I would really appreciate a separate mailing list for client implementation discussion and a language agnostic test suite. What might also be really useful is an enumerated list of error conditions and the expected behavior to come out of them.

Re: Improving the Kafka client ecosystem

2014-07-19 Thread Jay Kreps
Hey Philip, Yeah I think we have actually done pretty good at getting reasonably solid clients in a bunch of languages. I just think it is an important area. The architecture design patterns idea is fantastic. That would be a great thing to do. -Jay On Fri, Jul 18, 2014 at 11:46 PM, Philip O'

Re: Improving the Kafka client ecosystem

2014-07-19 Thread Timothy Chen
The certified client test suite really will benefit all the client developers, as writing a Kafka client often is not just talking protocol but to be able to handle correctly all the cases, errors and situations, but also performance. From my experience writing a C# client definitely feel that a

Re: Improving the Kafka client ecosystem

2014-07-18 Thread Philip O'Toole
Thanks Jay -- some good ideas there. I agree strongly that fewer, more solid, non-Java clients are better than many shallow ones. Interesting that you feel we could do some more work in this area, as I thought it was well served (even if they have proliferated). One area I would like see docume

Re: Improving the Kafka client ecosystem

2014-07-18 Thread Jay Kreps
Basically my thought with getting a separate mailing list was to have a place specifically to discuss issues around clients. I don't see a lot of discussion about them on the main list. I thought perhaps this was because people don't like to ask questions which are about adjacent projects/code base

Re: Improving the Kafka client ecosystem

2014-07-18 Thread Jun Rao
Another important part of eco-system could be around the adaptors of getting data from other systems into Kafka and vice versa. So, for the ingestion part, this can include things like getting data from mysql, syslog, apache server log, etc. For the egress part, this can include putting Kafka data

Improving the Kafka client ecosystem

2014-07-18 Thread Jay Kreps
A question was asked in another thread about what was an effective way to contribute to the Kafka project for people who weren't very enthusiastic about writing Java/Scala code. I wanted to kind of advocate for an area I think is really important and not as good as it could be--the client ecosyste