Re: open source projects based on kafka

2015-09-13 Thread Jeff Holoman
You could try implementing your own client. https://cwiki.apache.org/confluence/display/KAFKA/Clients On Sun, Sep 13, 2015 at 7:46 PM, Stevo Slavić wrote: > Have a look at https://github.com/allegro/hermes > > On Mon, Sep 14, 2015, 01:28 David Luu wrote: > > > The toy project idea is good. Ano

Re: open source projects based on kafka

2015-09-13 Thread Stevo Slavić
Have a look at https://github.com/allegro/hermes On Mon, Sep 14, 2015, 01:28 David Luu wrote: > The toy project idea is good. Another option I think could be to look at > the various Kafka client langague bindings and/or utilities (like > kafkacat). And from there, another option is to build a c

Re: open source projects based on kafka

2015-09-13 Thread David Luu
The toy project idea is good. Another option I think could be to look at the various Kafka client langague bindings and/or utilities (like kafkacat). And from there, another option is to build a client language binding for a language that's kind of lacking Kafka support, some have better support th

Re: open source projects based on kafka

2015-09-13 Thread Hisham Mardam-Bey
Hi Li, You can take a look at mypipe. "MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka." https://github.com/mardambey/mypipe It uses Kafka as well as some related concepts and technologies like Avro, a sche

Re: open source projects based on kafka

2015-09-13 Thread Manasvi Gupta
Here's a toy project - analyzing twitter stream. 1) Create dev. account on twitter 2) Using your dev credentials, connect to twitter stream api to retrieve stream of tweets 3) Store tweets in Kafka (using Kafka producer) 4) Retrieve tweets (using Kafka consumer) 5) For each tweet (or group of twee

Re: open source projects based on kafka

2015-09-13 Thread Li Tao
Hi Roger, Thanks for your recommendation. I just got to know Samza. and checked its code base. It is a little too huge for me. Maybe for now, I need to start a small project/application which utilize kafka as its infrastructure, so that I can use Kafka's API a lot and know Kafka better. It's har

Re: open source projects based on kafka

2015-09-12 Thread Roger Hoover
Hi Li, You might take a look at Apache Samza. It's conceptually simple but powerful and makes heavy use of Kafka. Best, Roger Sent from my iPhone > On Sep 12, 2015, at 10:34 PM, Li Tao wrote: > > Hi Hackers, > > This is Lee, a learner of kafka, i have read the original paper on kafka, > a

open source projects based on kafka

2015-09-12 Thread Li Tao
Hi Hackers, This is Lee, a learner of kafka, i have read the original paper on kafka, and walked through the document. I think the best way to learn sth is to write and read code about it. I am wondering is there any open source code / system which is based on kafka so that i can read or contribu