Re: Anyone working on a Kafka book?
Would you mind sharing your connection setup? > On Dec 13, 2013, at 10:36, Shafaq wrote: > > Thats already done. > >> On Dec 13, 2013 9:28 AM, "Steve Morin" wrote: >> Shafaq, >> That's pretty cool, have you already connected Kafka to spark RRD/DStream >> or is that something you have to figure out? >> -Steve >> >> >>> On Tue, Dec 10, 2013 at 7:10 PM, Shafaq wrote: >>> Hi Steve, >>> >>>The first phase would be pretty simple, essentially hooking up the >>> Kafka-DStream-consumer to perform KPI aggregation over the streamed data >>> from Kafka Broker cluster in real-time. >>> >>> We would like to maximize the throughput by choosing the right message >>> payload size, correct kafka topic/partition mapped to spark RRD/DStream >>> and minimizing I/O. >>> >>> Next, we would be using featurizing the stream to be able to develop >>> machine learning models using SVMs (Support Vector Machines) etc to provide >>> rich insights. >>> >>> Would be soon giving talk on this one, so keep tuned. >>> >>> Regards, >>> S.Abdullah >>> >>> On Tue, Dec 10, 2013 at 10:22 AM, Steve Morin wrote: Shafaq, What does the architecture of what your building look like? -Steve > On Tue, Dec 10, 2013 at 10:19 AM, Shafaq wrote: > Hey Guys, >I would love to contribute to the book specially in the portion of > Kafka-Spark integration or parts of kafka in general. >Am building a Kafka-Spark Real-time framework here at Gree Intl Inc > processing order of MBs of data per second. > > My profile: >www.linkedin.com/in/shafaqabdullah/ > > > Let me know, Im open in whatever ways. > > > Regards, > S.Abdullah > > > >> On Tue, Dec 10, 2013 at 9:15 AM, chetan conikee >> wrote: >> Hey Guys >> >> Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" >> book. >> We only finalized this late October are hoping to start this mid-month >> >> Chetan >> >> >> On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin >> wrote: >> >> > I'll let chetan comment if he's up for it. >> > -Steve >> > >> > >> > >> > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur wrote: >> > >> >> There was some talk a few months ago, not sure what the current >> >> status is. >> >> >> >> >> >> On 12/10/13 10:01 AM, S Ahmed wrote: >> >> >> >>> Is there a book or this was just an idea? >> >>> >> >>> >> >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin >> >>> > >>> >wrote: >> >>> >> >>> Thanks Jun, >> >> I've updated the example with this information. >> >> I've also removed some of the unnecessary newlines. >> >> Thanks, >> >> Chris >> >> >> On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: >> >> Chris, >> > >> > This looks good. One thing about partitioning. Currently, if a >> > message >> > doesn't have a key, we always use the random partitioner >> > (regardless of >> > what "partitioner.class" is set to). >> > >> > Thanks, >> > >> > Jun >> > >> > >> > >> > >> >> >> > > > > > -- > Kind Regards, > Shafaq >>> >>> >>> >>> -- >>> Kind Regards, >>> Shafaq
Re: Anyone working on a Kafka book?
Thats already done. On Dec 13, 2013 9:28 AM, "Steve Morin" wrote: > Shafaq, > That's pretty cool, have you already connected Kafka to spark > RRD/DStream or is that something you have to figure out? > -Steve > > > On Tue, Dec 10, 2013 at 7:10 PM, Shafaq wrote: > >> Hi Steve, >> >>The first phase would be pretty simple, essentially hooking up the >> Kafka-DStream-consumer to perform KPI aggregation over the streamed data >> from Kafka Broker cluster in real-time. >> >> We would like to maximize the throughput by choosing the right message >> payload size, correct kafka topic/partition mapped to spark RRD/DStream >> and minimizing I/O. >> >> Next, we would be using featurizing the stream to be able to develop >> machine learning models using SVMs (Support Vector Machines) etc to provide >> rich insights. >> >> Would be soon giving talk on this one, so keep tuned. >> >> Regards, >> S.Abdullah >> >> >> On Tue, Dec 10, 2013 at 10:22 AM, Steve Morin wrote: >> >>> Shafaq, >>> What does the architecture of what your building look like? >>> -Steve >>> >>> >>> On Tue, Dec 10, 2013 at 10:19 AM, Shafaq wrote: >>> Hey Guys, I would love to contribute to the book specially in the portion of Kafka-Spark integration or parts of kafka in general. Am building a Kafka-Spark Real-time framework here at Gree Intl Inc processing order of MBs of data per second. My profile: www.linkedin.com/in/shafaqabdullah/ Let me know, Im open in whatever ways. Regards, S.Abdullah On Tue, Dec 10, 2013 at 9:15 AM, chetan conikee wrote: > Hey Guys > > Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" > book. > We only finalized this late October are hoping to start this mid-month > > Chetan > > > On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin > wrote: > > > I'll let chetan comment if he's up for it. > > -Steve > > > > > > > > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur > wrote: > > > >> There was some talk a few months ago, not sure what the current > status is. > >> > >> > >> On 12/10/13 10:01 AM, S Ahmed wrote: > >> > >>> Is there a book or this was just an idea? > >>> > >>> > >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin < > curtin.ch...@gmail.com > >>> >wrote: > >>> > >>> Thanks Jun, > > I've updated the example with this information. > > I've also removed some of the unnecessary newlines. > > Thanks, > > Chris > > > On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao > wrote: > > Chris, > > > > This looks good. One thing about partitioning. Currently, if a > message > > doesn't have a key, we always use the random partitioner > (regardless of > > what "partitioner.class" is set to). > > > > Thanks, > > > > Jun > > > > > > > > > >> > > > -- Kind Regards, Shafaq >>> >> >> >> -- >> Kind Regards, >> Shafaq >> >> >
Re: Anyone working on a Kafka book?
Shafaq, That's pretty cool, have you already connected Kafka to spark RRD/DStream or is that something you have to figure out? -Steve On Tue, Dec 10, 2013 at 7:10 PM, Shafaq wrote: > Hi Steve, > >The first phase would be pretty simple, essentially hooking up the > Kafka-DStream-consumer to perform KPI aggregation over the streamed data > from Kafka Broker cluster in real-time. > > We would like to maximize the throughput by choosing the right message > payload size, correct kafka topic/partition mapped to spark RRD/DStream > and minimizing I/O. > > Next, we would be using featurizing the stream to be able to develop > machine learning models using SVMs (Support Vector Machines) etc to provide > rich insights. > > Would be soon giving talk on this one, so keep tuned. > > Regards, > S.Abdullah > > > On Tue, Dec 10, 2013 at 10:22 AM, Steve Morin wrote: > >> Shafaq, >> What does the architecture of what your building look like? >> -Steve >> >> >> On Tue, Dec 10, 2013 at 10:19 AM, Shafaq wrote: >> >>> Hey Guys, >>>I would love to contribute to the book specially in the portion of >>> Kafka-Spark integration or parts of kafka in general. >>>Am building a Kafka-Spark Real-time framework here at Gree Intl Inc >>> processing order of MBs of data per second. >>> >>> My profile: >>>www.linkedin.com/in/shafaqabdullah/ >>> >>> >>> Let me know, Im open in whatever ways. >>> >>> >>> Regards, >>> S.Abdullah >>> >>> >>> >>> On Tue, Dec 10, 2013 at 9:15 AM, chetan conikee wrote: >>> Hey Guys Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" book. We only finalized this late October are hoping to start this mid-month Chetan On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin wrote: > I'll let chetan comment if he's up for it. > -Steve > > > > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur wrote: > >> There was some talk a few months ago, not sure what the current status is. >> >> >> On 12/10/13 10:01 AM, S Ahmed wrote: >> >>> Is there a book or this was just an idea? >>> >>> >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin < curtin.ch...@gmail.com >>> >wrote: >>> >>> Thanks Jun, I've updated the example with this information. I've also removed some of the unnecessary newlines. Thanks, Chris On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: Chris, > > This looks good. One thing about partitioning. Currently, if a message > doesn't have a key, we always use the random partitioner (regardless of > what "partitioner.class" is set to). > > Thanks, > > Jun > > > > >> > >>> >>> >>> >>> -- >>> Kind Regards, >>> Shafaq >>> >>> >> > > > -- > Kind Regards, > Shafaq > >
Re: Anyone working on a Kafka book?
Hi Steve, The first phase would be pretty simple, essentially hooking up the Kafka-DStream-consumer to perform KPI aggregation over the streamed data from Kafka Broker cluster in real-time. We would like to maximize the throughput by choosing the right message payload size, correct kafka topic/partition mapped to spark RRD/DStream and minimizing I/O. Next, we would be using featurizing the stream to be able to develop machine learning models using SVMs (Support Vector Machines) etc to provide rich insights. Would be soon giving talk on this one, so keep tuned. Regards, S.Abdullah On Tue, Dec 10, 2013 at 10:22 AM, Steve Morin wrote: > Shafaq, > What does the architecture of what your building look like? > -Steve > > > On Tue, Dec 10, 2013 at 10:19 AM, Shafaq wrote: > >> Hey Guys, >>I would love to contribute to the book specially in the portion of >> Kafka-Spark integration or parts of kafka in general. >>Am building a Kafka-Spark Real-time framework here at Gree Intl Inc >> processing order of MBs of data per second. >> >> My profile: >>www.linkedin.com/in/shafaqabdullah/ >> >> >> Let me know, Im open in whatever ways. >> >> >> Regards, >> S.Abdullah >> >> >> >> On Tue, Dec 10, 2013 at 9:15 AM, chetan conikee wrote: >> >>> Hey Guys >>> >>> Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" >>> book. >>> We only finalized this late October are hoping to start this mid-month >>> >>> Chetan >>> >>> >>> On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin >>> wrote: >>> >>> > I'll let chetan comment if he's up for it. >>> > -Steve >>> > >>> > >>> > >>> > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur >>> wrote: >>> > >>> >> There was some talk a few months ago, not sure what the current >>> status is. >>> >> >>> >> >>> >> On 12/10/13 10:01 AM, S Ahmed wrote: >>> >> >>> >>> Is there a book or this was just an idea? >>> >>> >>> >>> >>> >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin < >>> curtin.ch...@gmail.com >>> >>> >wrote: >>> >>> >>> >>> Thanks Jun, >>> >>> I've updated the example with this information. >>> >>> I've also removed some of the unnecessary newlines. >>> >>> Thanks, >>> >>> Chris >>> >>> >>> On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: >>> >>> Chris, >>> > >>> > This looks good. One thing about partitioning. Currently, if a >>> message >>> > doesn't have a key, we always use the random partitioner >>> (regardless of >>> > what "partitioner.class" is set to). >>> > >>> > Thanks, >>> > >>> > Jun >>> > >>> > >>> > >>> > >>> >> >>> > >>> >> >> >> >> -- >> Kind Regards, >> Shafaq >> >> > -- Kind Regards, Shafaq
Re: Anyone working on a Kafka book?
Shafaq, What does the architecture of what your building look like? -Steve On Tue, Dec 10, 2013 at 10:19 AM, Shafaq wrote: > Hey Guys, >I would love to contribute to the book specially in the portion of > Kafka-Spark integration or parts of kafka in general. >Am building a Kafka-Spark Real-time framework here at Gree Intl Inc > processing order of MBs of data per second. > > My profile: >www.linkedin.com/in/shafaqabdullah/ > > > Let me know, Im open in whatever ways. > > > Regards, > S.Abdullah > > > > On Tue, Dec 10, 2013 at 9:15 AM, chetan conikee wrote: > >> Hey Guys >> >> Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" >> book. >> We only finalized this late October are hoping to start this mid-month >> >> Chetan >> >> >> On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin >> wrote: >> >> > I'll let chetan comment if he's up for it. >> > -Steve >> > >> > >> > >> > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur wrote: >> > >> >> There was some talk a few months ago, not sure what the current status >> is. >> >> >> >> >> >> On 12/10/13 10:01 AM, S Ahmed wrote: >> >> >> >>> Is there a book or this was just an idea? >> >>> >> >>> >> >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin < >> curtin.ch...@gmail.com >> >>> >wrote: >> >>> >> >>> Thanks Jun, >> >> I've updated the example with this information. >> >> I've also removed some of the unnecessary newlines. >> >> Thanks, >> >> Chris >> >> >> On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: >> >> Chris, >> > >> > This looks good. One thing about partitioning. Currently, if a >> message >> > doesn't have a key, we always use the random partitioner >> (regardless of >> > what "partitioner.class" is set to). >> > >> > Thanks, >> > >> > Jun >> > >> > >> > >> > >> >> >> > >> > > > > -- > Kind Regards, > Shafaq > >
Re: Anyone working on a Kafka book?
Hey Guys, I would love to contribute to the book specially in the portion of Kafka-Spark integration or parts of kafka in general. Am building a Kafka-Spark Real-time framework here at Gree Intl Inc processing order of MBs of data per second. My profile: www.linkedin.com/in/shafaqabdullah/ Let me know, Im open in whatever ways. Regards, S.Abdullah On Tue, Dec 10, 2013 at 9:15 AM, chetan conikee wrote: > Hey Guys > > Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" > book. > We only finalized this late October are hoping to start this mid-month > > Chetan > > > On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin wrote: > > > I'll let chetan comment if he's up for it. > > -Steve > > > > > > > > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur wrote: > > > >> There was some talk a few months ago, not sure what the current status > is. > >> > >> > >> On 12/10/13 10:01 AM, S Ahmed wrote: > >> > >>> Is there a book or this was just an idea? > >>> > >>> > >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin >>> >wrote: > >>> > >>> Thanks Jun, > > I've updated the example with this information. > > I've also removed some of the unnecessary newlines. > > Thanks, > > Chris > > > On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: > > Chris, > > > > This looks good. One thing about partitioning. Currently, if a > message > > doesn't have a key, we always use the random partitioner (regardless > of > > what "partitioner.class" is set to). > > > > Thanks, > > > > Jun > > > > > > > > > >> > > > -- Kind Regards, Shafaq
Re: Anyone working on a Kafka book?
Great, so its not even at MEAP stage then :(, let me guess, it is going to take 6 months to decide on what animal to put on the cover! :) Looking forward to in though! On Tue, Dec 10, 2013 at 12:15 PM, chetan conikee wrote: > Hey Guys > > Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" > book. > We only finalized this late October are hoping to start this mid-month > > Chetan > > > On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin wrote: > > > I'll let chetan comment if he's up for it. > > -Steve > > > > > > > > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur wrote: > > > >> There was some talk a few months ago, not sure what the current status > is. > >> > >> > >> On 12/10/13 10:01 AM, S Ahmed wrote: > >> > >>> Is there a book or this was just an idea? > >>> > >>> > >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin >>> >wrote: > >>> > >>> Thanks Jun, > > I've updated the example with this information. > > I've also removed some of the unnecessary newlines. > > Thanks, > > Chris > > > On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: > > Chris, > > > > This looks good. One thing about partitioning. Currently, if a > message > > doesn't have a key, we always use the random partitioner (regardless > of > > what "partitioner.class" is set to). > > > > Thanks, > > > > Jun > > > > > > > > > >> > > >
Re: Anyone working on a Kafka book?
Hey Guys Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" book. We only finalized this late October are hoping to start this mid-month Chetan On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin wrote: > I'll let chetan comment if he's up for it. > -Steve > > > > On Tue, Dec 10, 2013 at 8:40 AM, David Arthur wrote: > >> There was some talk a few months ago, not sure what the current status is. >> >> >> On 12/10/13 10:01 AM, S Ahmed wrote: >> >>> Is there a book or this was just an idea? >>> >>> >>> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin >> >wrote: >>> >>> Thanks Jun, I've updated the example with this information. I've also removed some of the unnecessary newlines. Thanks, Chris On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: Chris, > > This looks good. One thing about partitioning. Currently, if a message > doesn't have a key, we always use the random partitioner (regardless of > what "partitioner.class" is set to). > > Thanks, > > Jun > > > > >> >
Re: Anyone working on a Kafka book?
I'll let chetan comment if he's up for it. -Steve On Tue, Dec 10, 2013 at 8:40 AM, David Arthur wrote: > There was some talk a few months ago, not sure what the current status is. > > > On 12/10/13 10:01 AM, S Ahmed wrote: > >> Is there a book or this was just an idea? >> >> >> On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin > >wrote: >> >> Thanks Jun, >>> >>> I've updated the example with this information. >>> >>> I've also removed some of the unnecessary newlines. >>> >>> Thanks, >>> >>> Chris >>> >>> >>> On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: >>> >>> Chris, This looks good. One thing about partitioning. Currently, if a message doesn't have a key, we always use the random partitioner (regardless of what "partitioner.class" is set to). Thanks, Jun >
Re: Anyone working on a Kafka book?
There was some talk a few months ago, not sure what the current status is. On 12/10/13 10:01 AM, S Ahmed wrote: Is there a book or this was just an idea? On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin wrote: Thanks Jun, I've updated the example with this information. I've also removed some of the unnecessary newlines. Thanks, Chris On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: Chris, This looks good. One thing about partitioning. Currently, if a message doesn't have a key, we always use the random partitioner (regardless of what "partitioner.class" is set to). Thanks, Jun
Re: Anyone working on a Kafka book?
There is this one: http://www.packtpub.com/develop-custom-message-producers-and-consumers-using-apache-kafka/book 2013/12/10 S Ahmed > Is there a book or this was just an idea? > > > On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin >wrote: > > > Thanks Jun, > > > > I've updated the example with this information. > > > > I've also removed some of the unnecessary newlines. > > > > Thanks, > > > > Chris > > > > > > On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: > > > > > Chris, > > > > > > This looks good. One thing about partitioning. Currently, if a message > > > doesn't have a key, we always use the random partitioner (regardless of > > > what "partitioner.class" is set to). > > > > > > Thanks, > > > > > > Jun > > > > > > > > > > > >
Re: Anyone working on a Kafka book?
I forget but think Chetan was with oreilly > On Dec 10, 2013, at 7:01, S Ahmed wrote: > > Is there a book or this was just an idea? > > > On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin wrote: > >> Thanks Jun, >> >> I've updated the example with this information. >> >> I've also removed some of the unnecessary newlines. >> >> Thanks, >> >> Chris >> >> >>> On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: >>> >>> Chris, >>> >>> This looks good. One thing about partitioning. Currently, if a message >>> doesn't have a key, we always use the random partitioner (regardless of >>> what "partitioner.class" is set to). >>> >>> Thanks, >>> >>> Jun >>
Re: Anyone working on a Kafka book?
Is there a book or this was just an idea? On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin wrote: > Thanks Jun, > > I've updated the example with this information. > > I've also removed some of the unnecessary newlines. > > Thanks, > > Chris > > > On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: > > > Chris, > > > > This looks good. One thing about partitioning. Currently, if a message > > doesn't have a key, we always use the random partitioner (regardless of > > what "partitioner.class" is set to). > > > > Thanks, > > > > Jun > > > > > > >
Re: Anyone working on a Kafka book?
Thanks Jun, I've updated the example with this information. I've also removed some of the unnecessary newlines. Thanks, Chris On Mon, Mar 25, 2013 at 12:04 PM, Jun Rao wrote: > Chris, > > This looks good. One thing about partitioning. Currently, if a message > doesn't have a key, we always use the random partitioner (regardless of > what "partitioner.class" is set to). > > Thanks, > > Jun > > >
Re: Anyone working on a Kafka book?
Chris, This looks good. One thing about partitioning. Currently, if a message doesn't have a key, we always use the random partitioner (regardless of what "partitioner.class" is set to). Thanks, Jun On Thu, Mar 21, 2013 at 11:42 AM, Chris Curtin wrote: > I published my first Wiki example: > > https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example > > Can you guys take a look and see if the tone, format and of course content > fit into what you'd like to see? > > Also, is there a naming convention we should be following? > > Thanks, > > Chris > > > On Thu, Mar 21, 2013 at 1:38 PM, Neha Narkhede >wrote: > > > Yes, that works as well. > > > > Thanks, > > Neha > > > > > > On Thu, Mar 21, 2013 at 10:33 AM, Chris Curtin > >wrote: > > > > > Or can I do it in the Wiki until you release 0.8.0 so people can > comment > > on > > > them? I think I can edit the Wiki with my Apache login. > > > > > > > > > On Thu, Mar 21, 2013 at 12:17 AM, Jun Rao wrote: > > > > > > > Our webpage source is at https://svn.apache.org/repos/asf/kafka/site. > > > You > > > > can file a jira and attach a patch. > > > > > > > > Thanks, > > > > > > > > Jun > > > > > > > > > > > > > >
Re: Anyone working on a Kafka book?
Thanks for finding those. Looks like a copy and paste issue. I've updated the document. Thanks, Chris On Sat, Mar 23, 2013 at 11:27 AM, Jonathan Hodges wrote: > Many thanks for contributing! The docs are very helpful. I found a couple > small possible typos. The partitioning code example looks like it repeats > at the bottom with duplicate import and class definition statements. Also > the create topic command-line appears to have an extra '-' for the > partition option. I can edit these, but before doing so I wanted to check > and make sure I wasn't mistaken. > > -Jonathan > > > > >
Re: Anyone working on a Kafka book?
Many thanks for contributing! The docs are very helpful. I found a couple small possible typos. The partitioning code example looks like it repeats at the bottom with duplicate import and class definition statements. Also the create topic command-line appears to have an extra '-' for the partition option. I can edit these, but before doing so I wanted to check and make sure I wasn't mistaken. -Jonathan On Thu, Mar 21, 2013 at 12:42 PM, Chris Curtin wrote: > I published my first Wiki example: > > https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example > > Can you guys take a look and see if the tone, format and of course content > fit into what you'd like to see? > > Also, is there a naming convention we should be following? > > Thanks, > > Chris > > > On Thu, Mar 21, 2013 at 1:38 PM, Neha Narkhede >wrote: > > > Yes, that works as well. > > > > Thanks, > > Neha > > > > > > On Thu, Mar 21, 2013 at 10:33 AM, Chris Curtin > >wrote: > > > > > Or can I do it in the Wiki until you release 0.8.0 so people can > comment > > on > > > them? I think I can edit the Wiki with my Apache login. > > > > > > > > > On Thu, Mar 21, 2013 at 12:17 AM, Jun Rao wrote: > > > > > > > Our webpage source is at https://svn.apache.org/repos/asf/kafka/site. > > > You > > > > can file a jira and attach a patch. > > > > > > > > Thanks, > > > > > > > > Jun > > > > > > > > > > > > > >
Re: Anyone working on a Kafka book?
This looks great! A few comments * I think it would be useful to start with a complete example (ready to copy/paste) and then break it down bit by bit * Some of the formatting is funky (gratuitous newlines), also I think 2 spaces looks nicer than 4 * In the text, it might be useful to embolden or italicize class names Also, maybe we should move this to a separate thread? On 3/21/13 2:42 PM, Chris Curtin wrote: I published my first Wiki example: https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example Can you guys take a look and see if the tone, format and of course content fit into what you'd like to see? Also, is there a naming convention we should be following? Thanks, Chris On Thu, Mar 21, 2013 at 1:38 PM, Neha Narkhede wrote: Yes, that works as well. Thanks, Neha On Thu, Mar 21, 2013 at 10:33 AM, Chris Curtin wrote: Or can I do it in the Wiki until you release 0.8.0 so people can comment on them? I think I can edit the Wiki with my Apache login. On Thu, Mar 21, 2013 at 12:17 AM, Jun Rao wrote: Our webpage source is at https://svn.apache.org/repos/asf/kafka/site . You can file a jira and attach a patch. Thanks, Jun
Re: Anyone working on a Kafka book?
I published my first Wiki example: https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example Can you guys take a look and see if the tone, format and of course content fit into what you'd like to see? Also, is there a naming convention we should be following? Thanks, Chris On Thu, Mar 21, 2013 at 1:38 PM, Neha Narkhede wrote: > Yes, that works as well. > > Thanks, > Neha > > > On Thu, Mar 21, 2013 at 10:33 AM, Chris Curtin >wrote: > > > Or can I do it in the Wiki until you release 0.8.0 so people can comment > on > > them? I think I can edit the Wiki with my Apache login. > > > > > > On Thu, Mar 21, 2013 at 12:17 AM, Jun Rao wrote: > > > > > Our webpage source is at https://svn.apache.org/repos/asf/kafka/site . > > You > > > can file a jira and attach a patch. > > > > > > Thanks, > > > > > > Jun > > > > > > > > >
Re: Anyone working on a Kafka book?
Yes, that works as well. Thanks, Neha On Thu, Mar 21, 2013 at 10:33 AM, Chris Curtin wrote: > Or can I do it in the Wiki until you release 0.8.0 so people can comment on > them? I think I can edit the Wiki with my Apache login. > > > On Thu, Mar 21, 2013 at 12:17 AM, Jun Rao wrote: > > > Our webpage source is at https://svn.apache.org/repos/asf/kafka/site . > You > > can file a jira and attach a patch. > > > > Thanks, > > > > Jun > > > > >
Re: Anyone working on a Kafka book?
Or can I do it in the Wiki until you release 0.8.0 so people can comment on them? I think I can edit the Wiki with my Apache login. On Thu, Mar 21, 2013 at 12:17 AM, Jun Rao wrote: > Our webpage source is at https://svn.apache.org/repos/asf/kafka/site . You > can file a jira and attach a patch. > > Thanks, > > Jun > >
Re: Anyone working on a Kafka book?
Our webpage source is at https://svn.apache.org/repos/asf/kafka/site . You can file a jira and attach a patch. Thanks, Jun On Wed, Mar 20, 2013 at 12:39 PM, Chris Curtin wrote: > Okay, how do we do this logistically? I've take the Producer code that I > wrote for testing purposes and wrote a description around it. How do I get > it to you guys? > > Simple Consumer is going to take a little longer since my test Consumers > are non-trivial and I'll need to simplify them. > > Thanks, > > Chris > > > On Tue, Mar 19, 2013 at 5:28 PM, Neha Narkhede >wrote: > > > That's a great idea, Chris! How about picking the quickstart document > ?That > > is the most important information that users moving to 0.8 will need. > > > > Thanks, > > Neha > > > > > > > > >
Re: Anyone working on a Kafka book?
Okay, how do we do this logistically? I've take the Producer code that I wrote for testing purposes and wrote a description around it. How do I get it to you guys? Simple Consumer is going to take a little longer since my test Consumers are non-trivial and I'll need to simplify them. Thanks, Chris On Tue, Mar 19, 2013 at 5:28 PM, Neha Narkhede wrote: > That's a great idea, Chris! How about picking the quickstart document ?That > is the most important information that users moving to 0.8 will need. > > Thanks, > Neha > > > >
Re: Anyone working on a Kafka book?
Fantastic! Who is the target audience for the book, 0.7.2 users migrating to 0.8 or potential users of 0.8? Let me suggest a 2nd topic catering to the latter audience: getting from a dev environment (as described in the quickstart doc) to a production environment, with Zk/brokers/etc. deployed on different nodes, including replication and failover. In my experience with pitching Kafka inside 2 different companies engineers & decision makers with no first hand experience with Kafka will have a hard time buying in in absence of seeing the path all the way to production. In addition, replication and management of failures would also cater to 0.7.2 users, for whom these are new as well. Just a thought :) -Dragos On 3/19/13 2:28 PM, "Neha Narkhede" wrote: >That's a great idea, Chris! How about picking the quickstart document >?That >is the most important information that users moving to 0.8 will need. > >Thanks, >Neha > > >On Tue, Mar 19, 2013 at 1:31 PM, Chris Curtin >wrote: > >> Hi Jun, >> >> I've been thinking for a while about how to contribute to the project >>and >> thought that working on some documentation for the website might be a >>good >> way. Do you have an outline of what you'd like the site to look like >>that I >> (AND OTHERS hint, hint) could pick a topic, write the article and submit >> for you guys to review? >> >> >> Thanks, >> >> Chris >> >> >> On Tue, Mar 19, 2013 at 12:20 PM, Jun Rao wrote: >> >> > Hi, David, >> > >> > At LinkedIn, committers are too busy to write a Kafka book right now. >>I >> > think this is a good idea to pursue. So, if you want to do it, we'd be >> > happy to help. The only request that I have for you is while writing >>the >> > book, it would be good if you can use this opportunity to also help us >> > improve the documentation of the site. >> > >> > Thanks, >> > >> > Jun >> > >> > On Tue, Mar 19, 2013 at 6:34 AM, David Arthur >>wrote: >> > >> > > I was approached by a publisher the other day to do a book on Kafka >>- >> > > something I've actually thought about pursuing. Before I say yes (or >> > > consider saying yes), I wanted to make sure no one else was working >>on >> a >> > > book. No sense in producing competing texts at this point. >> > > >> > > So, anyone working on a Kafka book? Self published or otherwise? >> > > >> > > -David >> > > >> > > >> > > >> > >>
Re: Anyone working on a Kafka book?
That's a great idea, Chris! How about picking the quickstart document ?That is the most important information that users moving to 0.8 will need. Thanks, Neha On Tue, Mar 19, 2013 at 1:31 PM, Chris Curtin wrote: > Hi Jun, > > I've been thinking for a while about how to contribute to the project and > thought that working on some documentation for the website might be a good > way. Do you have an outline of what you'd like the site to look like that I > (AND OTHERS hint, hint) could pick a topic, write the article and submit > for you guys to review? > > > Thanks, > > Chris > > > On Tue, Mar 19, 2013 at 12:20 PM, Jun Rao wrote: > > > Hi, David, > > > > At LinkedIn, committers are too busy to write a Kafka book right now. I > > think this is a good idea to pursue. So, if you want to do it, we'd be > > happy to help. The only request that I have for you is while writing the > > book, it would be good if you can use this opportunity to also help us > > improve the documentation of the site. > > > > Thanks, > > > > Jun > > > > On Tue, Mar 19, 2013 at 6:34 AM, David Arthur wrote: > > > > > I was approached by a publisher the other day to do a book on Kafka - > > > something I've actually thought about pursuing. Before I say yes (or > > > consider saying yes), I wanted to make sure no one else was working on > a > > > book. No sense in producing competing texts at this point. > > > > > > So, anyone working on a Kafka book? Self published or otherwise? > > > > > > -David > > > > > > > > > > > >
Re: Anyone working on a Kafka book?
Hi Jun, I've been thinking for a while about how to contribute to the project and thought that working on some documentation for the website might be a good way. Do you have an outline of what you'd like the site to look like that I (AND OTHERS hint, hint) could pick a topic, write the article and submit for you guys to review? Thanks, Chris On Tue, Mar 19, 2013 at 12:20 PM, Jun Rao wrote: > Hi, David, > > At LinkedIn, committers are too busy to write a Kafka book right now. I > think this is a good idea to pursue. So, if you want to do it, we'd be > happy to help. The only request that I have for you is while writing the > book, it would be good if you can use this opportunity to also help us > improve the documentation of the site. > > Thanks, > > Jun > > On Tue, Mar 19, 2013 at 6:34 AM, David Arthur wrote: > > > I was approached by a publisher the other day to do a book on Kafka - > > something I've actually thought about pursuing. Before I say yes (or > > consider saying yes), I wanted to make sure no one else was working on a > > book. No sense in producing competing texts at this point. > > > > So, anyone working on a Kafka book? Self published or otherwise? > > > > -David > > > > > > >
Re: Anyone working on a Kafka book?
I guess the challenge would be that kafka is still in version 0.8, so by the time your book comes out they might be at version 1.0 i.e. its a moving target Sounds like a great idea though! On Tue, Mar 19, 2013 at 12:20 PM, Jun Rao wrote: > Hi, David, > > At LinkedIn, committers are too busy to write a Kafka book right now. I > think this is a good idea to pursue. So, if you want to do it, we'd be > happy to help. The only request that I have for you is while writing the > book, it would be good if you can use this opportunity to also help us > improve the documentation of the site. > > Thanks, > > Jun > > On Tue, Mar 19, 2013 at 6:34 AM, David Arthur wrote: > > > I was approached by a publisher the other day to do a book on Kafka - > > something I've actually thought about pursuing. Before I say yes (or > > consider saying yes), I wanted to make sure no one else was working on a > > book. No sense in producing competing texts at this point. > > > > So, anyone working on a Kafka book? Self published or otherwise? > > > > -David > > > > > > >
Re: Anyone working on a Kafka book?
Hi, David, At LinkedIn, committers are too busy to write a Kafka book right now. I think this is a good idea to pursue. So, if you want to do it, we'd be happy to help. The only request that I have for you is while writing the book, it would be good if you can use this opportunity to also help us improve the documentation of the site. Thanks, Jun On Tue, Mar 19, 2013 at 6:34 AM, David Arthur wrote: > I was approached by a publisher the other day to do a book on Kafka - > something I've actually thought about pursuing. Before I say yes (or > consider saying yes), I wanted to make sure no one else was working on a > book. No sense in producing competing texts at this point. > > So, anyone working on a Kafka book? Self published or otherwise? > > -David > > >
Anyone working on a Kafka book?
I was approached by a publisher the other day to do a book on Kafka - something I've actually thought about pursuing. Before I say yes (or consider saying yes), I wanted to make sure no one else was working on a book. No sense in producing competing texts at this point. So, anyone working on a Kafka book? Self published or otherwise? -David
