Re: Kafka Internals Video/Blog

2017-09-20 Thread James Cheng
This recent meetup had a presentation of the internals of the Kafka Controller. https://www.meetup.com/Stream-Processing-Meetup-LinkedIn/events/242656767/ The video is not yet available, but hopefully will be soon. -J

Re: Kafka Internals Video/Blog

2017-09-20 Thread Matthias J. Sax
Check out the Kafka wiki: https://cwiki.apache.org/confluence/display/KAFKA/Index It contains many design and discussion pages -- it's sometime a little hidden, but I am sure you can find them. -Matthias On 9/20/17 10:18 AM, M. Manna wrote: > Raghav, > > I would say Kafka documentation on Kafk

Re: Kafka Internals Video/Blog

2017-09-20 Thread M. Manna
Raghav, I would say Kafka documentation on Kafka.apache.org and confluent.io are the best ones that I found for myself. They both talk about some code for you to start with. I do recommend that you fork out Kafka from GitHub if you wanna go as far as debugging the code to see a flow of execution-

Re: Kafka Internals Video/Blog

2017-09-20 Thread Ted Yu
Kafka has been evolving rapidly. Is there area(s) which you're particularly interested ? You can find all the relevant KIPs under: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals Normally KIPs contain fair amount of technical details. >From each KIP, you can find J

Re: Kafka Internals Video/Blog

2017-09-20 Thread Raghav
Thanks Manna. I did watch that earlier. I am looking for something more detailed in terms of implementation and design details. I want to dabble with the code but given the complexity of the code, a good starter guide would be helpful. Thanks. On Wed, Sep 20, 2017 at 9:53 AM, M. Manna wrote:

Re: Kafka Internals Video/Blog

2017-09-20 Thread M. Manna
There's a video where Jay Kreps talks about how Kafka works - YouTube has it as the top 5 under "How Kafka Works". On 20 Sep 2017 5:49 pm, "Raghav" wrote: > Hi > > Just wondering if there is any video/blog that goes over Kafka Internal and > under the hood design and implementation details. I a

Kafka Internals Video/Blog

2017-09-20 Thread Raghav
Hi Just wondering if there is any video/blog that goes over Kafka Internal and under the hood design and implementation details. I am a newbie and I would like to dabble with the code and understand design of it. Just wondering if there is any video, blog etc that goes over it ? Thanks. -- Ragh