Re: Kafka Connect concept question

2016-04-11 Thread Uber Slacker
Thanks for the explanations guys. It would be cool to see a section in the documentation that explicitly compares and contrasts Kafka Connect versus working directly with the producer and consumer APIs. That's just my perspective as a newb - perhaps it's clear to others. Thanks again! On Thu, Apr

Re: Kafka Connect concept question

2016-04-07 Thread Jay Kreps
Another way to think about this is that the producer allows you to PUSH data into Kafka and the consumer allows you to PULL data out. This is what you need to write an application. However for an existing data system you need the opposite you need to PULL data into Kafka from the system or PUSH

Re: Kafka Connect concept question

2016-04-07 Thread Ewen Cheslack-Postava
On Wed, Apr 6, 2016 at 8:56 AM, Uber Slacker wrote: > Hi folks. I'm pretty new to Kafka. I have spent a fair amount of time so > far understanding the Kafka system in general and how producers and > consumers work. I'm now trying to get a grasp on how Kafka Connect >