Putting the consumer and producer in their own packages might hopefully
> alleviate some of this.
>
I like this idea. Moving forward, the biggest dependencies that the broker
will have and the producer/consumer clients won't are the
zookeeper/zkclient jars. It might be worth looking into this. Ple
Hey Guys,
One other potentially large benefit is to decouple broker dependencies
from consumer/producer dependencies. This makes upgrading the
consumer/producer and managing jar conflicts a lot less of a hassle.
Putting the consumer and producer in their own packages might hopefully
alleviate some
Hi Jay,
Actually, it's mostly the ability to easily cross-build; also the ease of
understanding the code (less code to grok) and implementing alternatives (I
guess all of those falls under cleanliness).
thanks,
Evan
On Tue, Jan 22, 2013 at 12:47 PM, Jay Kreps wrote:
> Hi Evan,
>
> Makes sen
Hi Evan,
Makes sense. Is your goal in separating the client shrinking the jar size?
or just general cleanliness?
-Jay
On Tue, Jan 22, 2013 at 10:53 AM, Evan Chan wrote:
> Jay,
>
> Comments inlined.
>
> On Tue, Jan 22, 2013 at 10:15 AM, Jay Kreps wrote:
>
> > Hey Evan,
> >
> > Great points, s
I like that API too!
On Tue, Jan 22, 2013 at 10:53 AM, Evan Chan wrote:
> Jay,
>
> Comments inlined.
>
> On Tue, Jan 22, 2013 at 10:15 AM, Jay Kreps wrote:
>
> > Hey Evan,
> >
> > Great points, some comments:
> > - Not sure if I understand what you mean by separating consumer and main
> > logi
Jay,
Comments inlined.
On Tue, Jan 22, 2013 at 10:15 AM, Jay Kreps wrote:
> Hey Evan,
>
> Great points, some comments:
> - Not sure if I understand what you mean by separating consumer and main
> logic.
>
I just meant having a separate Scala/Java client jar, so it's more
lightweight and easier
Hey Evan,
Great points, some comments:
- Not sure if I understand what you mean by separating consumer and main
logic.
- Yes, cross-building, I think this is in progress now for kafka as a whole
so it should be in either 0.8 or 0.8.1
- Yes, forgot to mention offset initialization, but that is defi
Jay,
For the consumer:
- Separation of the consumer logic from the main logic
- Making it easier to build the consumer for different versions of Scala
(say 2.10)
- Make it easier to read from any offset you want, while being able to keep
partition management features
- Better support for Akka and
It's worth mentioning that we are interested in exploring potential
generalizations of the producer and consumer API, but as a practical matter
most of the committers are working on getting a stable 0.8 release out the
door. So an improved consumer and producer api would be a 0.9 feature.
If you h
No, but you can implement it in your application.
Thanks,
Jun
On Sun, Jan 20, 2013 at 11:02 PM, navneet sharma <
navneetsharma0...@gmail.com> wrote:
> Is there any property to make consumer work for lets say only 10 mins (ie
> some kind of timer)
> So, i want to close the consumer after 10 mins
Is there any property to make consumer work for lets say only 10 mins (ie
some kind of timer)
So, i want to close the consumer after 10 mins reading from broker..
Thanks,
Navneet Sharma
On Mon, Jan 21, 2013 at 11:48 AM, Ryan LeCompte wrote:
> Perfect. Thanks Jun!
>
> Ryan
>
>
> On Sun, Jan 20,
Perfect. Thanks Jun!
Ryan
On Sun, Jan 20, 2013 at 10:16 PM, Jun Rao wrote:
> Yes, see consumer.timeout.ms in http://kafka.apache.org/configuration.html
>
> Thanks,
>
> Jun
>
> On Sun, Jan 20, 2013 at 7:14 PM, Ryan LeCompte wrote:
>
> > Hello all,
> >
> > Does Kafka still only support blocking
Yes, see consumer.timeout.ms in http://kafka.apache.org/configuration.html
Thanks,
Jun
On Sun, Jan 20, 2013 at 7:14 PM, Ryan LeCompte wrote:
> Hello all,
>
> Does Kafka still only support blocking stream iterstors? It would be great
> to pass a timeout or have a poll() operation for fetching i
Hello all,
Does Kafka still only support blocking stream iterstors? It would be great to
pass a timeout or have a poll() operation for fetching items. Right now I'm
always blocking in this call:
for (m <- stream) ...
Thanks!
Ryan
14 matches
Mail list logo
