: 06/19/2016 11:04 PM
Subject:Re: Consumer Question
Hi Chris,
We should also ensure that auto.create.topics.enable is set to true.
Thank you,
Anirudh
Hi Chris,
If the topic not exist, it will create a new topic with the name which you
give.
Thanks,
Nicole
On Sat, Jun 18, 2016 at 1
Hi Chris,
We should also ensure that auto.create.topics.enable is set to true.
Thank you,
Anirudh
Hi Chris,
If the topic not exist, it will create a new topic with the name which you
give.
Thanks,
Nicole
On Sat, Jun 18, 2016 at 1:55 AM, Chris Barlock wrote:
> If you have a consumer listening
Hi Chris,
If the topic not exist, it will create a new topic with the name which you
give.
Thanks,
Nicole
On Sat, Jun 18, 2016 at 1:55 AM, Chris Barlock wrote:
> If you have a consumer listening on a topic and that topic is deleted is
> the consumer made aware -- perhaps by some exception -- o
If you have a consumer listening on a topic and that topic is deleted is
the consumer made aware -- perhaps by some exception -- or does it
continue listening, blissfully unaware that it will never hear anything
more?
Thanks,
Chris
I read through the documentation however when I try to access Java API
through the link posted on the design page I get "no page found"
http://people.apache.org/~nehanarkhede/kafka-0.9-consumer-javadoc/doc/kafka/clients/consumer/KafkaConsumer.html
On Wed, Oct 21, 2015 at 9:59 AM, Mohit Anchlia
w
never mind, I found the documentation
On Wed, Oct 21, 2015 at 9:50 AM, Mohit Anchlia
wrote:
> Thanks. Where can I find new Java consumer API documentation with
> examples?
>
> On Tue, Oct 20, 2015 at 6:37 PM, Guozhang Wang wrote:
>
>> There are a bunch of new features added in 0.9 plus quite a
Thanks. Where can I find new Java consumer API documentation with examples?
On Tue, Oct 20, 2015 at 6:37 PM, Guozhang Wang wrote:
> There are a bunch of new features added in 0.9 plus quite a lot of bug
> fixes as well, a complete ticket list can be found here:
>
>
> https://issues.apache.org/j
There are a bunch of new features added in 0.9 plus quite a lot of bug
fixes as well, a complete ticket list can be found here:
https://issues.apache.org/jira/browse/KAFKA-1686?jql=project%20%3D%20KAFKA%20AND%20fixVersion%20%3D%200.9.0.0%20ORDER%20BY%20updated%20DESC
In a short summary of the new
Thanks. Are there any other major changes in .9 release other than the
Consumer changes. Should I wait for .9 or go ahead and performance test
with .8?
On Tue, Oct 20, 2015 at 3:54 PM, Guozhang Wang wrote:
> We will have a release document for that on the release date, it is not
> complete yet.
We will have a release document for that on the release date, it is not
complete yet.
Guozhang
On Tue, Oct 20, 2015 at 3:18 PM, Mohit Anchlia
wrote:
> Is there a wiki page where I can find all the major design changes in
> 0.9.0?
>
> On Mon, Oct 19, 2015 at 4:24 PM, Guozhang Wang wrote:
>
> >
Is there a wiki page where I can find all the major design changes in 0.9.0?
On Mon, Oct 19, 2015 at 4:24 PM, Guozhang Wang wrote:
> It is not released yet, we are shooting for Nov. for 0.9.0.
>
> Guozhang
>
> On Mon, Oct 19, 2015 at 4:08 PM, Mohit Anchlia
> wrote:
>
> > Is 0.9.0 still under de
It is not released yet, we are shooting for Nov. for 0.9.0.
Guozhang
On Mon, Oct 19, 2015 at 4:08 PM, Mohit Anchlia
wrote:
> Is 0.9.0 still under development? I don't see it here:
> http://kafka.apache.org/downloads.html
>
> On Mon, Oct 19, 2015 at 4:05 PM, Guozhang Wang wrote:
>
> > The links
Is 0.9.0 still under development? I don't see it here:
http://kafka.apache.org/downloads.html
On Mon, Oct 19, 2015 at 4:05 PM, Guozhang Wang wrote:
> The links you are referring are for the old consumer.
>
> If you are using the ZooKeeper based high-level version of the old consumer
> which is d
The links you are referring are for the old consumer.
If you are using the ZooKeeper based high-level version of the old consumer
which is described in the second link, then failures are handled and
abstracted from you so that if there is a failure in the current process,
its fetching partitions w
By old consumer you mean version < .8?
Here are the links:
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example
https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example
On Mon, Oct 19, 2015 at 12:52 PM, Guozhang Wang wrote:
> Hi Mohit,
>
> Are you refe
Hi Mohit,
Are you referring to the new Java consumer or the old consumer? Or more
specifically what examples doc are you referring to?
Guozhang
On Mon, Oct 19, 2015 at 10:01 AM, Mohit Anchlia
wrote:
> I see most of the consumer examples create a while/for loop and then fetch
> messages iterati
I see most of the consumer examples create a while/for loop and then fetch
messages iteratively. Is that the only way by which clients can consumer
messages? If this is the preferred way then how do you deal with failures,
exceptions such that messages are not lost.
Also, please point me to exampl
Thanks for confirming that, Guozhang.
Regards,
Libo
-Original Message-
From: Guozhang Wang [mailto:wangg...@gmail.com]
Sent: Wednesday, December 18, 2013 4:34 PM
To: users@kafka.apache.org
Subject: Re: a consumer question
Jun is right. Just checked the code. If you set
t; Libo
> > >
> > >
> > > -Original Message-
> > > From: Jun Rao [mailto:jun...@gmail.com]
> > > Sent: Tuesday, December 17, 2013 12:40 AM
> > > To: users@kafka.apache.org
> > > Subject: Re: a consumer question
> > >
consumer question
Actually, hasNext() only returns false when the consumer connector is shutdown.
Typically, you either set consumer.timeout.ms to -1 or a value larger than 0.
If it's set to 0, my guess is that it throws a timeout exception immediately if
there is no more message.
Thanks,
> > From: Jun Rao [mailto:jun...@gmail.com]
> > Sent: Tuesday, December 17, 2013 12:40 AM
> > To: users@kafka.apache.org
> > Subject: Re: a consumer question
> >
> > If there is a message, hasNext() returns true, not throwing an exception.
> &
a timeout exception, otherwise it
> returns true.
> Is that the right behavior?
>
> Regards,
>
> Libo
>
>
> -Original Message-
> From: Jun Rao [mailto:jun...@gmail.com]
> Sent: Tuesday, December 17, 2013 12:40 AM
> To: users@kafka.apache.org
> Subject: R
: Tuesday, December 17, 2013 12:40 AM
To: users@kafka.apache.org
Subject: Re: a consumer question
If there is a message, hasNext() returns true, not throwing an exception.
Thanks,
Jun
On Mon, Dec 16, 2013 at 11:29 AM, Yu, Libo wrote:
> Hi folks,
>
> For this parameters, if consumer.t
If there is a message, hasNext() returns true, not throwing an exception.
Thanks,
Jun
On Mon, Dec 16, 2013 at 11:29 AM, Yu, Libo wrote:
> Hi folks,
>
> For this parameters, if consumer.timeout.ms is set to 0, whenever I call
> ConsumerIterator's hasNext(),
> if there is a message available, a
Hi folks,
For this parameters, if consumer.timeout.ms is set to 0, whenever I call
ConsumerIterator's hasNext(),
if there is a message available, a timeout exception will be thrown. Is my
understanding correct? Thanks.
consumer.timeout.ms
-1
Throw a timeout exception to the consumer if no mes
Hi LIbo,
Yes, this is still the case in 0.8.
Guozhang
On Fri, Aug 23, 2013 at 8:14 AM, Philip O'Toole wrote:
> Yes, the Kafka team has told me that this is how it works (at least for
> 0.72).
>
> Philip
>
> On Fri, Aug 23, 2013 at 7:53 AM, Yu, Libo wrote:
> > Hi team,
> >
> > Right now, from
Yes, the Kafka team has told me that this is how it works (at least for 0.72).
Philip
On Fri, Aug 23, 2013 at 7:53 AM, Yu, Libo wrote:
> Hi team,
>
> Right now, from a stream, an iterator can be obtained which has a blocking
> hasNext().
> So what is the implementation behind the iterator? I as
Hi team,
Right now, from a stream, an iterator can be obtained which has a blocking
hasNext().
So what is the implementation behind the iterator? I assume there must be queue
and
the iterator monitors the queue. And a separate thread fetches data and feeds
to the
queue when it is almost empty.
ok,Thanks ~
On Tue, Jan 22, 2013 at 12:08 AM, Jun Rao wrote:
> Normally it shouldn't. If the problem shows up again, I suggest that you
> use the ConsumerOffsetChecker tool to see if the consumer is indeed
> lagging.
>
> Thanks,
>
> Jun
>
> On Mon, Jan 21, 2013 at 2:56 AM, Bo Sun wrote:
>
> > i
Normally it shouldn't. If the problem shows up again, I suggest that you
use the ConsumerOffsetChecker tool to see if the consumer is indeed lagging.
Thanks,
Jun
On Mon, Jan 21, 2013 at 2:56 AM, Bo Sun wrote:
> it's not any exceptions. i found sth.today, "several days later " , it's
> no data
it's not any exceptions. i found sth.today, "several days later " , it's
no data to produce to kafka. but after several days . kafka get the new
data. but cannot consume anything . is that ( no data days ) couse the
problem?
Thanks Eric
On Mon, Jan 21, 2013 at 2:13 PM, Jun Rao wrote:
> When
When the consumption stops in GroupA, were there any error/exception in the
consumer logic?
One common cause for a consumer to stop is that the application code hits
an exception while consuming an event. In particular, if you are using java
thread pool and haven't attached an exception handler, t
0.7.1 thanks
On Thu, Jan 17, 2013 at 11:26 PM, Jun Rao wrote:
> What version of Kafka are you using?
>
> Thanks,
>
> Jun
>
> On Wed, Jan 16, 2013 at 10:10 PM, Bo Sun wrote:
>
> > I'v got a problem like this.
> > 1. I use the groupname "GourpA" to consume the kafka topic "topicA" .
> > several d
What version of Kafka are you using?
Thanks,
Jun
On Wed, Jan 16, 2013 at 10:10 PM, Bo Sun wrote:
> I'v got a problem like this.
> 1. I use the groupname "GourpA" to consume the kafka topic "topicA" .
> several days later , we cannot got the new data from the consumer.
> 2. Then i use the group
I'v got a problem like this.
1. I use the groupname "GourpA" to consume the kafka topic "topicA" .
several days later , we cannot got the new data from the consumer.
2. Then i use the groupname "groupB" to consume the kafa topic "topicA". in
this new consumer , i got the new data. and i get the ne
35 matches
Mail list logo
