Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread ????
hello, everybody, how can I unsubscribe kafka users emails, Thank you! -- Original -- From: "Philip O'Toole";; Date: Thu, Aug 21, 2014 10:20 AM To: "users@kafka.apache.org"; Subject: Re: Keep on getting kafka.common.OffsetOutOfRang

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Philip O'Toole
s (if I have been >> following the thread correctly) -- when the retention time passes, the >> message is gone. Either consume your messages sooner, or increase your >> retention time. Kafka is not magic, it can only do what it's told. >> >> In practise I have fou

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Steve Miller
gt; On Wednesday, August 20, 2014 1:42 AM, "pradeep.si...@wipro.com" > wrote: > > > > Sure, I would try with setting longer retention hours. But I feel this would > not be good approach? Should we raise it as a bug? > > Thanks, > Pradeep Simha > Technical Le

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Guozhang Wang
, August 20, 2014 1:31 PM > To: users@kafka.apache.org > Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: > Random times > > We had a similar issue in our dev environments, where we had to configure > aggressive log retention to save space. > And the clients ke

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Philip O'Toole
al Lead > > -Original Message- > From: Steve Miller [mailto:st...@idrathernotsay.com] > Sent: Tuesday, August 19, 2014 6:13 PM > To: users@kafka.apache.org > Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: > Random times > >  Also, what do

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread pradeep.simha
:31 PM To: users@kafka.apache.org Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times We had a similar issue in our dev environments, where we had to configure aggressive log retention to save space. And the clients kept failing with this error, on Mondays, because

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Manjunath Shivakumar
://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction From: Steve Miller [st...@idrathernotsay.com] Sent: 20 August 2014 08:47 To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times That seems likely. I'

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Steve Miller
iginal Message- > From: Steve Miller [mailto:st...@idrathernotsay.com] > Sent: Tuesday, August 19, 2014 6:13 PM > To: users@kafka.apache.org > Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random > times > > Also, what do you have log.retention.hours set to? H

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread pradeep.simha
ssage- From: Steve Miller [mailto:st...@idrathernotsay.com] Sent: Tuesday, August 19, 2014 6:13 PM To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times Also, what do you have log.retention.hours set to? How often do you publish mes

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread pradeep.simha
...@gmail.com] Sent: Tuesday, August 19, 2014 10:05 PM To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times How often do you push messages to the brokers? Guozhang On Tue, Aug 19, 2014 at 2:12 AM, wrote: > Hi Team, > > Can someo

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread Guozhang Wang
etention.check.interval.ms=6 > > Am I doing anything wrong here? Since I haven't touched this properties > file. > > Thanks, > Pradeep Simha > Technical Lead > > -Original Message- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Tuesday,

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread Steve Miller
.si...@wipro.com [mailto:pradeep.si...@wipro.com] > Sent: Tuesday, August 19, 2014 9:30 AM > To: users@kafka.apache.org > Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random > times > > Hi Neha, > > Yes, I am using the latest version ie (0.8.1.1)

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread pradeep.simha
...@wipro.com [mailto:pradeep.si...@wipro.com] Sent: Tuesday, August 19, 2014 9:30 AM To: users@kafka.apache.org Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times Hi Neha, Yes, I am using the latest version ie (0.8.1.1). Hi Guozhang, These are the values

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-18 Thread pradeep.simha
hanks, Pradeep Simha Technical Lead -Original Message- From: Neha Narkhede [mailto:neha.narkh...@gmail.com] Sent: Tuesday, August 19, 2014 2:27 AM To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times Also, what version of Kafka are you

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-18 Thread Neha Narkhede
Also, what version of Kafka are you using? 0.8.1.1 is the latest most stable version. On Mon, Aug 18, 2014 at 9:36 AM, Guozhang Wang wrote: > Hi Pradeep, > > It seems your logs gets deleted due to retention policy. Could you check > the config values for log.retention.bytes and > log.retention.

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-18 Thread Guozhang Wang
Hi Pradeep, It seems your logs gets deleted due to retention policy. Could you check the config values for log.retention.bytes and log.retention.check.interval.ms? http://kafka.apache.org/documentation.html#brokerconfigs Guozhang On Mon, Aug 18, 2014 at 5:49 AM, wrote: > Hi Team, > > Of late