Re: Kafka stream issue : Deleting obsolete state directory

2018-09-24 Thread Bhavesh Patel
Hi Bill, Please find the log as requested. 2018-09-24 15:53:59.594 INFO 1 --- [pool-2-thread-1] i.micrometer.influx.InfluxMeterRegistry : successfully sent 2793 metrics to influx 2018-09-24 15:54:59.608 INFO 1 --- [pool-2-thread-1] i.micrometer.influx.InfluxMeterRegistry : successfully sent

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-24 Thread Bill Bejeck
Hi Bhavesh, I've taken a look at what you've posted, but I'll need the logs *before *the exception occurred. Can you attach the entire log? In the meantime, if this causing issues, you can effectively disable *state.cleanup.delay.ms *to a large value (Long.MAX_VAL

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-20 Thread Bhavesh Patel
Hi Bill, Yes and thanks for your response. Many thanks, Bhavesh Patel On Thu, Sep 20, 2018, 21:31 Bill Bejeck wrote: > Hi Bhavesh, > > I haven't forgotten about you, just got sidetracked with some other > issues. > > Just to be clear you are using Kafka Streams version 2.0 correct? > > I'll ta

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-20 Thread Bill Bejeck
Hi Bhavesh, I haven't forgotten about you, just got sidetracked with some other issues. Just to be clear you are using Kafka Streams version 2.0 correct? I'll take a look in the next day or so. Thanks, Bill On Thu, Sep 20, 2018 at 2:31 PM Bhavesh Patel wrote: > Hi, > Is it possible to get h

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-20 Thread Bhavesh Patel
Hi, Is it possible to get h lp with below issue? Many Thanks, Bhavesh Patel On Wed, Sep 19, 2018, 09:13 Bhavesh Patel wrote: > Hi Bill, > Apologies, I was trying to attached image. > Please find below the error log, > > 2018-09-18 09:26:09.112 INFO 1 --- [5-CleanupThread] > o.a.k.s.p.internals

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-19 Thread Bhavesh Patel
Hi Bill, Apologies, I was trying to attached image. Please find below the error log, 2018-09-18 09:26:09.112 INFO 1 --- [5-CleanupThread] o.a.k.s.p.internals.StateDirectory : stream-thread [ApplicationName-1ae22d38-32d3-451a-b039-372c79b2e6a5-CleanupThread] Deleting obsolete state directory

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-18 Thread Bill Bejeck
Hi Bhavesh, Sorry, but I'm still not seeing any log file attachment, maybe it's being filtered out. Can you copy the relevant section in the body of the email? Thanks, Bill On Tue, Sep 18, 2018 at 3:21 PM Bhavesh Patel wrote: > Hi Bill, > > Apologies, Please find the error stack attached. > >

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-18 Thread Bhavesh Patel
Hi Bill, Apologies, Please find the error stack attached. We are using kafka 2.0. Thanks, Bhavesh Patel On Tue, Sep 18, 2018 at 8:04 PM Bill Bejeck wrote: > Hi Bhavesh, > > I don't see the log file attachment, can you resend it? > > Also, what version of Kafka Streams are you running? > > Tha

Re: Kafka stream issue : Deleting obsolete state directory

2018-09-18 Thread Bill Bejeck
Hi Bhavesh, I don't see the log file attachment, can you resend it? Also, what version of Kafka Streams are you running? Thanks, Bill On Tue, Sep 18, 2018 at 12:31 PM Bhavesh Patel wrote: > Hi, > > We have a stream application where we are facing a little strange problem > with deleting state

Kafka stream issue : Deleting obsolete state directory

2018-09-18 Thread Bhavesh Patel
Hi, We have a stream application where we are facing a little strange problem with deleting state directory. Our application is deployed into in-house container platform and storage is backed by nfs. When app is running for a while and when it hits the cleanup delay of 60ms as defined dafaul