Re: Kafka connection issues

2020-09-23 Thread Ramya Ramamurthy
hi Kostas, Copy pasting this snippet where we see the fluctuations. Let me know if this helps. 2020-09-22 23:39:19,646 DEBUG org.apache.kafka.clients.NetworkClient - Node 3 disconnected. 2020-09-22 23:39:19,646 DEBUG org.apache.kafka.clients.NetworkClient -

Re: Kafka connection issues

2020-09-23 Thread Kostas Kloudas
Hi Ramya, Unfortunately I cannot see them. Kostas On Wed, Sep 23, 2020 at 10:27 AM Ramya Ramamurthy wrote: > > Hi Kostas, > > Attaching the taskmanager logs regarding this issue. > I have attached the Kaka related metrics. I hope you can see it this time. > > Not sure why we get these many

Re: Kafka connection issues

2020-09-23 Thread Ramya Ramamurthy
Hi Kostas, Attaching the taskmanager logs regarding this issue. I have attached the Kaka related metrics. I hope you can see it this time. Not sure why we get these many disconnects to Kafka. Maybe because of this interruptions, we seem to slow down on our processing. At some point the memory

Re: Kafka connection issues

2020-09-22 Thread Kostas Kloudas
Hi Ramya, Unfortunately your images are blocked. Could you upload them somewhere and post the links here? Also I think that the TaskManager logs may be able to help a bit more. Could you please provide them here? Cheers, Kostas On Tue, Sep 22, 2020 at 8:58 AM Ramya Ramamurthy wrote: > Hi, > >

Kafka connection issues

2020-09-22 Thread Ramya Ramamurthy
Hi, We are seeing an issue with Flink on our production. The version is 1.7 which we use. We started seeing sudden lag on kafka, and the consumers were no longer working/accepting messages. On trying to enable debug mode, the below errors were seen [image: image.jpeg] I am not sure why this