Re: Kafka 0.8.2.2 - CLOSE_WAITS on broker

2016-08-26 Thread Bharath Srinivasan
Java / OS info: -- java.specification.version = 1.8 java.vendor = Oracle Corporation java.version = 1.8.0_45 Oracle Linux Server release 6.7 kernel version 2.6.32-573.18.1.el6.x86_64 Redacted LSOF - ~46K Close Waits -- java4692 kafka 2618u IPv6

Re: Kafka 0.8.2.2 - CLOSE_WAITS on broker

2016-08-26 Thread Jaikiran Pai
Which Java vendor and version are you using in runtime? Also what OS is this? Can you get the lsof output (on Linux) and paste the output of that to some place (like gist) to show us what descriptors are open etc... -Jaikiran On Friday 26 August 2016 02:49 AM, Bharath Srinivasan wrote: Hello:

Kafka 0.8.2.2 - CLOSE_WAITS on broker

2016-08-25 Thread Bharath Srinivasan
Hello: We are running a data pipeline application stack using Kafka 0.8.2.2 in production. We have been seeing intermittent CLOSE_WAIT on our kafka brokers frequently and they fill up the file handles pretty quickly. By the time the open file count reaches around 40K, the node becomes unresponsive