RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-23 Thread Shankar hiremath
Dear All, Observation: I have HBase cluster with Kerberos enabled, when the Region Server startups then we observed some 20-30 socket fds are in CLOSE_WAIT state, After that when the Region Server starts opening then the socket fds in CLOSE_WAIT starts increasing gradually (almost same as number

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-23 Thread ramkrishna vasudevan
Does your regions have store files in them? In HBase all the store files are opened and the readers are kept open always when the region opening happens. When there is a compaction happening the count of those file handlers open gets reduced based on the number of files compacted. Regards Ram O

RE: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Shankar hiremath
bject: Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared Does your regions have store files in them? In HBase all the store files are opened and the readers are kept open always when the region opening happens. When there is a compaction happening the count of those file hand

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread ramkrishna vasudevan
amkrishna.s.vasude...@gmail.com] > Sent: 24 July 2014 PM 12:23 > To: user@hbase.apache.org > Subject: Re: RegionServer many socket fds are in CLOSE_WAIT and not > getting cleared > > Does your regions have store files in them? > In HBase all the store files are opened and the reade

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Qiang Tian
der > > by phone or email immediately and delete it! > > > > > > > > > > -----Original Message----- > > From: ramkrishna vasudevan [mailto:ramkrishna.s.vasude...@gmail.com] > > Sent: 24 July 2014 PM 12:23 > > To: user@hbase.apache.org > > Su

RE: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Shankar hiremath
[mailto:tian...@gmail.com] Sent: 24 July 2014 PM 03:19 To: user@hbase.apache.org Subject: Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared what is your hbase version? the close_wait is in regionserver process, probably rpc connection close() is not call due to some reason? can

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Esteban Gutierrez
> -Original Message- > From: Qiang Tian [mailto:tian...@gmail.com] > Sent: 24 July 2014 PM 03:19 > To: user@hbase.apache.org > Subject: Re: RegionServer many socket fds are in CLOSE_WAIT and not > getting cleared > > what is your hbase version? > the close_wait is in regi

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Andrew Purtell
s other than the intended recipient(s) is > > prohibited. If you receive this e-mail in error, please notify the sender > > by phone or email immediately and delete it! > > > > > > > > > > > > -Original Message- > > From: Qiang Tian [mailt

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Arpit Agarwal
+Hbase User On Wed, Jul 23, 2014 at 11:04 PM, Shankar hiremath < shankar.hirem...@huawei.com> wrote: > Dear All, > > Observation: > I have HBase cluster with Kerberos enabled, when the Region Server > startups then we observed some 20-30 socket fds are in CLOSE_WAIT state, > After that when the