Re: experiences with hbase-2492

2010-06-15 Thread Friso van Vollenhoven
I did not try the tcp_tw_reuse, because I am a bit fuzzy on what that exactly does. That is, what is the difference between recycling and reusing? The man page for tcp just mentions that tcp_tw_reuse allows to reuse TIME_WAIT sockets if it is safe from the protocol viewpoint and that it should n

Re: experiences with hbase-2492

2010-06-15 Thread Vidhyashankar Venkataraman
Friso, You may be knowing this already, but please bear in mind there is a potential risk of packets from previous connections that were in flight reach the new connections (that's the reason for the TIME_WAIT state in TCP).. And that may lead to unexpected behaviour.. Vidhya On 6/15/10 9:1

Re: experiences with hbase-2492

2010-06-15 Thread Todd Lipcon
Might be worth trying tcp_tw_reuse before turning on tw_recycle - as I understand it, the former is a lot safer than the latter. Can't wait for HDFS-941 some day :) -Todd On Tue, Jun 15, 2010 at 9:10 AM, Jean-Daniel Cryans wrote: > Friso, > > This is very interesting, and nobody answered probab

Re: experiences with hbase-2492

2010-06-15 Thread Andrew Purtell
Doh! I meant tcp_tw_reuse. Sorry, paste-o. - Andy --- On Tue, 6/15/10, Andrew Purtell wrote: > From: Andrew Purtell > Subject: Re: experiences with hbase-2492 > To: user@hbase.apache.org > Cc: fvanvollenho...@xebia.com > Date: Tuesday, June 15, 2010, 9:59 AM > tcp_tw_recyc

Re: experiences with hbase-2492

2010-06-15 Thread Andrew Purtell
tcp_tw_recycle did not do what you needed? - Andy > On Mon, Jun 14, 2010 at 11:40 PM, Friso van Vollenhoven wrote: > Hi all, > > Since I got no replies to my previous message (see > below), I went ahead and set the tcp_tw_recycle to true. > This worked like a charm. The number of sockets in TI

Re: experiences with hbase-2492

2010-06-15 Thread Jean-Daniel Cryans
Friso, This is very interesting, and nobody answered probably because no one tried tcp_tw_recycle. I personally didn't even know about that config until a few minutes ago ;) So from the varnish mailing list, it seems that machines behind firewalls or NAT won't play well with that config, but I do

Re: experiences with hbase-2492

2010-06-14 Thread Friso van Vollenhoven
Hi all, Since I got no replies to my previous message (see below), I went ahead and set the tcp_tw_recycle to true. This worked like a charm. The number of sockets in TIME_WAIT went down from many thousands to just a couple (tens). Apparently, once set to true, the recycling happens quite eager

experiences with hbase-2492

2010-06-11 Thread Friso van Vollenhoven
Hi all, We are experiencing a lot of "java.net.BindException: Cannot assign requested address", which is a case of https://issues.apache.org/jira/browse/hbase-2492. At some point, all grinds to a halt and regionservers start to shut down. I was wondering if anyone has found a way around this pro