Re: Question regarding url_param hashing

2010-05-25 Thread Willy Tarreau
Hi Jeff, I'm copying Dirk who has experienced exactly the same issue as yours a few weeks ago, and we stopped investigating because of a supposedly insufficient input data distribution. However, David (cc'd) has been using consistent hashing with success. Also, I know that it was working for me wh

Re: Question regarding url_param hashing

2010-05-25 Thread Jeffrey J. Persch
On May 25, 2010, at 3:03 PM, Jeffrey J. Persch wrote: Any insights as to why srv->puid is zero and not unique per server? I'll answer my own question. The consistent hash server tree is initialized in check_config_validity, line 5075. Generated puids are not assigned until check_config_val

Re: Question regarding url_param hashing

2010-05-25 Thread Jeffrey J. Persch
Greetings, I have reproduced this same issue on haproxy-1.4.6. Configure a backend with balance url_param x hash-type consistent server s1 host1:80 server s2 host2:80 server s3 host3:80 server s4 host4:80 The server will only dispatch requests to

Re: Question regarding url_param hashing

2010-04-20 Thread Willy Tarreau
On Tue, Apr 20, 2010 at 04:56:01PM +0200, Dirk Taggesell wrote: > Many thanks, Willy for answering my questions. > > > But in my opinion, when you start playing > > with 10 to 100 times more URLs than you have servers, I really > > don't see how you could be "lucky" enough to always reach the same

Re: Question regarding url_param hashing

2010-04-20 Thread Dirk Taggesell
Many thanks, Willy for answering my questions. > But in my opinion, when you start playing > with 10 to 100 times more URLs than you have servers, I really > don't see how you could be "lucky" enough to always reach the same > servers. We will test the consistent hashing again once we have produc

Re: Question regarding url_param hashing

2010-04-19 Thread Willy Tarreau
On Mon, Apr 19, 2010 at 12:49:13PM +0200, Dirk Taggesell wrote: > On Mon, Apr 12, 2010 at 8:50 PM, Dirk Taggesell > wrote: > > Hank A. Paulson wrote: > > > >> How varied is your "site" param? are there many variations or just a few > >> similar strings? > > > > There's a large amount of distincti

Re: Question regarding url_param hashing

2010-04-19 Thread Dirk Taggesell
On Mon, Apr 12, 2010 at 8:50 PM, Dirk Taggesell wrote: > Hank A. Paulson wrote: > >> How varied is your "site" param? are there many variations or just a few >> similar strings? > > There's a large amount of distinctive urls, maybe some are requested > several times, but still al large amount of

Re: Question regarding url_param hashing

2010-04-12 Thread Dirk Taggesell
Hank A. Paulson wrote: > How varied is your "site" param? are there many variations or just a few > similar strings? There's a large amount of distinctive urls, maybe some are requested several times, but still al large amount of different site urls. There is also another GET parameter, which is

Re: Question regarding url_param hashing

2010-04-12 Thread Hank A. Paulson
On 4/12/10 8:25 AM, Dirk Taggesell wrote: On Mon, Apr 12, 2010 at 12:07 AM, David Birdsong wrote: It's expected that consistent hashing won't provide an even distribution to your backends. You'll need to adjust the weights of each server to even out the traffic if you want a smooth distrib

Re: Question regarding url_param hashing

2010-04-12 Thread Dirk Taggesell
On Mon, Apr 12, 2010 at 12:07 AM, David Birdsong wrote: > It's expected that consistent hashing won't provide an even > distribution to your backends.   You'll need to adjust the weights of > each server to even out the traffic if you want a smooth distribution > of requests to backends. Granted

Re: Question regarding url_param hashing

2010-04-11 Thread David Birdsong
On Sat, Apr 10, 2010 at 11:08 AM, Dirk Taggesell wrote: > On Thu, Apr 8, 2010 at 10:57 PM, Willy Tarreau wrote: > >> In 1.4 you should probably use "hash-type consistent" to avoid redispatching >> everyone when one server falls down. > > Thanks for eyplaining, Willy, > > we tested everything so f

Re: Question regarding url_param hashing

2010-04-10 Thread Dirk Taggesell
On Thu, Apr 8, 2010 at 10:57 PM, Willy Tarreau wrote: > In 1.4 you should probably use "hash-type consistent" to avoid redispatching > everyone when one server falls down. Thanks for eyplaining, Willy, we tested everything so far (with version 1.4.4) and we discovered a strange behaviour: We ha

Re: Question regarding url_param hashing

2010-04-08 Thread Willy Tarreau
Hi Dirk, On Thu, Apr 08, 2010 at 09:14:31PM +0200, Dirk Taggesell wrote: > Hi all, > > I have a question regarding the balancing algorithm with > "balance url_param site": ist the distribution of requests to the > back-ends reproducible or random? > > The urls will look like this: > http://hostn

Question regarding url_param hashing

2010-04-08 Thread Dirk Taggesell
Hi all, I have a question regarding the balancing algorithm with "balance url_param site": ist the distribution of requests to the back-ends reproducible or random? The urls will look like this: http://hostname.com?site=www.someplace.com/bla/blubb.html