frontend stopped responding

2013-04-10 Thread Will Glass-Husain
Hi, I've been running with haproxy (dev18 on Ubuntu 12.04) under load for a few days, and then it stopped responding to most requests. Any suggestions to help me figure out what happened? Here's what I know: * From my web browser, requests would time out to the haproxy server * I have an Amazon

RE: frontend stopped responding

2013-04-10 Thread Lukas Tribus
Hi Will! > stopped responding to most requests. How did you recover from that condition? Restart HAproxy? Reboot the whole VM? When in that condition, did you see any other warnings or errors (dmesg, etc)? How was the load and memory usage (top, vmstat, free, uptime, etc)? Regards, Lukas

Re: frontend stopped responding

2013-04-10 Thread Will Glass-Husain
Hi, I have an Amazon ELB in front of haproxy. To recover I switched away from the haproxy server to an older Apache-based web server. No warnings is syslog or dmesg. Load was high, around 1.5. I didn't check memory (foolishly). Here's a question -- which is better to use - httpclose or http-

RE: frontend stopped responding

2013-04-10 Thread Lukas Tribus
> No warnings is syslog or dmesg Can you issue a "show errors" [1] on the control socket? > To recover I switched away from the haproxy server to > an older Apache-based web server. So haproxy is still in a broken condition on that server? If thats the case, you could attach strace to the proc

Re: frontend stopped responding

2013-04-10 Thread Will Glass-Husain
Hi, Unfortunately, I restarted haproxy, so show errors returns little of use. Good to know about this command though. root@www1-new:/var/log# echo "show errors" | socat unix-connect:/tmp/haproxy stdio Total events captured on [10/Apr/2013:12:29:14.795] : 0 Here's haproxy-vv root@www1-new:/var

RE: frontend stopped responding

2013-04-10 Thread Lukas Tribus
> Unfortunately, I restarted haproxy, so show errors > returns little of use. Alright, since we don't know what actually happened and there are no similar reports, we will probably not find the root cause this time. Next time this happens, please collect the information I asked using "show errors

Re: frontend stopped responding

2013-04-10 Thread Will Glass-Husain
That's helpful. Hard to remember to be comprehensive at 3AM sometimes. Any guidelines for server specs? WILL On Wed, Apr 10, 2013 at 6:10 AM, Lukas Tribus wrote: > > Unfortunately, I restarted haproxy, so show errors > > returns little of use. > > Alright, since we don't know what actually h

Re: Invalid ACL with Dev-18 JIT

2013-04-10 Thread Hiroaki Nakamura
Hi Lukas, Thanks for your bug report. Sorry for not responding earlier. Actually I did not watch this mailing list for some time. I made a patch to fix this problem. After applying this patch, it seems work correctly now. /etc/haproxy/haproxy.cfg ``` frontend all 0.0.0.0:80 default_backend ng

Re: frontend stopped responding

2013-04-10 Thread Maxime Ducharme
Check if you have packet loss when this happens, we have seen similar issues which were explained by AWS tech support that the IRQ of network card of the physical machine was saturated by another customer of AWS. This was resosurce issue. The bigger instance you take, the more resources you will

Re: frontend stopped responding

2013-04-10 Thread Will Glass-Husain
That seems a pretty good theory. Specifically, how were you testing for packet loss? Were you using ethtool? WILL On Wed, Apr 10, 2013 at 8:20 AM, Maxime Ducharme wrote: > Check if you have packet loss when this happens, we have seen similar > issues which were explained by AWS tech support t

Re: frontend stopped responding

2013-04-10 Thread Maxime Ducharme
ICMP echo requests from another EC2 instance in same availability zone would show packet loss. We could see it also from multiple monitoring nodes with Pingdom services. The haproxy server itself would not report much errors except problems talking to backends but nothing in dmesg or ethtool. 2

HAProxy and Zimbra

2013-04-10 Thread Phil Daws
Hello, have just started to explore HAProxy and am finding it amazing! As a long time Zimbra user I wanted to see how one could balance the front-end web client so had a play around. What I have at present is the following configuration: frontend zimbra-zwc-frontend-https bind 172.30.8.21

Re: HAProxy and Zimbra

2013-04-10 Thread David Coulson
On Apr 10, 2013, at 2:36 PM, Phil Daws wrote: > Hello, > > have just started to explore HAProxy and am finding it amazing! As a long > time Zimbra user I wanted to see how one could balance the front-end web > client so had a play around. What I have at present is the following > configurati

Re: HAProxy and Zimbra

2013-04-10 Thread Phil Daws
1.5-dev18 ... as said this is all very new to me. Amazing tech. Appreciate the help. - Original Message - From: "David Coulson" To: "Phil Daws" Cc: haproxy@formilux.org Sent: Wednesday, 10 April, 2013 7:46:30 PM Subject: Re: HAProxy and Zimbra On Apr 10, 2013, at 2:36 PM, Phil Daws wro

RE: Invalid ACL with Dev-18 JIT

2013-04-10 Thread Lukas Tribus
Hi Hiroaki! > I made a patch to fix this problem. > After applying this patch, it seems work correctly now. Thank you, it does work with your patch applied, great! Now you are declaring error and erroffset outside "#ifdef USE_PCRE_JIT", but actually use them only inside. This causes a compiler

Re: HAProxy crashing on start

2013-04-10 Thread Will Glass-Husain
Hi, I have more info on this. It seems that this problem occurs when I bring a haproxy server up and there's already an existing haproxy server in the peer group --> Server A is running and handles requests --> Server B comes up and immediately dies. I believe if both servers are already up and

Re: Invalid ACL with Dev-18 JIT

2013-04-10 Thread Hiroaki Nakamura
Hi Lukas! 2013/4/11 Lukas Tribus : > Hi Hiroaki! > >> I made a patch to fix this problem. >> After applying this patch, it seems work correctly now. > > Thank you, it does work with your patch applied, great! Thank you for your testing! > > > Now you are declaring error and erroffset outside "#i

HAProxy v1.5 - Stable

2013-04-10 Thread Scott Exton
I was just wondering if you had any idea when a stable version of HA Proxy 1.5 will be released? Thanks, Scott.

Re: Invalid ACL with Dev-18 JIT

2013-04-10 Thread Willy Tarreau
Hi Hiroaki, On Thu, Apr 11, 2013 at 09:48:05AM +0900, Hiroaki Nakamura wrote: > Hi Lukas! > > 2013/4/11 Lukas Tribus : > > Hi Hiroaki! > > > >> I made a patch to fix this problem. > >> After applying this patch, it seems work correctly now. > > > > Thank you, it does work with your patch applied,

Re: HAProxy crashing on start

2013-04-10 Thread Willy Tarreau
Hi Will, On Wed, Apr 10, 2013 at 05:00:33PM -0700, Will Glass-Husain wrote: > Hi, > > I have more info on this. It seems that this problem occurs when I bring a > haproxy server up and there's already an existing haproxy server in the > peer group > --> Server A is running and handles requests >