Re: [Zenloadbalancer-support] Zen just stopped working.... v2rc2

Mon, 20 Feb 2012 09:06:25 -0800

Marco
 
Thanks for clarifying, you confused me talking about MTU 500 !
I did some PING tests during the 'down phase and they were ok, I am just testing the old PEN Binary to see it their is an issue in the v2rc2 release.
 
Thanks for your quick reply.
Nick

>>> "Marco Tiggelaar - Key4ce" <[email protected]> 20/02/2012 16:41 >>>
Just to reply on what MTU is..
MTU Stands for: maximum transmission unit (MTU)
It is basically the largest protocol data unit that your network can use.

It was more as a hint as it produces weird effects (simular to what your having) where the network / service works.. but in certain ways doesn't work.
i also mentioned 1500 (default)  not 500 :)

in most common cases MTU uses 1500.
in your case the command (in linux zenloadbalancer) :
ping -f -l 1500 server-IP-Of-Destination

If you get anything else but ping results it indicates your MTU is off

You can also find the MTU your network card is using (in linux) by using ifconfig

Which displays like:

UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

Tho your issue is most likely not MTU it doesn't hurt to cross this off your list (as thats a tricky one that is normally always the last one on peoples list after been driven crazy for a long while - yet it's very simple to check as mentioned above ^^)

Regards,
Marco
--
   Key4ce General Manager
---------------------------------------------------
Phone NL: +31 (0)40  290 3310
Phone EN: +44 (0)1332 898 999

Italielaan 9
Eindhoven
The Netherlands
---------------------------------------------------
       http://www.key4ce.com

-----Original Message-----
From: Nick Furnell <[email protected]>
Reply-to: Nick Furnell <[email protected]>
To: [email protected]
Subject: Re: [Zenloadbalancer-support] Zen just stopped working.... v2rc2
Date: Mon, 20 Feb 2012 16:26:00 +0000

Hi Emilio   I have swapped the PEN binary now, I noticed a slight difference in the file sizes (v2rc2 = 82493, v2rc1 = 82329) - was their a change to the code?  Any thoughts as to the problem?   I will monitor the new farm settings and let you have the feedback over the next couple of days.    Thank you for the speedy reply.   Nick

>>> "Emilio Campos" <[email protected]> 20/02/2012 14:35 >>>
Hi, Nick , I attached the pen binary file of the v2rc1, please change it in your zen lb v2rc2

1º

mv /usr/local/zenloadbalancer/app/pen/bin/pen /usr/local/zenloadbalancer/app/pen/bin/pen_v2rc2

2º. Copy the pen binary in the tar.gz file attached in

/usr/local/zenloadbalancer/app/pen/bin/

3º apply execution permission

chmod +x /usr/local/zenloadbalancer/app/pen/bin/pen

4º
Restart your tcp farms

And check if the problem repeat.

Regards!


2012/2/20 Laura Garcia <[email protected]>
Hi Nick, what is the exact problem, the connection is refused from the VIP service?

Can you see the connections to the farm are established/syn/closed on the farms panel?
Have you tried to connect to the VIP service from the localhost Zen LB?


Regards,
Laura.


On Mon, Feb 20, 2012 at 2:45 PM, Nick Furnell <[email protected]> wrote:
Hi Emilio

This has just happened again. It has followed immediately after me changing the Sticky Client options for another farm, not sure if this is related..?

All servers are showing GREEN in the GUI summary page, Client Sessions 173 Active, and Active connections 550 max, 0 used, 69 last (but non showing).
The interface is also GREEN, edit, no change then UP - made no difference.

I can PING the virtual interface of the Farm
I can PING from the ZLB CLI to all my real servers.
I have tried CHECK_HTTP and the response is 'OK'
I can also hit the 'real' servers directly from my laptop, they respond OK.

Marco suggested MTU 500 - not sure what that means, I have asked him directly.
Tried: PING 192.168.1.20 -s 500

Here is the ZLB Log for the last 20 minutes, from just before it went off:-

Mon Feb 20 13:24:39 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:40 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:40 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:41 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:42 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:43 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:45 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:46 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:47 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:48 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:24:59 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:25:01 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:25:07 2012 - * - 192.168.10.137 - admin - loading the TIM-Clustered Farm data
Mon Feb 20 13:25:07 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:25:07 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 timeout' for TIM-Clustered farm tcp
Mon Feb 20 13:25:07 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 servers'
Mon Feb 20 13:25:07 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 blacklist' for TIM-Clustered farm
Mon Feb 20 13:25:07 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 servers'
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - loading the TIM-Clustered Farm data
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - setting 'MaxClientTime 500 3600' for TIM-Clustered farm tcp
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running 'Stop write true' for TIM-Clustered farm tcp
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running 'kill 15, 30556
'
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running 'Start write true' for TIM-Clustered farm tcp
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running /usr/local/zenloadbalancer/app/pen/bin/pen -S 2 -c 500 -x 500 -F '/usr/local/zenloadbalancer/config/TIM-Clustered_pen.cfg' -C 127.0.0.1:15381 192.168.1.49:80

Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - The max number of clients has been modified, the farm TIM-Clustered has been restarted
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 clients_max'
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 timeout' for TIM-Clustered farm tcp
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 servers'
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 blacklist' for TIM-Clustered farm
Mon Feb 20 13:26:46 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15381 servers'
Mon Feb 20 13:27:19 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15185 clients_max'
Mon Feb 20 13:27:21 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15185 clients_max'
Mon Feb 20 13:27:31 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15185 clients_max'
Mon Feb 20 13:28:06 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15185 clients_max'
Mon Feb 20 13:28:10 2012 - * - 192.168.10.137 - admin - running '/usr/local/zenloadbalancer/app/pen/bin/penctl 127.0.0.1:15185 clients_max'
Mon Feb 20 13:41:08 2012 - * - 192.168.10.137 - admin - running '/sbin/ip rule del from 192.168.1.46 table table_eth0'
Mon Feb 20 13:41:08 2012 - * - 192.168.10.137 - admin - running '/sbin/ifconfig eth0:PNagent 192.168.1.46 netmask 255.255.255.0'
Mon Feb 20 13:41:08 2012 - * - 192.168.10.137 - admin - running '/sbin/ip link set eth0:PNagent up'
Mon Feb 20 13:41:08 2012 - * - 192.168.10.137 - admin - Network interface eth0:PNagent is now UP
Mon Feb 20 13:41:08 2012 - * - 192.168.10.137 - admin - running '/sbin/ip rule del from 192.168.1.46 table table_eth0'
Mon Feb 20 13:41:08 2012 - * - 192.168.10.137 - admin - running '/sbin/ip rule add from 192.168.1.46 table table_eth0'
Mon Feb 20 13:41:08 2012 - * - 192.168.10.137 - admin - All is ok, saved eth0:PNagent interface config file

Any more thoughts?
Nick

>>> "Emilio Campos" <[email protected]> 20/02/2012 10:48 >>>

Nick, for the next time, before restarting It could be very useful to know the number of active connections , the max value and used value in manage farm section of farm is failing:

Table with header "Active connections 257 max, 0 used, 0 last "

Other question, is there a firewall between your vip zlb and your backends? or are they in the same subnet?

Regards


2012/2/20 Nick Furnell <[email protected]>
Hi Laura

This was a TCP farm on port 80 (today) and SMTP port (25) on Friday.

When the SMTP server was down, I tried Telnet from my laptop direct to the real servers (ok) and via ZLB address (nothing). I didn't try directly from the ZLB CLI

Thanks
Nick

>>> "Laura Garcia" <[email protected]> 20/02/2012 08:44 >>>

Has been detected in tcp or http farms?

El 20/02/2012 9:12, "Nick Furnell" <[email protected]> escribió:

Hi Guys

I have found this situation twice now, once on Friday and now again Monday morning. The Zen servers are fine, but they do not process any traffic to the 'real' servers?

Real servers are ok - tested them directly
Both ZLB servers are ok - logged in to both of them.
Communication between ZLB serves looked ok.

Decided to push the 'Test Failover button'.... it fixed it on BOTH occasions.

Any thoughts as to why ZLB is stopping processing?

Nick





Transform Medical Group (CS) Limited.
Registered in England & Wales with Company Number: 3228476
Registered office: 192 Altrincham Road, Manchester M22 4RZ

Transform Medical Group(CS) is registered in England and Wales, number 3228476. The registered office is at 192 Altrincham Road, Manchester, M22 4RZ. The information contained in this electronic message and any attachments (the "Message") is intended for one or more specific individuals or entities, and may be confidential, proprietary, privileged or otherwise protected by law. If you are not the intended recipient, please notify the sender immediately, delete this Message and do not disclose, distribute, or copy it to any third party or otherwise use this Message. Electronic messages are not secure or error free and can contain viruses or may be delayed, and the sender is not liable for any of these occurrences. The sender reserves the right to monitor, record and retain electronic messages.




------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Zenloadbalancer-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/zenloadbalancer-support




--
Load balancer distribution - Open Source Project
http://www.zenloadbalancer.com
Distribution list (subscribe): [email protected]



Transform Medical Group (CS) Limited.
Registered in England & Wales with Company Number: 3228476
Registered office: 192 Altrincham Road, Manchester M22 4RZ

Transform Medical Group(CS) is registered in England and Wales, number 3228476. The registered office is at 192 Altrincham Road, Manchester, M22 4RZ. The information contained in this electronic message and any attachments (the "Message") is intended for one or more specific individuals or entities, and may be confidential, proprietary, privileged or otherwise protected by law. If you are not the intended recipient, please notify the sender immediately, delete this Message and do not disclose, distribute, or copy it to any third party or otherwise use this Message. Electronic messages are not secure or error free and can contain viruses or may be delayed, and the sender is not liable for any of these occurrences. The sender reserves the right to monitor, record and retain electronic messages.



------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Zenloadbalancer-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/zenloadbalancer-support




------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Zenloadbalancer-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/zenloadbalancer-support




--
Load balancer distribution - Open Source Project
http://www.zenloadbalancer.com
Distribution list (subscribe): [email protected]



Transform Medical Group (CS) Limited.
Registered in England & Wales with Company Number: 3228476
Registered office: 192 Altrincham Road, Manchester M22 4RZ

Transform Medical Group(CS) is registered in England and Wales, number 3228476. The registered office is at 192 Altrincham Road, Manchester, M22 4RZ. The information contained in this electronic message and any attachments (the "Message") is intended for one or more specific individuals or entities, and may be confidential, proprietary, privileged or otherwise protected by law. If you are not the intended recipient, please notify the sender immediately, delete this Message and do not disclose, distribute, or copy it to any third party or otherwise use this Message. Electronic messages are not secure or error free and can contain viruses or may be delayed, and the sender is not liable for any of these occurrences. The sender reserves the right to monitor, record and retain electronic messages.



Transform Medical Group (CS) Limited.
Registered in England & Wales with Company Number: 3228476
Registered office: 192 Altrincham Road, Manchester M22 4RZ
Transform Medical Group(CS) is registered in England and Wales, number 3228476. The registered office is at 192 Altrincham Road, Manchester, M22 4RZ. The information contained in this electronic message and any attachments (the "Message") is intended for one or more specific individuals or entities, and may be confidential, proprietary, privileged or otherwise protected by law. If you are not the intended recipient, please notify the sender immediately, delete this Message and do not disclose, distribute, or copy it to any third party or otherwise use this Message. Electronic messages are not secure or error free and can contain viruses or may be delayed, and the sender is not liable for any of these occurrences. The sender reserves the right to monitor, record and retain electronic messages. 

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Zenloadbalancer-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/zenloadbalancer-support

Reply via email to