One observation. [r...@dr01 tmp]# ipvsadm -L -n --rate IP Virtual Server version 1.2.1 (size=4096) Prot LocalAddress:Port CPS InPPS OutPPS InBPS OutBPS -> RemoteAddress:Port TCP 192.168.16.183:8080 190 1333 0 228019 0 -> 192.168.16.180:8080 32 221 0 37969 0 -> 192.168.16.181:8080 32 220 0 37934 0 -> 192.168.16.178:8080 32 224 0 38017 0 -> 192.168.16.176:8080 32 224 0 38083 0 As per my understanding, CPS means connection per second. Here it shows 190 connections on VIP and 32 on each real server. What i have noticed 32 is the max it shows for real servers. Not sure, if this can be increased or how this is controlled ?
On Fri, Oct 29, 2010 at 10:55 AM, Anil Pillai <[email protected]> wrote: > Yes, i have done the test from two systems as well. > > I have monitored the CPU load reals server & director and it was nominal. > > > > On Fri, Oct 29, 2010 at 8:30 AM, Henrique Fernandes <[email protected]>wrote: > >> Are you runing ab in two diferente machines ? >> >> 10.84.53.243 <http://10.84.53.243:60300/> >> <http://192.168.16.178:8080/>10.84.53.244 <http://10.84.53.244:55993/> >> >> >> Can you see the cpu load on both machines and the ldirectord server ? >> >> >> []'sf.rique >> >> >> On Thu, Oct 28, 2010 at 5:48 PM, Anil Pillai <[email protected]> wrote: >> >> > yes still its the same. >> > >> > Will change it to wrr and see. >> > >> > On Fri, Oct 29, 2010 at 2:47 AM, Sfrique <[email protected]> wrote: >> > >> > > Wlc is the balancer method.... >> > > You could choose between others... Like wrr >> > > >> > > well you got 150 again?? >> > > >> > > It seens you are using 2 servers to run ab. >> > > >> > > I will look into it closer later im on my phone... >> > > ----- Original message ----- >> > > > Please find the latest stats >> > > > >> > > > [r...@dr01 ha.d]# ipvsadm -L -n >> > > > IP Virtual Server version 1.2.1 (size=4096) >> > > > Prot LocalAddress:Port Scheduler Flags >> > > > -> RemoteAddress:Port Forward Weight >> ActiveConn >> > > InActConn >> > > > TCP 192.168.16.183:8080 wlc >> > > > -> 192.168.16.178:8080 Route 1 100 >> > > 5129 >> > > > -> 192.168.16.176:8080 Route 1 100 >> > > 5116 >> > > > -> 192.168.16.177:8080 Route 1 100 >> > > 5117 >> > > > [r...@dr01 ha.d]# ipvsadm -L -n --stats >> > > > IP Virtual Server version 1.2.1 (size=4096) >> > > > Prot LocalAddress:Port Conns InPkts >> > > OutPkts InBytes >> > > > OutBytes >> > > > -> RemoteAddress:Port >> > > > TCP 192.168.16.183:8080 22106 154555 >> > > 0 26451062 >> > > > 0 >> > > > -> 192.168.16.178:8080 7377 51598 >> > > 0 8828089 >> > > > 0 >> > > > -> 192.168.16.176:8080 7374 51578 >> > > 0 8824550 >> > > > 0 >> > > > -> 192.168.16.177:8080 7355 51379 >> > > 0 8798423 >> > > > 0 >> > > > [r...@dr01 ha.d]# ipvsadm -L -n --rate >> > > > IP Virtual Server version 1.2.1 (size=4096) >> > > > Prot LocalAddress:Port CPS InPPS >> > > OutPPS InBPS >> > > > OutBPS >> > > > -> RemoteAddress:Port >> > > > TCP 192.168.16.183:8080 19 >> 150 >> > > 0 23312 >> > > > 0 >> > > > -> 192.168.16.178:8080 6 >> > > 50 0 7775 >> > > > 0 >> > > > -> 192.168.16.176:8080 6 >> > > 50 0 7741 >> > > > 0 >> > > > -> 192.168.16.177:8080 6 >> > > 50 0 7796 >> > > > 0 >> > > > >> > > > [r...@dr01 ha.d]# ipvsadm -L -n --connection >> > > > IP Virtual Server version 1.2.1 (size=4096) >> > > > IPVS connection entries >> > > > pro expire state source virtual >> > > destination >> > > > TCP 00:22 FIN_WAIT 10.84.53.244:56447 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:16 FIN_WAIT 10.84.53.243:60102 192.168.16.183:8080 >> > > > 192.168.16.178:8080 >> > > > TCP 00:12 FIN_WAIT 10.84.53.244:55531 192.168.16.183:8080 >> > > > 192.168.16.178:8080 >> > > > TCP 00:03 FIN_WAIT 10.84.53.243:58875 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:22 FIN_WAIT 10.84.53.244:56341 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:17 FIN_WAIT 10.84.53.244:55922 192.168.16.183:8080 >> > > > 192.168.16.178:8080 >> > > > TCP 00:05 FIN_WAIT 10.84.53.244:54851 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:20 FIN_WAIT 10.84.53.244:56227 192.168.16.183:8080 >> > > > 192.168.16.178:8080 >> > > > TCP 00:00 FIN_WAIT 10.84.53.244:54475 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:18 FIN_WAIT 10.84.53.243:60300 192.168.16.183:8080 >> > > > 192.168.16.178:8080 >> > > > TCP 00:18 FIN_WAIT 10.84.53.244:55993 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:17 FIN_WAIT 10.84.53.244:55956 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:11 FIN_WAIT 10.84.53.244:55404 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:06 FIN_WAIT 10.84.53.243:59238 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:18 FIN_WAIT 10.84.53.243:60293 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:16 FIN_WAIT 10.84.53.244:55866 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:17 FIN_WAIT 10.84.53.244:55905 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:24 FIN_WAIT 10.84.53.243:60891 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:20 FIN_WAIT 10.84.53.243:60458 192.168.16.183:8080 >> > > > 192.168.16.178:8080 >> > > > TCP 00:12 FIN_WAIT 10.84.53.244:55486 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:06 FIN_WAIT 10.84.53.243:59241 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > TCP 00:01 FIN_WAIT 10.84.53.244:54504 192.168.16.183:8080 >> > > > 192.168.16.176:8080 >> > > > TCP 00:14 FIN_WAIT 10.84.53.243:59877 192.168.16.183:8080 >> > > > 192.168.16.177:8080 >> > > > I am not clear about the question on wlc and ipvs. >> > > > >> > > > Regards, >> > > > >> > > > On Thu, Oct 28, 2010 at 5:11 PM, Henrique Fernandes >> > > > <[email protected]>wrote: >> > > > >> > > > > When you give ab to 192.168.16.183:8080 it does not get 450 >> > > > > connections ? >> > > > > >> > > > > Do this: >> > > > > >> > > > > #ipvsadm --zero >> > > > > >> > > > > Check to see if stats is zero for each server. >> > > > > >> > > > > Now use ab to server 192.168.16.183:8080 while the test are being >> > use, >> > > >> > > > > see --conections, try to get like more than once. >> > > > > >> > > > > after test over, use --stats and post here again! >> > > > > >> > > > > I guess as you are seeing you can figureout >> > > > > >> > > > > By the way, is a choise of your to use wlc balancer and route in >> > ipvs >> > > > > ? >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > []'sf.rique >> > > > > >> > > > > >> > > > > On Thu, Oct 28, 2010 at 3:59 AM, Anil Pillai <[email protected]> >> > > > > wrote: >> > > > > >> > > > > > Below is the the output of commands. >> > > > > > >> > > > > > >> > > > > > [r...@dr01 ~]# ipvsadm -L -n >> > > > > > IP Virtual Server version 1.2.1 (size=4096) >> > > > > > Prot LocalAddress:Port Scheduler Flags >> > > > > > -> RemoteAddress:Port Forward Weight >> ActiveConn >> > > InActConn >> > > > > > TCP 192.168.16.183:8080 wlc >> > > > > > -> 192.168.16.178:8080 Route 1 0 >> > > 59 >> > > > > > -> 192.168.16.176:8080 Route 1 0 >> > > 59 >> > > > > > -> 192.168.16.177:8080 Route 1 0 >> > > 81 >> > > > > > >> > > > > > [r...@dr01 ~]# ipvsadm -L -n --stats >> > > > > > IP Virtual Server version 1.2.1 (size=4096) >> > > > > > Prot LocalAddress:Port Conns >> InPkts >> > > OutPkts InBytes >> > > > > > OutBytes >> > > > > > -> RemoteAddress:Port >> > > > > > TCP 192.168.16.183:8080 23514 164005 >> > > 0 23122438 >> > > > > > 0 >> > > > > > -> 192.168.16.178:8080 8532 59554 >> > > 0 8380480 >> > > > > > 0 >> > > > > > -> 192.168.16.176:8080 7628 53138 >> > > 0 7459184 >> > > > > > 0 >> > > > > > -> 192.168.16.177:8080 7354 51313 >> > > 0 7282774 >> > > > > > 0 >> > > > > > >> > > > > > [r...@dr01 ~]# ipvsadm -L -n --connection >> > > > > > IPVS connection entries >> > > > > > pro expire state source >> virtual >> > > >> > > > > > destination >> > > > > > >> > > > > > --connection, didn;t give any output. >> > > > > > >> > > > > > Yes, i get 150 on each server when tested simultaneously. >> > > > > > >> > > > > > >> > > > > > On Wed, Oct 27, 2010 at 8:03 PM, Henrique Fernandes >> > > > > > <[email protected] >> > > > > > > wrote: >> > > > > > >> > > > > > > Can you please post the outputs of this comands in the >> diretord. >> > > > > > > >> > > > > > > #ipvsadm -L -n >> > > > > > > >> > > > > > > #ipvsadm -L --n --stats >> > > > > > > >> > > > > > > #ipvsadm -L -n --connection >> > > > > > > >> > > > > > > >> > > > > > > And if you use ab to test both servers at same time you get >> 150 >> > on >> > > > > > > each >> > > > > ? >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > []'sf.rique >> > > > > > > >> > > > > > > >> > > > > > > On Wed, Oct 27, 2010 at 10:50 AM, Anil Pillai < >> > [email protected]> >> > > >> > > > > > wrote: >> > > > > > > >> > > > > > > > Hi, >> > > > > > > > >> > > > > > > > I have a LVS/DR setup (ldirectord) with One Director and two >> > Real >> > > >> > > > > > > Servers. >> > > > > > > > On Real Servers i have Apache Webserver running on port >> 8080. >> > > > > > > > Each Apache is capable of serving 150 TPS. >> > > > > > > > Now when i did load testing via Virtual IP, i am still >> getting >> > > > > > > > same >> > > > > TPS >> > > > > > > > (150). >> > > > > > > > For load testing i have used apache benckmark (ab) tool. >> > > > > > > > As per my understanding via Load Balancer (VIP) TPS should >> > > > > > > > increase >> > > > > and >> > > > > > > > should get around 300 TPS. >> > > > > > > > >> > > > > > > > Not sure where i am going wrong. Can anyone help me on this >> ? >> > > > > > > > >> > > > > > > > Below is the Setup Details: >> > > > > > > > >> > > > > > > > Director (Just acts as director only): >> > > > > > > > >> > > > > > > > 10.50.57.55 -> Virtual IP >> > > > > > > > 10.50.57.45 -> Physical IP >> > > > > > > > >> > > > > > > > Real Server 1: >> > > > > > > > 10.50.57.22 -> Physical IP on eth0 >> > > > > > > > lo:0 Link encap:Local Loopback >> > > > > > > > >> > > > > > > > inet addr:10.50.57.55 Mask:255.255.255.255 >> > > > > > > > >> > > > > > > > UP LOOPBACK RUNNING MTU:16436 Metric:1 >> > > > > > > > >> > > > > > > > Real Server 2: >> > > > > > > > 10.50.57.23 -> Physical IP on eth0 >> > > > > > > > lo:0 Link encap:Local Loopback >> > > > > > > > >> > > > > > > > inet addr:10.50.57.55 Mask:255.255.255.255 >> > > > > > > > >> > > > > > > > UP LOOPBACK RUNNING MTU:16436 Metric:1 >> > > > > > > > >> > > > > > > > # Global Directives >> > > > > > > > checktimeout=3 >> > > > > > > > checkinterval=6 >> > > > > > > > autoreload=yes >> > > > > > > > logfile="/var/log/ldirectord.log" >> > > > > > > > quiescent=yes >> > > > > > > > # HTTP services >> > > > > > > > virtual=10.50.57.55:8080 >> > > > > > > > service=http >> > > > > > > > scheduler=rr >> > > > > > > > protocol=tcp >> > > > > > > > checktype=negotiate >> > > > > > > > real=10.50.57.22:8080 >> > > > > > > > real=10.50.57.23:8080 >> > > > > > > > request="test/lvs.html" >> > > > > > > > receive="Test Page" >> > > > > > > > >> > > > > > > > >> > > > > > > > Added Below line in sysctl.conf on Real Servers: >> > > > > > > > net.ipv4.conf.lo.arp_ignore = 1 >> > > > > > > > net.ipv4.conf.lo.arp_announce = 2 >> > > > > > > > net.ipv4.conf.all.arp_ignore = 1 >> > > > > > > > net.ipv4.conf.all.arp_announce = 2 >> > > > > > > > >> > > > > > > > >> > > > > > > > Regards, >> > > > > > > > _______________________________________________ >> > > > > > > > Please read the documentation before posting - it's >> available >> > at: >> > > >> > > > > > > > http://www.linuxvirtualserver.org/ >> > > > > > > > >> > > > > > > > LinuxVirtualServer.org mailing list - >> > > > > [email protected] >> > > > > > > > Send requests to [email protected] >> > > > > > > > or go to >> http://lists.graemef.net/mailman/listinfo/lvs-users >> > > > > > > > >> > > > > > > _______________________________________________ >> > > > > > > Please read the documentation before posting - it's available >> at: >> > > > > > > http://www.linuxvirtualserver.org/ >> > > > > > > >> > > > > > > LinuxVirtualServer.org mailing list - >> > > > > > > [email protected] Send requests to >> > > > > > > [email protected] or go to >> > > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users >> > > > > > > >> > > > > > _______________________________________________ >> > > > > > Please read the documentation before posting - it's available >> at: >> > > > > > http://www.linuxvirtualserver.org/ >> > > > > > >> > > > > > LinuxVirtualServer.org mailing list - >> > > > > > [email protected] Send requests to >> > > > > > [email protected] or go to >> > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users >> > > > > > >> > > > > _______________________________________________ >> > > > > Please read the documentation before posting - it's available at: >> > > > > http://www.linuxvirtualserver.org/ >> > > > > >> > > > > LinuxVirtualServer.org mailing list - >> > [email protected] >> > > > > Send requests to [email protected] >> > > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users >> > > > > >> > > > _______________________________________________ >> > > > Please read the documentation before posting - it's available at: >> > > > http://www.linuxvirtualserver.org/ >> > > > >> > > > LinuxVirtualServer.org mailing list - >> [email protected] >> > > > Send requests to [email protected] >> > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users >> > > >> > > >> > _______________________________________________ >> > Please read the documentation before posting - it's available at: >> > http://www.linuxvirtualserver.org/ >> > >> > LinuxVirtualServer.org mailing list - [email protected] >> > Send requests to [email protected] >> > or go to http://lists.graemef.net/mailman/listinfo/lvs-users >> > >> _______________________________________________ >> Please read the documentation before posting - it's available at: >> http://www.linuxvirtualserver.org/ >> >> LinuxVirtualServer.org mailing list - [email protected] >> Send requests to [email protected] >> or go to http://lists.graemef.net/mailman/listinfo/lvs-users >> > > _______________________________________________ Please read the documentation before posting - it's available at: http://www.linuxvirtualserver.org/ LinuxVirtualServer.org mailing list - [email protected] Send requests to [email protected] or go to http://lists.graemef.net/mailman/listinfo/lvs-users
