Re: [CentOS] vmstat and loadavg disagree about system load
Hi John, Followed line is quoted from “man vmstat”, it means r+b=running process + uninterruptible sleep process. So, what’s the definition of system load, doesn’t it include running process and process in uninterruptible sleep. Which part is wrong? Please explicitly denote. > Procs > r: The number of processes waiting for run time. > b: The number of processes in uninterruptible sleep. Regards, Mingfei -Original Message- From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On Behalf Of John R Pierce Sent: 2014年10月9日 13:19 To: centos@centos.org Subject: Re: [CentOS] vmstat and loadavg disagree about system load On 10/8/2014 10:01 PM, Mingfei Hua wrote: > The man interpretation of vmstat running and blocked process: > Procs > r: The number of processes waiting for run time. > b: The number of processes in uninterruptible sleep. > The blocked here is not process waiting user input, it should include process > waiting IO and network. It should has same meaning with system load in > loadavg which include running(runnable) process and process in status of > uninterruptible sleep. 'should' according to what ? Linux has *NEVER* worked that way. -- john r pierce 37N 122W somewhere on the middle of the left coast ___ CentOS mailing list CentOS@centos.org<mailto:CentOS@centos.org> http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] vmstat and loadavg disagree about system load
The man interpretation of vmstat running and blocked process: Procs r: The number of processes waiting for run time. b: The number of processes in uninterruptible sleep. The blocked here is not process waiting user input, it should include process waiting IO and network. It should has same meaning with system load in loadavg which include running(runnable) process and process in status of uninterruptible sleep. Regards, Mingfei -Original Message- From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On Behalf Of John R Pierce Sent: 2014年10月9日 12:24 To: centos@centos.org Subject: Re: [CentOS] vmstat and loadavg disagree about system load On 10/8/2014 9:00 PM, Mingfei Hua wrote: > The first two number of vmstat is running process and blocked process, the > sum of the two number should equal to system load. But it's inconsistent in > this case. linux load average counts processes that are doing disk IO or network IO as being 'ready'. they aren't actually running, but neither are they waiting on user input ('blocked' per vmstat's version of reality). -- john r pierce 37N 122W somewhere on the middle of the left coast ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] vmstat and loadavg disagree about system load
Hi John, The first two number of vmstat is running process and blocked process, the sum of the two number should equal to system load. But it's inconsistent in this case. Regards, Mingfei -Original Message- From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On Behalf Of John R Pierce Sent: 2014年10月9日 11:57 To: centos@centos.org Subject: Re: [CentOS] vmstat and loadavg disagree about system load On 10/8/2014 8:48 PM, Mingfei Hua wrote: > 1 4 499492 150392 4496 476338000 192 552 1227 1094 2 0 75 24 > 0 > ... > 1 2 499520 135936 4428 477085200 27144 120 2428 2449 9 1 85 6 > 0 > 2 1 499520 148336 4428 476166800 19072 192 2281 2420 8 1 83 8 > 0 > 0 2 499520 156408 4432 474965200 12416 436 1303 1235 3 0 86 11 > 0 > ... > [root@idm-amst-db-12 ~]# uptime > 01:47:47 up 26 days, 4:21, 1 user, load average: 26.85, 22.12, 19.38 > [root@idm-amst-db-12 ~]# uptime > 01:47:58 up 26 days, 4:21, 1 user, load average: 24.38, 21.74, 19.29 > [root@idm-amst-db-12 ~]# cat /proc/loadavg > 25.40 22.05 19.45 1/555 13911 > two completely different sorts of numbers.vmstat is printing the % of CPU usage by user, sys, and idle.load average is the average number of 'ready to run' processes in the last 1, 5, and 15 minutes. -- john r pierce 37N 122W somewhere on the middle of the left coast ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] vmstat and loadavg disagree about system load
1 4 499492 150392 4496 476338000 192 552 1227 1094 2 0 75 24 0 0 5 499492 150656 4500 476352800 0 160 465 263 1 0 68 30 0 0 5 499492 150468 4500 476353200 0 0 177 93 1 0 69 31 0 1 5 499492 151020 4500 476354000 0 0 160 132 0 0 69 31 0 1 5 499492 151268 4500 476354000 0 0 304 143 1 0 69 30 0 0 5 499492 151368 4500 476354000 0 344 369 192 0 0 69 31 0 0 1 499492 145020 4512 477103200 6260 1428 2013 2613 4 1 79 17 0 2 0 499492 140432 4512 476939600 3187272 2393 2796 8 1 87 3 0 1 0 499500 137332 4512 476943208 2598480 2052 2012 8 1 90 1 0 1 0 499508 132992 4512 477259208 24960 384 2325 2344 8 1 90 1 0 3 0 499520 135720 4400 47687920 12 24840 252 2491 2345 9 1 89 1 0 0 2 499520 210740 4404 469309600 15904 384 1798 1513 6 1 90 4 0 1 2 499520 210856 4404 469363600 0 0 154 119 0 0 87 12 0 0 2 499520 211328 4404 469383200 0 0 128 119 0 0 87 13 0 0 2 499520 212080 4404 469383200 0 0 128 144 0 0 87 12 0 0 2 499520 212700 4404 469383600 0 0 115 135 0 0 87 13 0 0 2 499520 213196 4404 469383600 0 336 88 102 0 0 87 12 0 2 0 499520 202552 4416 470450400 7984 17852 2036 1828 6 1 87 7 0 2 0 499520 172800 4416 473320800 25744 128 2165 2094 9 1 89 2 0 2 0 499520 153872 4416 475446800 18816 392 2000 1996 7 0 88 4 0 3 0 499520 169620 4416 473830000 27520 480 2346 2248 9 1 90 1 0 2 0 499520 140260 4416 476532800 24584 224 2247 2231 9 1 90 1 0 0 2 499520 179204 4416 472574800 17164 3564 1701 1619 5 1 87 8 0 0 2 499520 179948 4416 472548800 0 0 209 131 1 0 87 13 0 0 2 499520 180072 4416 472549200 0 0 111 117 0 0 87 12 0 0 2 499520 180436 4416 472549200 0 0 71 81 0 0 87 13 0 0 2 499520 180560 4416 472549200 0 0 182 110 0 0 87 13 0 0 1 499520 180180 4416 472549200 0 344 315 179 0 0 87 12 0 2 0 499520 182196 4428 473130000 2944 1108 1828 1935 6 0 86 8 0 1 0 499520 150180 4428 475729200 2393688 2038 1905 7 1 88 4 0 2 0 499520 157264 4428 475191600 23568 176 2324 2139 8 1 87 5 0 1 2 499520 135936 4428 477085200 27144 120 2428 2449 9 1 85 6 0 2 1 499520 148336 4428 476166800 19072 192 2281 2420 8 1 83 8 0 0 2 499520 156408 4432 474965200 12416 436 1303 1235 3 0 86 11 0 ^C [root@idm-amst-db-12 ~]# ^C [root@idm-amst-db-12 ~]# ^C [root@idm-amst-db-12 ~]# uptime 01:47:47 up 26 days, 4:21, 1 user, load average: 26.85, 22.12, 19.38 [root@idm-amst-db-12 ~]# uptime 01:47:58 up 26 days, 4:21, 1 user, load average: 24.38, 21.74, 19.29 [root@idm-amst-db-12 ~]# cat /proc/loadavg 25.40 22.05 19.45 1/555 13911 Sincerely, Mingfei Hua ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Weird output of system load
This issue happened again, who can help on this? system load up to 72, but /proc/stat only show that 2 processes were running and no process blocked. could it be a bug? /proc/stat cpu 5584507 61716 7213361 166019596 244884 146923 396136 0 0 cpu0 4186208 9686 2596560 81685397 112653 146699 365382 0 0 cpu1 1398298 52029 4616801 84334199 132230 224 30753 0 0 intr 1121292737 139 8 0 0 0 0 0 0 0 0 0 0 106 0 0 73 0 0 550904491 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4022511 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ctxt 1114886293 btime 1409530629 processes 10263085 procs_running 2 procs_blocked 0 softirq 1469123445 0 380686538 182314 632630211 3763285 0 2 56074856 1852476 393933763 /proc/loadavg 72.27 33.47 12.45 3/1906 13601 On Sep 11, 2014, at 2:54 PM, Mingfei Hua mailto:mf...@aerohive.com>> wrote: All, One server of mine running CentOS 6.3. The load is very high, but few process in running or blocked. Followed is the output of /proc/stat, /proc/loadavg and top /proc/stat cpu 5351723 61716 6974590 161365578 240734 141769 380525 0 0 cpu0 4016881 9686 2510787 79408769 110721 141549 351075 0 0 cpu1 1334842 52029 4463802 81956808 130013 220 29449 0 0 intr 1081538370 139 8 0 0 0 0 0 0 0 0 0 0 106 0 0 73 0 0 531522246 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3929190 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ctxt 1074666354 btime 1409530629 processes 9684115 procs_running 1 procs_blocked 0 softirq 1418158114 0 367862840 177073 609942882 3679591 0 2 53962455 1790447 380742824 /proc/loadavg 11.21 22.50 10.74 1/2536 16895 Top –H top - 05:08:02 up 10 days, 4:50, 1 user, load average: 13.24, 23.26, 10.86 Tasks: 2535 total, 1 running, 2534 sleeping, 0 stopped, 0 zombie Cpu(s): 3.1%us, 4.0%sy, 0.0%ni, 92.5%id, 0.1%wa, 0.1%hi, 0.2%si, 0.0%st Mem: 3925040k total, 3780944k used, 144096k free,31464k buffers Swap: 2064376k total, 1196k used, 2063180k free, 3201568k cached Sincerely, Mingfei Hua ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] Weird output of system load
All, One server of mine running CentOS 6.3. The load is very high, but few process in running or blocked. Followed is the output of /proc/stat, /proc/loadavg and top /proc/stat cpu 5351723 61716 6974590 161365578 240734 141769 380525 0 0 cpu0 4016881 9686 2510787 79408769 110721 141549 351075 0 0 cpu1 1334842 52029 4463802 81956808 130013 220 29449 0 0 intr 1081538370 139 8 0 0 0 0 0 0 0 0 0 0 106 0 0 73 0 0 531522246 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3929190 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ctxt 1074666354 btime 1409530629 processes 9684115 procs_running 1 procs_blocked 0 softirq 1418158114 0 367862840 177073 609942882 3679591 0 2 53962455 1790447 380742824 /proc/loadavg 11.21 22.50 10.74 1/2536 16895 Top -H top - 05:08:02 up 10 days, 4:50, 1 user, load average: 13.24, 23.26, 10.86 Tasks: 2535 total, 1 running, 2534 sleeping, 0 stopped, 0 zombie Cpu(s): 3.1%us, 4.0%sy, 0.0%ni, 92.5%id, 0.1%wa, 0.1%hi, 0.2%si, 0.0%st Mem: 3925040k total, 3780944k used, 144096k free,31464k buffers Swap: 2064376k total, 1196k used, 2063180k free, 3201568k cached Sincerely, Mingfei Hua ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos