Tom Lane <t...@sss.pgh.pa.us> wrote: 
 
> It'd be useful first off to figure out if it's a CPU or I/O issue.
> Is there any visible difference in vmstat output?  Also, try turning
> off autovacuum in both cases, just to see if that's related.
 
Both took slightly longer with autovacuum off, but probably just
within the noise.
 
It's hard to interpret the vmstat output, largely because I chose to
run this on one of our biggest servers, which is not currently serving
an application, per se, but as a replication target, and this being
"off hours" is busy running the sync process to the source machines. 
This involves generating md5 sums on both sides for blocks of rows,
which is pretty CPU-intensive.  There is very little disk output from
that right now, pretty light on the disk reads, but keeping a few CPUs
pretty busy generating those md5 sums.
 
I've got to go keep an appointment, but I'll come back and see if I
can do more.  For now, here's the raw vmstat, in case someone can pick
out info I'm missing:
 
-Kevin

baseline:
 
procs -----------memory---------- ---swap-- -----io---- -system-- -----cpu------
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
 3  1    240 1456928  70164 124350736    0    0  1016    78    0    0  6  1 89  
4  0
 4  0    240 1451224  70164 124356896    0    0  5580    47 5457 39514 15  3 74 
 8  0
 2  1    240 1445812  70172 124361008    0    0  4988   543 5347 36680 15  3 73 
 9  0
 3  1    240 1440196  70172 124366144    0    0  5928   501 3431 30250 14  3 76 
 8  0
 3  1    240 1434444  70172 124372312    0    0  5920    47 6477 34794 16  2 73 
 9  0
 1  3    240 1428916  70172 124376424    0    0  5268   468 5449 33003 15  2 73 
10  0
 1  1    240 1422820  70172 124382592    0    0  5036   107 3995 26131 12  2 75 
11  0
 1  3    240 1418556  70172 124387728    0    0  4052   156 4562 33519 12  2 78 
 8  0
 1  3    240 1412972  70180 124392864    0    0  5544   676 5063 32300 14  2 73 
11  0
 1  3    240 1406964  70180 124399032    0    0  5796   119 4743 28285 12  2 74 
13  0
 0  3    240 1400992  70180 124404176    0    0  6112   116 4184 15183  9  1 75 
15  0
 4  0    240 1396372  70180 124410336    0    0  4604   119 4123 38639 14  2 74 
10  0
 3  1    240 1391936  70180 124416512    0    0  4572   332 5025 38534 15  3 73 
 9  0
 2  3    240 1387324  70188 124418560    0    0  4796   397 4271 23039 11  2 80 
 8  0
 2  1    240 1380196  70188 124425752    0    0  6864   209 5583 32509 16  2 73 
 9  0
 1  3    240 1374980  70188 124432944    0    0  5292    52 5007 37758 15  2 74 
 9  0
 0  0    240 1372708  70188 124435008    0    0  2600   132 3363 18199  9  1 86 
 4  0
 2  2    240 1367488  70188 124439120    0    0  5152   430 5450 42153 18  3 74 
 6  0
 
8.3.7 test:
 
procs -----------memory---------- ---swap-- -----io---- -system-- -----cpu------
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
 0  0    240 590064  70164 125219392    0    0  1016    78    0    0  6  1 89  
4  0
 4  1    240 586336  70164 125221448    0    0  3628    37 4990 39525 15  3 77  
5  0
 2  0    240 581892  70164 125226592    0    0  4556    50 5597 33057 16  2 76  
5  0
 3  1    240 578616  70164 125229672    0    0  3500    42 3902 36959 14  3 80  
4  0
 3  1    240 573520  70164 125234816    0    0  5232    82 5081 26713 15  2 75  
8  0
 1  3    240 591688  70164 125217336    0    0  4612 15890 5256 33309 13  3 76  
8  0
 3  1    240 586944  70172 125220416    0    0  4596   100 4640 23263 12  2 77  
9  0
 3  1    240 595632  70160 125215280    0    0  5512  5814 5314 26822 16  2 73  
8  0
 1  2    240 581200  70152 125229680    0    0  4684 39061 3604 26682 16  3 67 
14  0
 4  1    240 596972  70152 125211184    0    0  1508 53915 2729 20654  9  3 83  
5  0
 2  4    240 589184  70152 125220432    0    0  4140 44877 3809 82485 12  4 69 
16  0
 1  4    240 597620  70116 125209160    0    0  5744 54096 4597 26422 14  3 66 
17  0
 1  4    240 585936  70116 125219440    0    0  4136 44584 3661 35574 18  3 68 
11  0
 0  5    240 601460  70096 125203008    0    0  4968 54009 4669 26507 12  3 72 
14  0
 1  4    240 592604  70080 125210224    0    0  5064 44674 4190 40394 14  3 71 
12  0
 2  3    240 604844  70076 125196864    0    0  5528 49601 4664 39189 18  4 68 
10  0
 1  4    240 590348  70072 125214344    0    0  7716 49397 4949 41086 18  3 67 
11  0
 1  4    240 600036  70060 125200992    0    0  4152 53968 4641 31875 16  3 66 
15  0
 1  4    240 587336  70052 125212304    0    0  6420 44620 4427 47627 16  4 67 
13  0
 3  2    240 582508  70044 125215400    0    0  4524 32812 4510 256103 18  9 60 
13  0
 5  1    240 603680  70020 125192808    0    0  6584 33341 3844 28189 16  3 68 
13  0
 4  1    240 591464  70016 125206176    0    0  6180 54710 6664 37282 20  3 64 
13  0
 5  1    240 586924  70020 125212336    0    0  5748 44552 5351 39772 18  3 67 
11  0
 4  1    240 602376  70004 125193856    0    0  5840 54181 4824 34279 17  4 67 
12  0
 3  2    240 586816  70016 125208232    0    0  5764 44604 5151 36577 19  4 66 
11  0
 0  6    240 594248  70004 125201048    0    0  1844 155959 3455 18643 10  2 72 
16  0
 0  5    240 593708  70004 125201048    0    0   568 86177  938 3286  1  1 65 
33  0
 5  1    240 584752  70004 125210304    0    0  3048 65967 2507 13585  6  1 71 
22  0
 5  0    240 591348  69996 125200032    0    0  6052 54033 5755 47300 16  3 67 
14  0
 9  0    240 588984  69992 125202088    0    0  5412 44549 5912 41640 19  4 67  
9  0
 3  2    240 597288  70000 125192832    0    0  4932 100169 4388 38583 16  4 68 
12  0
 4  0    240 588424  70000 125201056    0    0  5644 44586 4622 80474 17  4 69 
10  0
 3  2    240 595240  70000 125192832    0    0  3988 60860 4884 133166 21  8 64 
 7  0
 2  2    240 590912  70000 125197968    0    0  5388    39 4126 45577 16  3 75  
6  0
 4  0    240 587372  70000 125202080    0    0  3524    90 6014 53819 19  4 74  
3  0
 2  3    240 582560  70008 125205152    0    0  4536 31763 5278 38437 15  3 75  
7  0

8.4rc1 test:
 
procs -----------memory---------- ---swap-- -----io---- -system-- -----cpu------
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
 0  0    240 1287356  70208 124520304    0    0  1016    78    0    0  6  1 89  
4  0
 3  1    240 1284660  70208 124524416    0    0  2868    34 3587 29557 11  2 85 
 2  0
 3  1    240 1279860  70208 124528528    0    0  4836   101 5194 42884 18  3 73 
 6  0
 3  2    240 1275056  70212 124532640    0    0  4684   158 5465 36991 16  3 73 
 8  0
 0  2    240 1263284  70212 124542920    0    0  4408 28164 3974 23725 14  2 74 
10  0
 5  0    240 1250564  70212 124555256    0    0  1560 37397 2019 19256  7  2 84 
 7  0
 1  4    240 1235324  70212 124571704    0    0  6080 34716 5140 24951 14  3 68 
15  0
 4  1    240 1217792  70212 124589184    0    0  5980 37729 3854 32427 16  4 68 
12  0
 4  0    240 1203884  70212 124600488    0    0  1480 39227 3491 21508 10  2 83 
 5  0
 2  4    240 1188804  70220 124615904    0    0  5632 51850 5526 28898 16  3 66 
15  0
 4  1    240 1171632  70220 124632352    0    0  5580 36163 5949 29191 17  3 66 
14  0
 2  3    240 1156340  70220 124648800    0    0  4464 37555 3826 26459 15  2 72 
11  0
 5  1    240 1140684  70220 124665248    0    0  4644 36814 5823 36929 19  3 67 
11  0
 3  1    240 1131484  70220 124674496    0    0  4784 37517 4436 26394 16  3 70 
12  0
 5  0    240 1111080  70220 124695056    0    0  1644 52557 3217 24840 11  3 82 
 4  0
 4  3    240 1096592  70228 124710464    0    0  4260 36061 5069 58768 21  5 67 
 8  0
 2  3    240 1079168  70228 124726912    0    0  5552 37792 5311 29631 16  3 67 
14  0
 3  3    240 1059292  70228 124745424    0    0  6328 39051 3641 28413 17  3 68 
12  0
 4  1    240 1048212  70228 124754672    0    0  4824 33963 6520 37910 17  4 68 
12  0
 2  3    240 1029280  70228 124774208    0    0  5016 50793 4434 25577 14  3 69 
14  0
 3  3    240 1014132  70236 124787560    0    0  3108 38636 3460 16941 10  2 80 
 9  0
 4  1    240 996936  70236 124805040    0    0  5004 38295 5388 38612 20  3 66 
11  0
 5  1    240 979748  70236 124822512    0    0  5028 38293 5466 41689 18  3 68 
11  0
 4  3    240 965460  70236 124836904    0    0  4780 49665 4376 36979 17  4 67 
13  0
 2  5    240 951400  70236 124850272    0    0  4264 96618 6222 47678 19  4 67 
10  0
 0  6    240 950920  70236 124850272    0    0   384 123092  858 3979  1  0 58 
41  0
 6  0    240 943736  70244 124858480    0    0  2060 50630 2924 20746  9  2 67 
22  0
 4  0    240 927924  70244 124873904    0    0  4012 37003 5367 50649 20  5 68  
7  0
 4  1    240 913016  70244 124888296    0    0  4748 51125 5662 48438 20  5 68  
8  0
 0  6    240 898188  70244 124902688    0    0  4740 71452 4847 42958 18  4 67 
11  0
 5  0    240 884288  70244 124916048    0    0  3340 34776 5150 53089 17  5 67 
11  0
 0  1    240 870228  70244 124929416    0    0  4108 34547 2235 35575 18  3 70  
9  0
 4  1    240 854660  70252 124945856    0    0  3524 38198 6555 35867 15  3 76  
6  0
 5  0    240 838620  70252 124961280    0    0  4272 37602 5276 64432 21  6 69  
4  0
 1  4    240 822460  70252 124976696    0    0  6256 87739 4655 41708 19  3 67 
11  0
 4  1    240 810904  70252 124989032    0    0  3056 32703 5567 53686 18  3 67 
12  0
 7  0    240 796852  70252 125002400    0    0  4400 50627 3802 47900 21  4 68  
6  0
 4  1    240 783208  70252 125016784    0    0  3524 34064 5975 39859 15  4 76  
5  0
 4  0    240 774568  70260 125023976    0    0  4516  9483 5610 48929 18  4 72  
6  0
 1  3    240 769208  70260 125029120    0    0  4700 33609 4112 47078 17  4 74  
5  0
-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers

Reply via email to