Re: [expert] High System Load on disk activity
> Offhand I would expect you have hit a condition in a filesystem. You say > "move" does that mean delete as well? If so and if you are using XFS, > that is normal. XFS seems to do something really interesting with deletion, > perhaps some form of defragging of open space. > > if you are using ext2 I would be shocked by this behavior, but the journaling > filesystems do have additional overhead. > > Let's get a little better description of your setup and see if someone can > reproduce the behavior. Doh! Filesystem is the obvious thing i forgot to describe. All partitions are formatted with ext3. I've have them mounted with data=journal at the moment, but i found a speed comparison with ext2, ext3 and reiserfs, which showed the default ext3 to be considerably slower. i'm going to wait till early tommorow till i'm sure there are no or minimal users on the site, stop apache and mysql, then remount the data partition with data=writeback, which is supposedly a lot faster and will still give the same guarantee of consistancy as reiserfs. I had tried data=writeback on the quiet machine, but didn't notice a considerable difference. I'm going to run some tests on the quiet system at the moment, and then try the live system in the morning, so i'll let you know how it goes. my reference: http://groups.google.com/groups?hl=en&lr=&ie=UTF-8&oe=UTF-8&selm=linux.kernel.E162ZQN-00069u-00%40fenrus.demon.nl thanks, thorsten -- |---| |Thorsten-Sideb0ard-| |---Consolidated Independent| |---| Want to buy your Pack or Services from MandrakeSoft? Go to http://www.mandrakestore.com
Re: [expert] High System Load on disk activity
On Wednesday 26 February 2003 08:49 am, thorsten Sideb0ard wrote: > Hi there, > > i recently subscribed to the list, and have been enjoying browsing the > threads, however i didn't think i would be posting as soon... > > I wonder if anyone can offer any advice... > > I have two two machines, built from scratch > comprising of Asus P4S8X motherboard, P4 2.4GHz, > with two IBM drives each, one Deskstar 120GXP 82.3GB UDMA100 for the > system drive and one Deskstar180GXP 185.2GB UDMA100 > as a data partition. > They have a clean install of Mandrake 9.0 > [EMAIL PROTECTED] root]# uname -an > Linux morpheus.cissme.com 2.4.19-16mdkcustom #4 SMP > > The drives themselves seem in good shape: > [EMAIL PROTECTED] root]# hdparm /dev/hda > > /dev/hda: > multcount= 16 (on) > IO_support = 1 (32-bit) > unmaskirq= 0 (off) > using_dma= 1 (on) > keepsettings = 0 (off) > readonly = 0 (off) > readahead= 8 (on) > geometry = 10011/255/63, sectors = 160836480, start = 0 > > > [EMAIL PROTECTED] root]# hdparm /dev/hdc > > /dev/hdc: > multcount= 16 (on) > IO_support = 1 (32-bit) > unmaskirq= 0 (off) > using_dma= 1 (on) > keepsettings = 0 (off) > readonly = 0 (off) > readahead= 8 (on) > geometry = 22526/255/63, sectors = 361882080, start = 0 > > and seem to get good throughput: > > [EMAIL PROTECTED] root]# hdparm -tT /dev/hda > > /dev/hda: > Timing buffer-cache reads: 128 MB in 0.28 seconds =457.14 MB/sec > Timing buffered disk reads: 64 MB in 1.40 seconds = 45.71 MB/sec > > [EMAIL PROTECTED] root]# hdparm -tT /dev/hdc > > /dev/hdc: > Timing buffer-cache reads: 128 MB in 0.28 seconds =457.14 MB/sec > Timing buffered disk reads: 64 MB in 1.18 seconds = 54.24 MB/sec > > > Running Bonnie++ also confirms these results and in addition tells me that > i get about 23MB a second on Rewrite speeds. > > All seems pretty good, until i start trying to move any large amounts > of data around on the drives while also having mysql and apache running. > > > One of the systems is still not being used, so i can use it as a test box: > When i copy 1.7GB of data from hda -> hdc, > it doesn't seem like much load: > > [EMAIL PROTECTED] root]# time cp *.gz /space/scratch.backup/ > 0.13user 17.59system 1:44.22elapsed 17%CPU (0avgtext+0avgdata > 0maxresident)k > 0inputs+0outputs (130major+23minor)pagefaults 0swaps > > Output of non-idle mode ps: > > 4:02pm up 8 days, 22:35, 6 users, load average: 0.97, 0.35, 0.12 > 86 processes: 83 sleeping, 3 running, 0 zombie, 0 stopped > CPU states: 0.5% user, 25.2% system, 0.0% nice, 74.1% idle > Mem: 1551472K av, 1521556K used, 29916K free, 0K shrd, 68920K > buff > Swap: 2097136K av, 154508K used, 1942628K free 1299612K > cached > > PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND > 380 root 18 0 512 512 440 R15.3 0.0 0:17 cp > 421 thorsten 12 0 1044 1044 820 R 0.5 0.0 0:00 top > 383 thorsten 9 0 1816 1816 1628 R 0.0 0.1 0:00 sshd > > > And here is a sample of vmstat 1 while the copy is running: >procs memoryswap io system > cpu r b w swpd free buff cache si sobibo incs us > sy id 1 1 1 154508 31488 69112 1297788 0 0 16000 36752 989 719 > 0 29 71 0 1 0 154508 31748 69064 1297580 0 0 16128 40648 1023 > 851 0 25 75 1 0 0 154508 31080 69060 1298236 0 0 16128 36692 > 928 695 1 26 73 1 0 0 154508 31044 69068 1298280 0 0 16768 > 36632 998 765 0 28 72 1 0 0 154508 31004 69036 1298588 0 0 > 21888 32592 973 922 0 31 69 0 1 1 154508 31084 68928 1298468 0 > 0 17664 40800 1004 774 2 29 69 1 0 0 154508 31348 68856 1298296 > 0 0 17792 32596 947 766 0 25 75 1 0 0 154508 31012 68892 > 1298652 0 0 20480 32592 958 884 1 26 73 0 1 1 154508 30488 > 68960 1299100 0 0 18048 36692 939 799 0 30 70 1 0 1 154508 > 29728 68968 1299748 0 0 16128 40932 1034 722 1 20 79 0 1 0 > 154508 30192 68940 1299324 0 0 16000 36492 971 834 1 24 75 0 > 1 0 154508 30060 68928 1299464 0 0 16128 38696 933 735 0 23 > 77 0 1 0 154508 29908 68920 1299612 0 0 16128 34544 943 656 0 > 28 72 > > > Howver on the box also running mysql and httpd at the same time: > > [EMAIL PROTECTED] root]# time cp *.gz /space/scratch.backup/ > 0.31user 15.43system 3:27.27elapsed 7%CPU (0avgtext+0avgdata > 0maxresident)k > 0inputs+0outputs (130major+23minor)pagefaults 0swaps > > > non-idle ps output: > > 4:26pm up 27 days, 3:03, 6 users, load average: 7.97, 4.42, 2.42 > 419 processes: 418 sleeping, 1 running, 0 zombie, 0 stopped > CPU states: 18.0% user, 58.9% system, 0.0% nice, 23.0% idle > Mem: 1551472K av, 1520456K used, 31016K free, 0K shrd, 17532K > buff > Swap: 2097136K av, 39756K used, 2057380K free
[expert] High System Load on disk activity
Hi there, i recently subscribed to the list, and have been enjoying browsing the threads, however i didn't think i would be posting as soon... I wonder if anyone can offer any advice... I have two two machines, built from scratch comprising of Asus P4S8X motherboard, P4 2.4GHz, with two IBM drives each, one Deskstar 120GXP 82.3GB UDMA100 for the system drive and one Deskstar180GXP 185.2GB UDMA100 as a data partition. They have a clean install of Mandrake 9.0 [EMAIL PROTECTED] root]# uname -an Linux morpheus.cissme.com 2.4.19-16mdkcustom #4 SMP The drives themselves seem in good shape: [EMAIL PROTECTED] root]# hdparm /dev/hda /dev/hda: multcount= 16 (on) IO_support = 1 (32-bit) unmaskirq= 0 (off) using_dma= 1 (on) keepsettings = 0 (off) readonly = 0 (off) readahead= 8 (on) geometry = 10011/255/63, sectors = 160836480, start = 0 [EMAIL PROTECTED] root]# hdparm /dev/hdc /dev/hdc: multcount= 16 (on) IO_support = 1 (32-bit) unmaskirq= 0 (off) using_dma= 1 (on) keepsettings = 0 (off) readonly = 0 (off) readahead= 8 (on) geometry = 22526/255/63, sectors = 361882080, start = 0 and seem to get good throughput: [EMAIL PROTECTED] root]# hdparm -tT /dev/hda /dev/hda: Timing buffer-cache reads: 128 MB in 0.28 seconds =457.14 MB/sec Timing buffered disk reads: 64 MB in 1.40 seconds = 45.71 MB/sec [EMAIL PROTECTED] root]# hdparm -tT /dev/hdc /dev/hdc: Timing buffer-cache reads: 128 MB in 0.28 seconds =457.14 MB/sec Timing buffered disk reads: 64 MB in 1.18 seconds = 54.24 MB/sec Running Bonnie++ also confirms these results and in addition tells me that i get about 23MB a second on Rewrite speeds. All seems pretty good, until i start trying to move any large amounts of data around on the drives while also having mysql and apache running. One of the systems is still not being used, so i can use it as a test box: When i copy 1.7GB of data from hda -> hdc, it doesn't seem like much load: [EMAIL PROTECTED] root]# time cp *.gz /space/scratch.backup/ 0.13user 17.59system 1:44.22elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (130major+23minor)pagefaults 0swaps Output of non-idle mode ps: 4:02pm up 8 days, 22:35, 6 users, load average: 0.97, 0.35, 0.12 86 processes: 83 sleeping, 3 running, 0 zombie, 0 stopped CPU states: 0.5% user, 25.2% system, 0.0% nice, 74.1% idle Mem: 1551472K av, 1521556K used, 29916K free, 0K shrd, 68920K buff Swap: 2097136K av, 154508K used, 1942628K free 1299612K cached PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 380 root 18 0 512 512 440 R15.3 0.0 0:17 cp 421 thorsten 12 0 1044 1044 820 R 0.5 0.0 0:00 top 383 thorsten 9 0 1816 1816 1628 R 0.0 0.1 0:00 sshd And here is a sample of vmstat 1 while the copy is running: procs memoryswap io system cpu r b w swpd free buff cache si sobibo incs us sy id 1 1 1 154508 31488 69112 1297788 0 0 16000 36752 989 719 0 29 71 0 1 0 154508 31748 69064 1297580 0 0 16128 40648 1023 851 0 25 75 1 0 0 154508 31080 69060 1298236 0 0 16128 36692 928 695 1 26 73 1 0 0 154508 31044 69068 1298280 0 0 16768 36632 998 765 0 28 72 1 0 0 154508 31004 69036 1298588 0 0 21888 32592 973 922 0 31 69 0 1 1 154508 31084 68928 1298468 0 0 17664 40800 1004 774 2 29 69 1 0 0 154508 31348 68856 1298296 0 0 17792 32596 947 766 0 25 75 1 0 0 154508 31012 68892 1298652 0 0 20480 32592 958 884 1 26 73 0 1 1 154508 30488 68960 1299100 0 0 18048 36692 939 799 0 30 70 1 0 1 154508 29728 68968 1299748 0 0 16128 40932 1034 722 1 20 79 0 1 0 154508 30192 68940 1299324 0 0 16000 36492 971 834 1 24 75 0 1 0 154508 30060 68928 1299464 0 0 16128 38696 933 735 0 23 77 0 1 0 154508 29908 68920 1299612 0 0 16128 34544 943 656 0 28 72 Howver on the box also running mysql and httpd at the same time: [EMAIL PROTECTED] root]# time cp *.gz /space/scratch.backup/ 0.31user 15.43system 3:27.27elapsed 7%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (130major+23minor)pagefaults 0swaps non-idle ps output: 4:26pm up 27 days, 3:03, 6 users, load average: 7.97, 4.42, 2.42 419 processes: 418 sleeping, 1 running, 0 zombie, 0 stopped CPU states: 18.0% user, 58.9% system, 0.0% nice, 23.0% idle Mem: 1551472K av, 1520456K used, 31016K free, 0K shrd, 17532K buff Swap: 2097136K av, 39756K used, 2057380K free 1129820K cached PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 5120 thorsten 14 0 1332 1332 820 R25.3 0.0 3:23 top 5548 root 10 0 512 512 440 D10.9 0.0 0:09 cp 24561 www9 0 2945
