Thomas Maier-Komor <[EMAIL PROTECTED]> wrote:
> > Quad Opteron (2x Opteron 880 2.4 GHz) and UFS:
> >
> > LD_PRELOAD=./mtwrite.so ./star xp -time < ../linux-2.6.17.3.tar.bz2
> > ./star: WARNING: Archive is 'bzip2' compressed, trying to use the -bz
> > option.
> > ./star: 23107 blocks + 0 bytes (total of 236615680 bytes = 231070.00k).
> > ./star: Total time 174.461sec (1324 kBytes/sec)
> > 2:54.473r 18.500u 6.670s 14% 0M 0+0k 0st 0+0io 0pf+0w
> >
> > rm -rf linux-2.6.17.3/
> > ./star xp -time < ../linux-2.6.17.3.tar.bz2
> > ./star: WARNING: Archive is 'bzip2' compressed, trying to use the -bz
> > option.
> > ./star: 23107 blocks + 0 bytes (total of 236615680 bytes = 231070.00k).
> > ./star: Total time 25.709sec (8987 kBytes/sec)
> > 25.733r 15.850u 5.900s 84% 0M 0+0k 0st 0+0io 0pf+0w
Let me add that if I run
bzip2 -d < linux-2.6.17.3.tar.bz2 | sdd -onull bs=10k -t
I get ~ 14 MB/z read speed in sdd
> I know that star/tar's performance regress on UFS filesystems if you preload
> mtwrite.so. I performed my tests on a ZFS filesystem. I don't have a recent
> linux kernel at hand, because it has been some time since I last used it. But
> all Linux are equal, as you know, and here are some tests with an older linux
> kernel archive:
But why is my test 6.7 times slower when using your mtwrite.so?
> [EMAIL PROTECTED]:/var/a$ star --version
> star: star 1.5a57 (sparc-sun-solaris2.8)
>
> Copyright (C) 1985, 88-90, 92-96, 98, 99, 2000-2005 Jörg Schilling
> This is free software; see the source for copying conditions. There is NO
> warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
A bit old... the recent version is 1.5a77-pre, your version is 2 years old.
> =======> ZFS <==========
> [EMAIL PROTECTED]:/var/tmp$ df .
> /var/tmp (mypool/tmp ):154786268 blocks 154786268 files
> [EMAIL PROTECTED]:/var/tmp$ mtstar xp -time <
> /mypool/alternates/ftp/pub/linux-2.6.1.tar.bz2
> star: WARNING: Archive is 'bzip2' compressed, trying to use the -bz option.
> star: 18213 blocks + 0 bytes (total of 186501120 bytes = 182130.00k).
> star: Total time 26.341sec (6914 kBytes/sec)
> [EMAIL PROTECTED]:/var/tmp$ rm -r linux-2.6.1/
> [EMAIL PROTECTED]:/var/tmp$ star xp -time <
> /mypool/alternates/ftp/pub/linux-2.6.1.tar.bz2
> star: WARNING: Archive is 'bzip2' compressed, trying to use the -bz option.
> star: 18213 blocks + 0 bytes (total of 186501120 bytes = 182130.00k).
> star: Total time 113.350sec (1606 kBytes/sec)
This is not a good result for ZFS, keeping the UFS results in mind.
BTW: If I unpack the archive linux-2.6.17.3.tar.bz2 first, I get the following
results:
star -xp -time f=1
star: 23107 blocks + 0 bytes (total of 236615680 bytes = 231070.00k).
star: Total time 18.213sec (12687 kBytes/sec)
18.274r 0.170u 5.500s 31% 0M 0+0k 0st 0+0io 0pf+0w
rm -rf linux-2.6.17.3/
star -xp -time -no-fsync f=1
star: 23107 blocks + 0 bytes (total of 236615680 bytes = 231070.00k).
star: Total time 16.975sec (13612 kBytes/sec)
17.051r 0.140u 2.910s 17% 0M 0+0k 0st 0+0io 0pf+0w
rm -rf linux-2.6.17.3
tar -xp -time -no-fsync fs=100m f=1
star: 23107 blocks + 0 bytes (total of 236615680 bytes = 231070.00k).
star: Total time 15.587sec (14823 kBytes/sec)
16.070r 0.140u 3.100s 20% 0M 0+0k 0st 0+0io 0pf+0w
LD_PRELOAD=./mtwrite.so ./star -xp -time -no-fsync bs=100m f=1
./star: 2 blocks + 26900480 bytes (total of 236615680 bytes = 231070.00k).
./star: Total time 175.807sec (1314 kBytes/sec)
2:56.197r 0.780u 4.150s 2% 0M 0+0k 0st 0+0io 0pf+0w
so the best star standalone extract on UFS is 11x faster than the one with
mtwrite.so
> =======> UFS <========
> [EMAIL PROTECTED]:/var/a$ df .
> / (/dev/md/dsk/d20 ):42540552 Blöcke 3538508 Dateien
> [EMAIL PROTECTED]:/var/a$ mtstar xp -time <
> /mypool/alternates/ftp/pub/linux-2.6.1.tar.bz2
> star: WARNING: Archive is 'bzip2' compressed, trying to use the -bz option.
> star: 18213 blocks + 0 bytes (total of 186501120 bytes = 182130.00k).
> star: Total time 34.085sec (5343 kBytes/sec)
> [EMAIL PROTECTED]:/var/a$ rm -r linux-2.6.1/
> [EMAIL PROTECTED]:/var/a$ star xp -time <
> /mypool/alternates/ftp/pub/linux-2.6.1.tar.bz2
> star: WARNING: Archive is 'bzip2' compressed, trying to use the -bz option.
> star: 18213 blocks + 0 bytes (total of 186501120 bytes = 182130.00k).
> star: Total time 36.085sec (5047 kBytes/sec)
>
>
> Be aware that the attached filesystems are hosten on fast SCSI disks. The UFS
> consists of a mirror of two 15k RPM 73G disks. The ZFS is located on a mirror
> of two 10k RPM 146G disks. Maybe this might be the reason that my tests
> perform much better in threaded mode...
Why is your extract speed with mtwrite.so still ~ 4x better then mine?
Jörg
--
EMail:[EMAIL PROTECTED] (home) Jörg Schilling D-13353 Berlin
[EMAIL PROTECTED] (uni)
[EMAIL PROTECTED] (work) Blog: http://schily.blogspot.com/
URL: http://cdrecord.berlios.de/old/private/ ftp://ftp.berlios.de/pub/schily
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss@opensolaris.org
