On 7/18/05, Jake Hamby <[EMAIL PROTECTED]> wrote:
> 
> Okay, I did a more "scientific" test and uncompressed the archive first. 

FIRSTLY : This is great work !   Really !

I am sooo happy to see someone actually perform and experiment and
then provide data.

> Test system:  2.8GHz Pentium 4, 512MB DDR333 RAM, 120GB Seagate ST3120026A 
> drive, OpenSolaris w/ JDS and 2 terminal windows open, bonnie++ gives read 
> speed as 50588K/sec, write speed as 44935K/sec.


wow .. nice machine.

want to try crucible on that for me ? 

http://www.blastwave.org/dclarke/crucible/


> Jake Hamby

a name I will watch for :-)

> $ bzcat ~/Downloads/kde/KDEkderequired-341.tar.bz2 >KDEkderequired-341.tar
> $ sync
> $ time star xf KDEkderequired-341.tar
> star: 72176 blocks + 4608 bytes (total of 739086848 bytes = 721764.50k).
> 
> real    2m53.636s
> user    0m1.280s
> sys     0m32.205s
> $ rm -r KDEkderequired-341
> $ sync
> $ time star xf KDEkderequired-341.tar
> star: 72176 blocks + 4608 bytes (total of 739086848 bytes = 721764.50k).
> 
> real    2m52.759s
> user    0m1.270s
> sys     0m32.265s

faster slighly.  could be system noise affecting throughput however.

I could read every one of your tests and come to the same conclusion
that I did over two years ago.  I never used anything but star ever
again.  I tested it with millions and millions of files on a SAN/NAS
multipath storage config and this is where I discovered the beauty of
star.  Late at night in the server room at a telcom that had some
24,000 users email accounts on a big email server cluster.  Years of
data.  In maildir format.

I had to move the /mail directory contents to a new storage array
config and I needed something that would move these millions of files
fast.  I tried Sun tar and I tried cpio and I even tried ufsdump piped
into ufsrestore.  With throughput estimates in hand after the first 30
minutes I knew that I was dead in the water if I wanted this system up
by 07:00AM.

It was star ( whatever version in 2003 ) that saturated the channels
and moved everything with the file metadata in blazing fast record
time.  It was _stunningly_ faster than anything else.

After watching it toss around many gig of millions of files like that
with many threads running simultaneously I never used anything else
ever again.

And I never had a problem either.

Dennis Clarke
Director and Admin for blastwave.org
[EMAIL PROTECTED]
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss@opensolaris.org

Reply via email to