[Amanda-users] Solaris ZFS Amanda *compressed* GNUTAR SLOWWWWWWW

Tue, 21 Dec 2010 19:14:59 -0800 

# date
Tue Dec 21 20:51:33 EST 2010
# ls -ltr /amandadump/dmp001/20101221004214 | tail
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:36 zulu01._rz2pool_mace.0.598.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:37 zulu01._rz2pool_mace.0.599.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:39 zulu01._rz2pool_mace.0.600.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:41 zulu01._rz2pool_mace.0.601.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:43 zulu01._rz2pool_mace.0.602.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:45 zulu01._rz2pool_mace.0.603.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:47 zulu01._rz2pool_mace.0.604.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:48 zulu01._rz2pool_mace.0.605.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:50 zulu01._rz2pool_mace.0.606.tmp
-rw-------   1 amanda   sys      470843392 
Dec 21 20:51 zulu01._rz2pool_mace.0.607.tmp
# date
Tue Dec 21 20:51:54 EST 2010
# date
Tue Dec 21 20:52:14 EST 2010
# date
Tue Dec 21 20:52:20 EST 2010
# date
Tue Dec 21 20:52:27 EST 2010
# date
Tue Dec 21 20:52:30 EST 2010
# ls -ltr /amandadump/dmp001/20101221004214 | tail
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:36 zulu01._rz2pool_mace.0.598.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:37 zulu01._rz2pool_mace.0.599.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:39 zulu01._rz2pool_mace.0.600.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:41 zulu01._rz2pool_mace.0.601.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:43 zulu01._rz2pool_mace.0.602.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:45 zulu01._rz2pool_mace.0.603.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:47 zulu01._rz2pool_mace.0.604.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:48 zulu01._rz2pool_mace.0.605.tmp
-rw-------   1 amanda   sys      1073741824 
Dec 21 20:50 zulu01._rz2pool_mace.0.606.tmp
-rw-------   1 amanda   sys      943620096 
Dec 21 20:52 zulu01._rz2pool_mace.0.607.tmp


Equates to 470MB/minute or < 10MB/s.

CPU is barely utilized:


otal&#58; 98 processes, 806 lwps, load averages&#58; 1.50, 1.44, 1.43
&nbsp; &nbsp;PID USERNAME&nbsp; SIZE&nbsp; &nbsp;RSS STATE&nbsp; PRI NICE&nbsp; 
&nbsp; &nbsp; TIME&nbsp; CPU PROCESS/NLWP&nbsp; &nbsp; &nbsp; &nbsp;
&nbsp;25639 amanda&nbsp; &nbsp;1708K 1012K cpu1&nbsp; &nbsp; &nbsp;0&nbsp; 
&nbsp; 0&nbsp; 17&#58;12&#58;46&nbsp; 11% gzip/1
&nbsp;25640 amanda&nbsp; &nbsp;7176K 1164K sleep&nbsp; &nbsp;33&nbsp; &nbsp; 
0&nbsp; &nbsp;2&#58;17&#58;34 1.8% sendbackup/1
&nbsp; &nbsp;123 root&nbsp; &nbsp; &nbsp; &nbsp; 0K&nbsp; &nbsp; 0K sleep&nbsp; 
&nbsp;99&nbsp; -20&nbsp; &nbsp;4&#58;57&#58;12 1.1% zpool-rz2pool/51
&nbsp;25645 amanda&nbsp; &nbsp;2448K 1324K sleep&nbsp; &nbsp;52&nbsp; &nbsp; 
0&nbsp; &nbsp;1&#58;01&#58;30 0.8% gtar/1
&nbsp;25641 root&nbsp; &nbsp; &nbsp; &nbsp;42M&nbsp; &nbsp;41M sleep&nbsp; 
&nbsp;49&nbsp; &nbsp; 0&nbsp; &nbsp;1&#58;01&#58;08 0.8% gtar/1
&nbsp; &nbsp;545 root&nbsp; &nbsp; &nbsp; &nbsp;12M 9996K sleep&nbsp; 
&nbsp;59&nbsp; &nbsp; 0&nbsp; &nbsp;0&#58;54&#58;49 0.4% syslogd/15
&nbsp; &nbsp;119 root&nbsp; &nbsp; &nbsp; &nbsp; 0K&nbsp; &nbsp; 0K sleep&nbsp; 
&nbsp;99&nbsp; -20&nbsp; &nbsp;1&#58;50&#58;23 0.2% zpool-amandadum/51
&nbsp;25636 amanda&nbsp; &nbsp;7536K 2872K sleep&nbsp; &nbsp;59&nbsp; &nbsp; 
0&nbsp; &nbsp;0&#58;22&#58;04 0.2% chunker/1
&nbsp; &nbsp;868 root&nbsp; &nbsp; &nbsp;7708K 1596K sleep&nbsp; &nbsp;59&nbsp; 
&nbsp; 0&nbsp; &nbsp;1&#58;13&#58;09 0.2% dhcpd/1
&nbsp;25457 amanda&nbsp; &nbsp;7592K 2968K sleep&nbsp; &nbsp;59&nbsp; &nbsp; 
0&nbsp; &nbsp;0&#58;16&#58;33 0.2% dumper/1
&nbsp;25588 amanda&nbsp; &nbsp;7864K 2992K sleep&nbsp; &nbsp;59&nbsp; &nbsp; 
0&nbsp; &nbsp;0&#58;14&#58;24 0.1% amandad/1
&nbsp;25969 root&nbsp; &nbsp; &nbsp;3776K 2944K cpu5&nbsp; &nbsp; 59&nbsp; 
&nbsp; 0&nbsp; &nbsp;0&#58;00&#58;00 0.0% prstat/1
&nbsp; &nbsp;665 root&nbsp; &nbsp; &nbsp;2560K&nbsp; 772K sleep&nbsp; 
&nbsp;59&nbsp; &nbsp; 0&nbsp; &nbsp;0&#58;06&#58;04 0.0% fbconsole/1
&nbsp; &nbsp;723 daemon&nbsp; &nbsp;2512K 1440K sleep&nbsp; &nbsp;60&nbsp; 
-20&nbsp; &nbsp;1&#58;12&#58;29 0.0% nfsd/12
&nbsp; 1060 noaccess&nbsp; 132M&nbsp; 103M sleep&nbsp; &nbsp;59&nbsp; &nbsp; 
0&nbsp; &nbsp;0&#58;05&#58;46 0.0% java/18
&nbsp;NPROC USERNAME&nbsp; SWAP&nbsp; &nbsp;RSS MEMORY&nbsp; &nbsp; &nbsp; 
TIME&nbsp; CPU&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
&nbsp; &nbsp; 30 amanda&nbsp; &nbsp; &nbsp;23M&nbsp; &nbsp;18M&nbsp; 
&nbsp;0.2%&nbsp; 22&#58;42&#58;05&nbsp; 14%
&nbsp; &nbsp; 54 root&nbsp; &nbsp; &nbsp; 135M&nbsp; 142M&nbsp; 
&nbsp;1.7%&nbsp; 12&#58;05&#58;40 2.7%
&nbsp; &nbsp; &nbsp;7 daemon&nbsp; &nbsp;8596K 6768K&nbsp; &nbsp;0.1%&nbsp; 
&nbsp;1&#58;12&#58;40 0.0%
&nbsp; &nbsp; &nbsp;1 noaccess&nbsp; 126M&nbsp; 104M&nbsp; &nbsp;1.3%&nbsp; 
&nbsp;0&#58;05&#58;46 0.0%
&nbsp; &nbsp; &nbsp;1 smmsp&nbsp; &nbsp; 1580K 2100K&nbsp; &nbsp;0.0%&nbsp; 
&nbsp;0&#58;00&#58;01 0.0%
Total&#58; 98 processes, 814 lwps, load averages&#58; 1.51, 1.45, 1.43


disklist:


zulu01 /rz2pool/mace comp-user-tar-span


Granted...this is a big pool:


-bash-3.00$ df -h
Filesystem&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;size&nbsp; 
&nbsp;used&nbsp; avail capacity&nbsp; Mounted on
...
rz2pool/mace&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 12T&nbsp; 
&nbsp;6.0T&nbsp; &nbsp;2.7T&nbsp; &nbsp; 70%&nbsp; &nbsp; /rz2pool/mace


Here's the definition for that dumptype:



# Dumptypes for gnutar
define dumptype root-tar &#123;
&nbsp; &nbsp; global
&nbsp; &nbsp; program "GNUTAR"
&nbsp; &nbsp; comment "root partitions dumped with tar"
&nbsp; &nbsp; compress none
&nbsp; &nbsp; index
#&nbsp; &nbsp;exclude list "/usr/local/etc/amanda/exclude.gtar"
&nbsp; &nbsp; priority low
&#125;


define dumptype user-tar-span &#123;
&nbsp; &nbsp; root-tar
&nbsp; &nbsp; tape_splitsize 3 Gb
&nbsp; &nbsp; comment "tape-spanning user partitions dumped with tar"
&nbsp; &nbsp; priority medium
&#125;


define dumptype comp-user-tar &#123;
&nbsp; &nbsp; user-tar
&nbsp; &nbsp; compress client fast
&#125;


Gtar version:


-bash-3.00$ /usr/sfw/bin/gtar --version&nbsp; &nbsp; &nbsp; 
tar &#40;GNU tar&#41; 1.23


When I do an uncompressed backup I get throughput of about 3000-4000MB/min or 
50-60MB/s.

So compressed backups are 10 plus time slower then uncompressed.

What am I missing?

+----------------------------------------------------------------------
|This was sent by baldw...@mynetwatchman.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+----------------------------------------------------------------------

Reply via email to