Re: Win2K3 backup performance

[Richard Rhodes]

Also, are you sure you can read the data off of disks any faster?
I'm not sure what the equivalent cmd would be on Windows, but on Unix
I'd try a   "dd if= of=/dev/null bs=128k"  (or some variant) and see
just
how fast the data can be read from the drives.

Rick






 "Allen S. Rout"
 <[EMAIL PROTECTED]>
 Sent by: "ADSM:To
 Dist Stor ADSM-L@VM.MARIST.EDU
 Manager"   cc
 <[EMAIL PROTECTED]
 .EDU>     Subject
       Re: Win2K3 backup performance

 02/01/2008 09:57
 AM


 Please respond to
 "ADSM: Dist Stor
 Manager"
 <[EMAIL PROTECTED]
   .EDU>






>> On Thu, 31 Jan 2008 17:39:49 -0800, Larry Peifer <[EMAIL PROTECTED]>
said:


> The fastest backup I can get from a Win2003 server, TSM 5.4.0.4 client,
to
> an AIX TSM server, 5.4.0.0 is 17Mb/sec. over GigE with a dedicated 2nd
nic
> for backup only.  I'd like to hear from others who are getting better
> speeds and what tuning can be done.  That's 3000 files averaging 100Mb
> each so it takes about 4.5 hours to transfer about 300 Gig.


May be obvious, but have you ruled out throughput bottleneck on the
TSM server?

Are you writing to a contested disk pool, etc?

Or if it's tape, are you in a sour spot w.r.t. streaming, perhaps
shoeshining?


- Allen S. Rout


-
The information contained in this message is intended only for the
personal and confidential use of the recipient(s) named above. If
the reader of this message is not the intended recipient or an
agent responsible for delivering it to the intended recipient, you
are hereby notified that you have received this document in error
and that any review, dissemination, distribution, or copying of
this message is strictly prohibited. If you have received this
communication in error, please notify us immediately, and delete
the original message.

Re: Win2K3 backup performance

[Allen S. Rout]

>> On Thu, 31 Jan 2008 17:39:49 -0800, Larry Peifer <[EMAIL PROTECTED]> said:


> The fastest backup I can get from a Win2003 server, TSM 5.4.0.4 client, to
> an AIX TSM server, 5.4.0.0 is 17Mb/sec. over GigE with a dedicated 2nd nic
> for backup only.  I'd like to hear from others who are getting better
> speeds and what tuning can be done.  That's 3000 files averaging 100Mb
> each so it takes about 4.5 hours to transfer about 300 Gig.


May be obvious, but have you ruled out throughput bottleneck on the
TSM server?

Are you writing to a contested disk pool, etc?

Or if it's tape, are you in a sour spot w.r.t. streaming, perhaps
shoeshining?


- Allen S. Rout

Re: Win2K3 backup performance

[Richard Rhodes]

We have had several instances of slow backup times to Win servers (with 1gb
connections) where the throughput looked almost exactly like 100mb
connections.  As we looked at it, we found that all access to these servers
(including backups) was going through a BigIP box with only 100mb
connections.

Rick





 Sam Sheppard
 <[EMAIL PROTECTED]
 .GOV>  To
 Sent by: "ADSM:   ADSM-L@VM.MARIST.EDU
 Dist Stor  cc
 Manager"
 <[EMAIL PROTECTED] Subject
 .EDU> Win2K3 backup performance


 01/31/2008 07:08
 PM


 Please respond to
 "ADSM: Dist Stor
 Manager"
 <[EMAIL PROTECTED]
   .EDU>






We have a Windows 2003 client running TSM 5.4.1 backing up to a Solaris
10 TSM server running the 5.4.1 server.

The client has several very large files to be backed up (300-400GB). We
are finding on a 1.3GB test file that we can only get a throughput of
about 10MB/sec (looks like 100Mb speed) even though this client is
configured on a GigE VLan.  One interesting aspect just discovered is
that a restore of the same file got speeds of 37MB/sec, which is about
the same as an FTP of the same file from the client to the server.
Client, switch, and server all set to 1GB full.

At this point, I'm completely mystified as to what might be behind
these performance anomalies.  I would expect much higher throughput
rates on all of these tests, but would be satisfied if the backup would
just perform at the same speed as the others.

Client options:  Server Options:

TCPWindowsize   63   TCPWindowsize  131072
TCPBuffsize  32

Thanks
Sam Sheppard
San Diego Data Processing Corp.
(858)-581-9668


-
The information contained in this message is intended only for the
personal and confidential use of the recipient(s) named above. If
the reader of this message is not the intended recipient or an
agent responsible for delivering it to the intended recipient, you
are hereby notified that you have received this document in error
and that any review, dissemination, distribution, or copying of
this message is strictly prohibited. If you have received this
communication in error, please notify us immediately, and delete
the original message.

Re: Win2K3 backup performance

[Henrik Vahlstedt]

Hi,

Have you recently upgraded the client, and are you using scheduled
backups with sessioinitiation=serveronly?
>From 5.3.5.3 to latest 5.4 client I have an issue with above settings
and performance. 
Ie, with newer clients performace drops with 70-80% when I backup larger
files > 1Gb.
Dsmc and sessioinitiation=clientorserver works fine.

//Henrik


-Original Message-
From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of
Sam Sheppard
Sent: den 1 februari 2008 01:09
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] Win2K3 backup performance

We have a Windows 2003 client running TSM 5.4.1 backing up to a Solaris
10 TSM server running the 5.4.1 server.

The client has several very large files to be backed up (300-400GB). We
are finding on a 1.3GB test file that we can only get a throughput of
about 10MB/sec (looks like 100Mb speed) even though this client is
configured on a GigE VLan.  One interesting aspect just discovered is
that a restore of the same file got speeds of 37MB/sec, which is about
the same as an FTP of the same file from the client to the server.
Client, switch, and server all set to 1GB full.

At this point, I'm completely mystified as to what might be behind these
performance anomalies.  I would expect much higher throughput rates on
all of these tests, but would be satisfied if the backup would just
perform at the same speed as the others.

Client options:  Server Options:

TCPWindowsize   63   TCPWindowsize  131072
TCPBuffsize  32

Thanks
Sam Sheppard
San Diego Data Processing Corp.
(858)-581-9668


---
The information contained in this message may be CONFIDENTIAL and is
intended for the addressee only. Any unauthorised use, dissemination of the
information or copying of this message is prohibited. If you are not the
addressee, please notify the sender immediately by return e-mail and delete
this message.
Thank you.

Re: Win2K3 backup performance

[Kelly Lipp]

Also set txnbytelimit to themaximum of 2GB (if you have a relatively new client 
5.3 or later) and txngroupmax on the server 1024 (though that is not really 
your issue on this client but might be on clients with many smaller files)
 
Upping txnbytelimit beyond the 25600 default may make a huge difference as you 
cut down on your transaction mini-commits dramatically...
 
 
Kelly Lipp
CTO, VP Manufacturing
STORServer, Inc.
485-B Elkton Drive
Colorado Springs, CO 80907
www.storserver.com  
719-266-8777



From: ADSM: Dist Stor Manager on behalf of David Vargas
Sent: Thu 1/31/2008 8:12 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Win2K3 backup performance



This is what I found to work with our system, with a 1Gb backup network.

* TCPWINDOWSIZE 2048 - Maximum setting
TCPWindowsize   512

* TCPBUFFSIZE   512 - Maximum setting
TCPBuffSize 255

The maximum settings

David

-Original Message-
From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of
Sam Sheppard
Sent: Thursday, January 31, 2008 2:09 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] Win2K3 backup performance

We have a Windows 2003 client running TSM 5.4.1 backing up to a Solaris
10 TSM server running the 5.4.1 server.

The client has several very large files to be backed up (300-400GB). We
are finding on a 1.3GB test file that we can only get a throughput of
about 10MB/sec (looks like 100Mb speed) even though this client is
configured on a GigE VLan.  One interesting aspect just discovered is
that a restore of the same file got speeds of 37MB/sec, which is about
the same as an FTP of the same file from the client to the server.
Client, switch, and server all set to 1GB full.

At this point, I'm completely mystified as to what might be behind these
performance anomalies.  I would expect much higher throughput rates on
all of these tests, but would be satisfied if the backup would just
perform at the same speed as the others.

Client options:  Server Options:

TCPWindowsize   63   TCPWindowsize  131072
TCPBuffsize  32

Thanks
Sam Sheppard
San Diego Data Processing Corp.
(858)-581-9668


The information contained in this e-mail message is intended only for the 
personal and confidential use of the recipient(s) named above.  If you are not 
the intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution or copying 
of this message is strictly prohibited.  If you have received this 
communication in error, please notify us immediately by e-mail and delete the 
original message.  Thank you.

Re: Win2K3 backup performance

[David Vargas]

This is what I found to work with our system, with a 1Gb backup network.

* TCPWINDOWSIZE 2048 - Maximum setting
TCPWindowsize   512

* TCPBUFFSIZE   512 - Maximum setting
TCPBuffSize 255

The maximum settings 

David

-Original Message-
From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of
Sam Sheppard
Sent: Thursday, January 31, 2008 2:09 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] Win2K3 backup performance

We have a Windows 2003 client running TSM 5.4.1 backing up to a Solaris
10 TSM server running the 5.4.1 server.

The client has several very large files to be backed up (300-400GB). We
are finding on a 1.3GB test file that we can only get a throughput of
about 10MB/sec (looks like 100Mb speed) even though this client is
configured on a GigE VLan.  One interesting aspect just discovered is
that a restore of the same file got speeds of 37MB/sec, which is about
the same as an FTP of the same file from the client to the server.
Client, switch, and server all set to 1GB full.

At this point, I'm completely mystified as to what might be behind these
performance anomalies.  I would expect much higher throughput rates on
all of these tests, but would be satisfied if the backup would just
perform at the same speed as the others.

Client options:  Server Options:

TCPWindowsize   63   TCPWindowsize  131072
TCPBuffsize  32

Thanks
Sam Sheppard
San Diego Data Processing Corp.
(858)-581-9668


The information contained in this e-mail message is intended only for the 
personal and confidential use of the recipient(s) named above.  If you are not 
the intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution or copying 
of this message is strictly prohibited.  If you have received this 
communication in error, please notify us immediately by e-mail and delete the 
original message.  Thank you.

Re: Win2K3 backup performance

[Larry Peifer]

The fastest backup I can get from a Win2003 server, TSM 5.4.0.4 client, to
an AIX TSM server, 5.4.0.0 is 17Mb/sec. over GigE with a dedicated 2nd nic
for backup only.  I'd like to hear from others who are getting better
speeds and what tuning can be done.  That's 3000 files averaging 100Mb
each so it takes about 4.5 hours to transfer about 300 Gig.




Sam Sheppard <[EMAIL PROTECTED]>
Sent by: "ADSM: Dist Stor Manager" 
01/31/2008 04:08 PM
Please respond to
"ADSM: Dist Stor Manager" 


To
ADSM-L@VM.MARIST.EDU
cc

Subject
[ADSM-L] Win2K3 backup performance






We have a Windows 2003 client running TSM 5.4.1 backing up to a Solaris
10 TSM server running the 5.4.1 server.

The client has several very large files to be backed up (300-400GB). We
are finding on a 1.3GB test file that we can only get a throughput of
about 10MB/sec (looks like 100Mb speed) even though this client is
configured on a GigE VLan.  One interesting aspect just discovered is
that a restore of the same file got speeds of 37MB/sec, which is about
the same as an FTP of the same file from the client to the server.
Client, switch, and server all set to 1GB full.

At this point, I'm completely mystified as to what might be behind
these performance anomalies.  I would expect much higher throughput
rates on all of these tests, but would be satisfied if the backup would
just perform at the same speed as the others.

Client options:  Server Options:

TCPWindowsize   63   TCPWindowsize  131072
TCPBuffsize  32

Thanks
Sam Sheppard
San Diego Data Processing Corp.
(858)-581-9668

Re: Win2K3 backup performance

[James Drozynski]

Hi Sam,
   I had a similar problem with a notes server running W2003.
I was using the tdp client for lotus notes.  My work around was to take a
second network interface
on the server and lock both the port and the client down to 100/full
duplex. This tdp client is the only one I
have to run on this second interface and it works fine now. I don't know
if you have a hdwe. second interface, but if you
do, try adding another ip address and give it a try...TSM allows for the
use of more then one hdwe.  interface...

At any rate kindly let me know what your resolution is as I'm
interested...

thx jimmyd

James Drozynski
IBM Pittsburgh Lab
11 Stanwix Street
Pittsburgh Pa. 15222
Tel:412-667-4421
Fax:412-667-6975
Tie:989-4421