Re: transfer rate terminology

[Richard Sims]

On Jul 8, 2010, at 3:10 AM, Mehdi Salehi wrote:

> Thanks for your replies.
> 
> According to IBM, 3592 J1A tape drive has Compressed sustained data rate of
> 80 MB/s and Maximum interface burst transfer rate of 200 MB/s
> 
> http://publib.boulder.ibm.com/infocenter/ts3500tl/v1r0/index.jsp?topic=/com.ibm.storage.3584.doc/ipg_3584_a69p0cti20.html
> 
> When backing up a storage pool (source and destination pools are based on
> 3592 J1A drives), I noticed that transfer rate between two drives was more
> than 100MB/s for a long period of time. "q proc" showed that a big file
> (more than 200GB) was being transferred. Why the transfer rate exceeded
> 80MB?

Because the circumstances allow streaming to occur.

Re: transfer rate terminology

[Mehdi Salehi]

Thanks for your replies.

According to IBM, 3592 J1A tape drive has Compressed sustained data rate of
80 MB/s and Maximum interface burst transfer rate of 200 MB/s

http://publib.boulder.ibm.com/infocenter/ts3500tl/v1r0/index.jsp?topic=/com.ibm.storage.3584.doc/ipg_3584_a69p0cti20.html

When backing up a storage pool (source and destination pools are based on
3592 J1A drives), I noticed that transfer rate between two drives was more
than 100MB/s for a long period of time. "q proc" showed that a big file
(more than 200GB) was being transferred. Why the transfer rate exceeded
80MB?

Many thanks,
Mehdi

Re: transfer rate terminology

[Bruce T. Harvey]

Essentially they are what they say.  'Sustained data rate' reflects more
or less the average data rate over a period of time.  Different systems
compute it slightly differently (different average periods) but it's
essentially what you can expect to be the supported average amount of data
going through at any given time.  This would be when the cache is full and
active, when all buffers are loaded, etc.

'Burst transfer rate' is the highest rate you can expect data to travel
through the connection at any given time.  For example, there may be a
burst of data to begin a communications, but then it evens out to the
'sustained' rate.

Many thanks!

Bruce T.

>>>
Bruce T. Harvey
AIX Network Engineer





Mehdi Salehi 
Sent by: "ADSM: Dist Stor Manager" 
07/07/10 11:09 AM
Please respond to
"ADSM: Dist Stor Manager" 


To
ADSM-L@vm.marist.edu
cc

Subject
[ADSM-L] transfer rate terminology






Hi,
What do "sustained data rate" and "burst transfer rate" mean? I appreciate
your explanation or any reference.

Thanks

The contents of this email are the property of PNC. If it was not addressed to 
you, you have no legal right to read it. If you think you received it in error, 
please notify the sender. Do not forward or copy without permission of the 
sender. This message may contain an advertisement of a product or service and 
thus may constitute a commercial electronic mail message under US Law. The 
postal address for PNC is 249 Fifth Avenue, Pittsburgh, PA 15222. If you do not 
wish to receive any additional advertising or promotional messages from PNC at 
this e-mail address, click here to unsubscribe. 
https://pnc.p.delivery.net/m/u/pnc/uni/p.asp By unsubscribing to this message, 
you will be unsubscribed from all advertising or promotional messages from PNC. 
Removing your e-mail address from this mailing list will not affect your 
subscription to alerts, e-newsletters or account servicing e-mails.

Re: transfer rate terminology

[Richard Sims]

Burst rate refers to the transfer of data which the hardware component happens 
to have immediately at hand, as in a cache buffer.
Sustained rate refers to the long-term average where the hardware has to also 
get data by seeking to a position on the medium and reading from it, which 
takes much longer.

 Richard Sims

On Jul 7, 2010, at 11:09 AM, Mehdi Salehi wrote:

> Hi,
> What do "sustained data rate" and "burst transfer rate" mean? I appreciate
> your explanation or any reference.
> 
> Thanks

Re: Transfer Rate

[Francisco Reyes]

On Thu, 2 Aug 2001, Lindsay Morris wrote:
> If you really want to speed up your backups, you need to
> look at the accounting log records (.../server/bin/dsmaccnt.log - see admin
> guide for layout)
> to see which of your clients suffer most from idle wait, media wait, or comm
> wait.

Is this accounting file created by default? I don't see one in my bin
directory.

Re: Transfer Rate

[Prather, Wanda]

No, you have to turn it on.
Run a Q STATUS command; one of the lines show ACCOUNTING either ON or OFF.
To turn it on, just enter:  SET ACCOUNTING ON

It will stay on across any server restarts, until you turn it off.
We have a script that runs every month that copies the dsmaccnt.log file
elsewhere (or you could archive it) then clears it.
You will want to do something similar so the file won't grow forever.

The dsmaccnt.log file is a simple comma-delimited format; the fields are
described in the admin guide.



-Original Message-
From: Francisco Reyes [mailto:[EMAIL PROTECTED]]
Sent: Friday, August 03, 2001 5:13 PM
To: [EMAIL PROTECTED]
Subject: Re: Transfer Rate


On Thu, 2 Aug 2001, Lindsay Morris wrote:
> If you really want to speed up your backups, you need to
> look at the accounting log records (.../server/bin/dsmaccnt.log - see
admin
> guide for layout)
> to see which of your clients suffer most from idle wait, media wait, or
comm
> wait.

Is this accounting file created by default? I don't see one in my bin
directory.

Re: Transfer Rate

[Bill Wheeler]

The only client we have is where the server is located.  We are running TSM
to backup one RS/6000 F50 server.  And backing up 70 GB in 8 hours doesn't
seem right.  Is there anything that I can do to speed this up.  We run a
Magstar 3570 connected to the F50 server through SCSI.

TSM Version 4.1.2.0
AIX Version 4.3.3.0

-Original Message-
From: Lindsay Morris [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 02, 2001 10:19 AM
To: [EMAIL PROTECTED]
Subject: Re: Transfer Rate


Aggregate uses wall-clock time;
Network uses the intervals between when the client says "I'm sending data
now", to when the server actually receives it.

It's perfectly normal to have aggregate be a lot slower than network.

If you really want to speed up your backups, you need to
look at the accounting log records (.../server/bin/dsmaccnt.log - see admin
guide for layout)
to see which of your clients suffer most from idle wait, media wait, or comm
wait.

> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED]]On Behalf Of
> Bill Wheeler
> Sent: Thursday, August 02, 2001 9:55 AM
> To: [EMAIL PROTECTED]
> Subject: Transfer Rate
>
>
> Hello All,
>
> I hope a few of the *SMer guru can help me out on this one.   I don't
> know if you have had a problem like this before.   The problem is our
> Aggregate Transfer Rate is allot lower then the Network Transfer
> Rate.   Is
> there something that I can look at to see if I can get the data moved
> quicker?Here is a copy of the Activity log with the rates:
>
>
> ANE4961I (Session: 4532, Node: F50_CLIENT)  Total number
>
> of bytes transferred:69.33 GB07/31/01 06:51:30
>
> ANE4963I (Session: 4532, Node: F50_CLIENT)  Data transfer
>
> time:11,858.22 sec   07/31/01 06:51:30
>
> ANE4966I (Session: 4532, Node: F50_CLIENT)  Network data
>
> transfer rate:6,130.86 KB/sec07/31/01 06:51:30
>
> ANE4967I (Session: 4532, Node: F50_CLIENT)  Aggregate data
>
> transfer rate:  2,462.14 KB/sec  07/31/01 06:51:30
>
> ANE4968I (Session: 4532, Node: F50_CLIENT)  Objects
>
> compressed by:0% 07/31/01 06:51:30
>
> ANE4964I (Session: 4532, Node: F50_CLIENT)  Elapsed
>
> processing time:08:12:07
>
>
> Any advice would be helpful.
>
> Thanks in advance,
>
> Bill Wheeler
> AIX Administrator
> La-Z-Boy Incorporated
> [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>

Re: Transfer Rate

[Bill Wheeler]

What we are backing up are two file repositories consisting of about 65 GB
of data.  They include both large and small files and probably consist more
of the small files.   Some of the other information that I did not add
earlier is as follows:

ANE4952I (Session: 4532, Node: F50_CLIENT)  Total number
   of objects inspected:  116,901

ANE4953I (Session: 4532, Node: F50_CLIENT)  Total number
   of objects archived:   116,549


The copy serialization is set to SHRSTATIC.   How much of a difference would
changing this make, any idea?

-Original Message-
From: Martin, Jon R. [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 02, 2001 2:10 PM
To: [EMAIL PROTECTED]
Subject: Re: Transfer Rate


What is the file structure that you are backing up? Are there a LARGE amount
of small files the client needs to process?  What is the copy serialization
set at for your copy groups.  If you are backing up active files and the
copy serialization is set to make multiple attempts on an active file,
possibly that can add alot of time.

Just some wild guesses.

-Original Message-
From: Bill Wheeler [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 02, 2001 1:47 PM
To: [EMAIL PROTECTED]
Subject: Re: Transfer Rate


The only client we have is where the server is located.  We are running TSM
to backup one RS/6000 F50 server.  And backing up 70 GB in 8 hours doesn't
seem right.  Is there anything that I can do to speed this up.  We run a
Magstar 3570 connected to the F50 server through SCSI.

TSM Version 4.1.2.0
AIX Version 4.3.3.0

-Original Message-
From: Lindsay Morris [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 02, 2001 10:19 AM
To: [EMAIL PROTECTED]
Subject: Re: Transfer Rate


Aggregate uses wall-clock time;
Network uses the intervals between when the client says "I'm sending data
now", to when the server actually receives it.

It's perfectly normal to have aggregate be a lot slower than network.

If you really want to speed up your backups, you need to
look at the accounting log records (.../server/bin/dsmaccnt.log - see admin
guide for layout)
to see which of your clients suffer most from idle wait, media wait, or comm
wait.

> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED]]On Behalf Of
> Bill Wheeler
> Sent: Thursday, August 02, 2001 9:55 AM
> To: [EMAIL PROTECTED]
> Subject: Transfer Rate
>
>
> Hello All,
>
> I hope a few of the *SMer guru can help me out on this one.   I don't
> know if you have had a problem like this before.   The problem is our
> Aggregate Transfer Rate is allot lower then the Network Transfer
> Rate.   Is
> there something that I can look at to see if I can get the data moved
> quicker?Here is a copy of the Activity log with the rates:
>
>
> ANE4961I (Session: 4532, Node: F50_CLIENT)  Total number
>
> of bytes transferred:69.33 GB07/31/01 06:51:30
>
> ANE4963I (Session: 4532, Node: F50_CLIENT)  Data transfer
>
> time:11,858.22 sec   07/31/01 06:51:30
>
> ANE4966I (Session: 4532, Node: F50_CLIENT)  Network data
>
> transfer rate:6,130.86 KB/sec07/31/01 06:51:30
>
> ANE4967I (Session: 4532, Node: F50_CLIENT)  Aggregate data
>
> transfer rate:  2,462.14 KB/sec  07/31/01 06:51:30
>
> ANE4968I (Session: 4532, Node: F50_CLIENT)  Objects
>
> compressed by:0% 07/31/01 06:51:30
>
> ANE4964I (Session: 4532, Node: F50_CLIENT)  Elapsed
>
> processing time:08:12:07
>
>
> Any advice would be helpful.
>
> Thanks in advance,
>
> Bill Wheeler
> AIX Administrator
> La-Z-Boy Incorporated
> [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>

Re: Transfer Rate

[Martin, Jon R.]

What is the file structure that you are backing up? Are there a LARGE amount
of small files the client needs to process?  What is the copy serialization
set at for your copy groups.  If you are backing up active files and the
copy serialization is set to make multiple attempts on an active file,
possibly that can add alot of time.

Just some wild guesses.

-Original Message-
From: Bill Wheeler [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 02, 2001 1:47 PM
To: [EMAIL PROTECTED]
Subject: Re: Transfer Rate


The only client we have is where the server is located.  We are running TSM
to backup one RS/6000 F50 server.  And backing up 70 GB in 8 hours doesn't
seem right.  Is there anything that I can do to speed this up.  We run a
Magstar 3570 connected to the F50 server through SCSI.

TSM Version 4.1.2.0
AIX Version 4.3.3.0

-Original Message-
From: Lindsay Morris [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 02, 2001 10:19 AM
To: [EMAIL PROTECTED]
Subject: Re: Transfer Rate


Aggregate uses wall-clock time;
Network uses the intervals between when the client says "I'm sending data
now", to when the server actually receives it.

It's perfectly normal to have aggregate be a lot slower than network.

If you really want to speed up your backups, you need to
look at the accounting log records (.../server/bin/dsmaccnt.log - see admin
guide for layout)
to see which of your clients suffer most from idle wait, media wait, or comm
wait.

> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED]]On Behalf Of
> Bill Wheeler
> Sent: Thursday, August 02, 2001 9:55 AM
> To: [EMAIL PROTECTED]
> Subject: Transfer Rate
>
>
> Hello All,
>
> I hope a few of the *SMer guru can help me out on this one.   I don't
> know if you have had a problem like this before.   The problem is our
> Aggregate Transfer Rate is allot lower then the Network Transfer
> Rate.   Is
> there something that I can look at to see if I can get the data moved
> quicker?Here is a copy of the Activity log with the rates:
>
>
> ANE4961I (Session: 4532, Node: F50_CLIENT)  Total number
>
> of bytes transferred:69.33 GB07/31/01 06:51:30
>
> ANE4963I (Session: 4532, Node: F50_CLIENT)  Data transfer
>
> time:11,858.22 sec   07/31/01 06:51:30
>
> ANE4966I (Session: 4532, Node: F50_CLIENT)  Network data
>
> transfer rate:6,130.86 KB/sec07/31/01 06:51:30
>
> ANE4967I (Session: 4532, Node: F50_CLIENT)  Aggregate data
>
> transfer rate:  2,462.14 KB/sec  07/31/01 06:51:30
>
> ANE4968I (Session: 4532, Node: F50_CLIENT)  Objects
>
> compressed by:0% 07/31/01 06:51:30
>
> ANE4964I (Session: 4532, Node: F50_CLIENT)  Elapsed
>
> processing time:08:12:07
>
>
> Any advice would be helpful.
>
> Thanks in advance,
>
> Bill Wheeler
> AIX Administrator
> La-Z-Boy Incorporated
> [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>

Re: Transfer Rate

[Thomas A. La Porte]

Also, if you're client and server are on the same host, the
network shouldn't enter into the picture, you should be using
SHAREDMEM as your protocol.

 -- Tom

On Thu, 2 Aug 2001, David Longo wrote:

>Your original post of actlog stats didn't include how many objects
>inspected/backed up.  If you have a LOT of small files that would
>account for some of it.
>
>What type of network do you have?
>
>I just looked at some of my stats and I have on the clients I checked
>a Network to Aggregate data transfer time of 2 -1 to 3 -1.
>
>How many sessions does the client use?  You can set
>RESOURCEUTILIZATION in dsm.sys on client to increase number
> of sessions - see docs for info.  Experiment to see best for you.
>
>I would think you can get better than 8 hours for 70GB.  I imagine
>4 -6 hours is as good as you can  do.
>
>Have TSM 3.7.4.0 server on AIX 4.3.3 on F50 with 4x 332Mhz CPU
>and 2 GB RAM.  IBM 3575 library.  Using 155MB ATM network.  (Some clients have 100MB 
>Ethernet.)
>
>
>David B. Longo
>System Administrator
>Health First, Inc.
>3300 Fiske Blvd.
>Rockledge, FL 32955-4305
>PH  321.434.5536
>Pager  321.634.8230
>Fax:321.434.5525
>[EMAIL PROTECTED]
>
>
>>>> [EMAIL PROTECTED] 08/02/01 01:47PM >>>
>The only client we have is where the server is located.  We are running TSM
>to backup one RS/6000 F50 server.  And backing up 70 GB in 8 hours doesn't
>seem right.  Is there anything that I can do to speed this up.  We run a
>Magstar 3570 connected to the F50 server through SCSI.
>
>TSM Version 4.1.2.0
>AIX Version 4.3.3.0
>
>-Original Message-
>From: Lindsay Morris [mailto:[EMAIL PROTECTED]]
>Sent: Thursday, August 02, 2001 10:19 AM
>To: [EMAIL PROTECTED]
>Subject: Re: Transfer Rate
>
>
>Aggregate uses wall-clock time;
>Network uses the intervals between when the client says "I'm sending data
>now", to when the server actually receives it.
>
>It's perfectly normal to have aggregate be a lot slower than network.
>
>If you really want to speed up your backups, you need to
>look at the accounting log records (.../server/bin/dsmaccnt.log - see admin
>guide for layout)
>to see which of your clients suffer most from idle wait, media wait, or comm
>wait.
>
>> -Original Message-
>> From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED]]On Behalf Of
>> Bill Wheeler
>> Sent: Thursday, August 02, 2001 9:55 AM
>> To: [EMAIL PROTECTED]
>> Subject: Transfer Rate
>>
>>
>> Hello All,
>>
>> I hope a few of the *SMer guru can help me out on this one.   I don't
>> know if you have had a problem like this before.   The problem is our
>> Aggregate Transfer Rate is allot lower then the Network Transfer
>> Rate.   Is
>> there something that I can look at to see if I can get the data moved
>> quicker?Here is a copy of the Activity log with the rates:
>>
>>
>> ANE4961I (Session: 4532, Node: F50_CLIENT)  Total number
>>
>> of bytes transferred:69.33 GB07/31/01 06:51:30
>>
>> ANE4963I (Session: 4532, Node: F50_CLIENT)  Data transfer
>>
>> time:11,858.22 sec   07/31/01 06:51:30
>>
>> ANE4966I (Session: 4532, Node: F50_CLIENT)  Network data
>>
>> transfer rate:6,130.86 KB/sec07/31/01 06:51:30
>>
>> ANE4967I (Session: 4532, Node: F50_CLIENT)  Aggregate data
>>
>> transfer rate:  2,462.14 KB/sec  07/31/01 06:51:30
>>
>> ANE4968I (Session: 4532, Node: F50_CLIENT)  Objects
>>
>> compressed by:0% 07/31/01 06:51:30
>>
>> ANE4964I (Session: 4532, Node: F50_CLIENT)  Elapsed
>>
>> processing time:08:12:07
>>
>>
>> Any advice would be helpful.
>>
>> Thanks in advance,
>>
>> Bill Wheeler
>> AIX Administrator
>> La-Z-Boy Incorporated
>> [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>>
>
>
>
>"MMS " made the following
> annotations on 08/02/01 14:20:19
>--
>This message is for the named person's use only.  It may contain confidential, 
>proprietary, or legally privileged information.  No confidentiality or privilege is 
>waived or lost by any mistransmission.  If you receive this message in error, please 
>immediately delete it and all copies of it from your system, destroy any hard copies 
>of it, and notify the sender.  You must not, directly or indirectly, use, disclose, 
>distribute, print, or copy any part of this message if you are not the intended 
>recipient.  Health First reserves the right to monitor all e-mail communications 
>through its networks.  Any views or opinions expressed in this message are solely 
>those of the individual sender, except (1) where the message states such views or 
>opinions are on behalf of a particular entity;  and (2) the sender is authorized by 
>the entity to give such views or opinions.
>
>==
>
>

Re: Transfer Rate

[Lindsay Morris]

Aggregate uses wall-clock time;
Network uses the intervals between when the client says "I'm sending data
now", to when the server actually receives it.

It's perfectly normal to have aggregate be a lot slower than network.

If you really want to speed up your backups, you need to
look at the accounting log records (.../server/bin/dsmaccnt.log - see admin
guide for layout)
to see which of your clients suffer most from idle wait, media wait, or comm
wait.

> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED]]On Behalf Of
> Bill Wheeler
> Sent: Thursday, August 02, 2001 9:55 AM
> To: [EMAIL PROTECTED]
> Subject: Transfer Rate
>
>
> Hello All,
>
> I hope a few of the *SMer guru can help me out on this one.   I don't
> know if you have had a problem like this before.   The problem is our
> Aggregate Transfer Rate is allot lower then the Network Transfer
> Rate.   Is
> there something that I can look at to see if I can get the data moved
> quicker?Here is a copy of the Activity log with the rates:
>
>
> ANE4961I (Session: 4532, Node: F50_CLIENT)  Total number
>
> of bytes transferred:69.33 GB07/31/01 06:51:30
>
> ANE4963I (Session: 4532, Node: F50_CLIENT)  Data transfer
>
> time:11,858.22 sec   07/31/01 06:51:30
>
> ANE4966I (Session: 4532, Node: F50_CLIENT)  Network data
>
> transfer rate:6,130.86 KB/sec07/31/01 06:51:30
>
> ANE4967I (Session: 4532, Node: F50_CLIENT)  Aggregate data
>
> transfer rate:  2,462.14 KB/sec  07/31/01 06:51:30
>
> ANE4968I (Session: 4532, Node: F50_CLIENT)  Objects
>
> compressed by:0% 07/31/01 06:51:30
>
> ANE4964I (Session: 4532, Node: F50_CLIENT)  Elapsed
>
> processing time:08:12:07
>
>
> Any advice would be helpful.
>
> Thanks in advance,
>
> Bill Wheeler
> AIX Administrator
> La-Z-Boy Incorporated
> [EMAIL PROTECTED] 
>

Re: Transfer Rate

[David Longo]

Your original post of actlog stats didn't include how many objects
inspected/backed up.  If you have a LOT of small files that would
account for some of it.

What type of network do you have?

I just looked at some of my stats and I have on the clients I checked
a Network to Aggregate data transfer time of 2 -1 to 3 -1.

How many sessions does the client use?  You can set 
RESOURCEUTILIZATION in dsm.sys on client to increase number
 of sessions - see docs for info.  Experiment to see best for you.

I would think you can get better than 8 hours for 70GB.  I imagine
4 -6 hours is as good as you can  do.

Have TSM 3.7.4.0 server on AIX 4.3.3 on F50 with 4x 332Mhz CPU
and 2 GB RAM.  IBM 3575 library.  Using 155MB ATM network.  (Some clients have 100MB 
Ethernet.)


David B. Longo
System Administrator
Health First, Inc.
3300 Fiske Blvd.
Rockledge, FL 32955-4305
PH  321.434.5536
Pager  321.634.8230
Fax:321.434.5525
[EMAIL PROTECTED]


>>> [EMAIL PROTECTED] 08/02/01 01:47PM >>>
The only client we have is where the server is located.  We are running TSM
to backup one RS/6000 F50 server.  And backing up 70 GB in 8 hours doesn't
seem right.  Is there anything that I can do to speed this up.  We run a
Magstar 3570 connected to the F50 server through SCSI.

TSM Version 4.1.2.0
AIX Version 4.3.3.0

-Original Message-
From: Lindsay Morris [mailto:[EMAIL PROTECTED]] 
Sent: Thursday, August 02, 2001 10:19 AM
To: [EMAIL PROTECTED] 
Subject: Re: Transfer Rate


Aggregate uses wall-clock time;
Network uses the intervals between when the client says "I'm sending data
now", to when the server actually receives it.

It's perfectly normal to have aggregate be a lot slower than network.

If you really want to speed up your backups, you need to
look at the accounting log records (.../server/bin/dsmaccnt.log - see admin
guide for layout)
to see which of your clients suffer most from idle wait, media wait, or comm
wait.

> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED]]On Behalf Of
> Bill Wheeler
> Sent: Thursday, August 02, 2001 9:55 AM
> To: [EMAIL PROTECTED] 
> Subject: Transfer Rate
>
>
> Hello All,
>
> I hope a few of the *SMer guru can help me out on this one.   I don't
> know if you have had a problem like this before.   The problem is our
> Aggregate Transfer Rate is allot lower then the Network Transfer
> Rate.   Is
> there something that I can look at to see if I can get the data moved
> quicker?Here is a copy of the Activity log with the rates:
>
>
> ANE4961I (Session: 4532, Node: F50_CLIENT)  Total number
>
> of bytes transferred:69.33 GB07/31/01 06:51:30
>
> ANE4963I (Session: 4532, Node: F50_CLIENT)  Data transfer
>
> time:11,858.22 sec   07/31/01 06:51:30
>
> ANE4966I (Session: 4532, Node: F50_CLIENT)  Network data
>
> transfer rate:6,130.86 KB/sec07/31/01 06:51:30
>
> ANE4967I (Session: 4532, Node: F50_CLIENT)  Aggregate data
>
> transfer rate:  2,462.14 KB/sec  07/31/01 06:51:30
>
> ANE4968I (Session: 4532, Node: F50_CLIENT)  Objects
>
> compressed by:0% 07/31/01 06:51:30
>
> ANE4964I (Session: 4532, Node: F50_CLIENT)  Elapsed
>
> processing time:08:12:07
>
>
> Any advice would be helpful.
>
> Thanks in advance,
>
> Bill Wheeler
> AIX Administrator
> La-Z-Boy Incorporated
> [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>



"MMS " made the following
 annotations on 08/02/01 14:20:19
--
This message is for the named person's use only.  It may contain confidential, 
proprietary, or legally privileged information.  No confidentiality or privilege is 
waived or lost by any mistransmission.  If you receive this message in error, please 
immediately delete it and all copies of it from your system, destroy any hard copies 
of it, and notify the sender.  You must not, directly or indirectly, use, disclose, 
distribute, print, or copy any part of this message if you are not the intended 
recipient.  Health First reserves the right to monitor all e-mail communications 
through its networks.  Any views or opinions expressed in this message are solely 
those of the individual sender, except (1) where the message states such views or 
opinions are on behalf of a particular entity;  and (2) the sender is authorized by 
the entity to give such views or opinions.

==

Re: Transfer rate in TSM 4.1 OS/390

[Petr Přerost]

Hi Wilfredo ,
if you are sure that problem with throughput is in tapes you should check
tapeiobufs setting in your server
confiruration file - you can speed  up tape processing if you are ready to
use some extra memory.
I recommend to check q db f=d  - cache hit and region size in the same time.

regards
 Petr

- Pùvodní zpráva -
Od: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
Komu: <[EMAIL PROTECTED]>
Odesláno: 13. bøezna 2001 18:10
Pøedmìt: Re: Transfer rate in TSM 4.1 OS/390


> Adolph, the drives are Escon connections. We have two (2) channels to the
> controller. There is not anyone using
>  the tape drives at the same time.
>
> Thanks again
> -- Remitido por WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA
con
> fecha 13/03/2001 13:07 ---
>
>
> [EMAIL PROTECTED] con fecha 13/03/2001 11:34:00
> Destinatarios: [EMAIL PROTECTED]@Internet
> CC:  (cci: WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA)
>
> Asunto: Re: Transfer rate in TSM 4.1 OS/390
>
> Wilfredo, then you need to look at how the drives are connected Escon or
> Ficon - how many connections to the controller. Was anything else using
tape
> drives at the same time?
>
> I'm seeing rates around 20MB/sec which after compression would be about
> 7-8MB/sec.
>
> Adolph
> - Original Message -
> From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
> To: <[EMAIL PROTECTED]>
> Sent: Tuesday, March 13, 2001 9:24 AM
> Subject: Re: Transfer rate in TSM 4.1 OS/390
>
>
> > Thanks Adolph,
> >
> > The drives are 3590 E and I am using drives hardware compression.
> >
> > Wilfredo
> >
> >
> >
> >
> >
> > [EMAIL PROTECTED] con fecha 13/03/2001 10:02:00
> > Destinatarios: [EMAIL PROTECTED]@Internet
> > CC:  (cci: WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA)
> >
> > Asunto: Re: Transfer rate in TSM 4.1 OS/390
> >
> > You didn't mention which model of 3590 drive. The B models have a
maximum
> > native transfer rate of 9MB/sec and the E's have a maximum of 14MB/SEC.
> How
> > are the drives attached to your OS/390 system? Are you using TSM
> compression
> > or are you using the drives hardware compression? These can all impact
> your
> > throughput.
> >
> > Adolph
> >
> >
> > - Original Message -
> > From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
> > To: <[EMAIL PROTECTED]>
> > Sent: Tuesday, March 13, 2001 8:13 AM
> > Subject: Transfer rate in TSM 4.1 OS/390
> >
> >
> > > Anyone know about the highest transfer rate in TSM 4.1 OS/390 Server
> from
> > OMVS
> > > Client through IBM 3494 Magstar 3590?. I have done some tests. The
> highest
> > > transfer rate that I have reached is 5MB/sec. Is it the maximum?
> > >
> > > I appreciate your help,
> > >
> > > Wilfredo Castillo
> > > Data Center
> > > Intesa - Caracas, Venezuela
> > >
> > >
> > >
> > > ***  PDVSA4S INTERNET E-MAIL USE  ***
> > > This message may contain information solely  of the interest of PDVSA
or
> > > its businesses. Copying,  distribution,  disclosure  or any  use  of
the
> > > information   contained  in  this  transmission  is  permitted  only
to
> > > authorized  parties. If you have  received this e-mail by  error,
please
> > > destroy it and notify [EMAIL PROTECTED] or the sender by reply
email.
> > >
> > > **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> > > Esta nota puede contener informacion de interes solo  para  PDVSA o
sus
> > > negocios. Solo esta  permitida su  copia, distribucion  o uso a
personas
> > > autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala
y
> > > notifique al remitente o a [EMAIL PROTECTED]
> >
> >
> >
> >
> >
> > ***  PDVSA4S INTERNET E-MAIL USE  ***
> > This message may contain information solely  of the interest of PDVSA or
> > its businesses. Copying,  distribution,  disclosure  or any  use  of the
> > information   contained  in  this  transmission  is  permitted  only  to
> > authorized  parties. If you have  received this e-mail by  error, please
> > destroy it and notify [EMAIL PROTECTED] or the sender by reply email.
> >
> > **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> > Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
> > negocios. Solo esta  permitida su  copia, distribucion  o uso a p

Re: Transfer rate in TSM 4.1 OS/390

[Castillo, Wilfredo]

Adolph, the drives are Escon connections. We have two (2) channels to the
controller. There is not anyone using
 the tape drives at the same time.

Thanks again
-- Remitido por WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA con
fecha 13/03/2001 13:07 ---


[EMAIL PROTECTED] con fecha 13/03/2001 11:34:00
Destinatarios: [EMAIL PROTECTED]@Internet
CC:  (cci: WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA)

Asunto: Re: Transfer rate in TSM 4.1 OS/390

Wilfredo, then you need to look at how the drives are connected Escon or
Ficon - how many connections to the controller. Was anything else using tape
drives at the same time?

I'm seeing rates around 20MB/sec which after compression would be about
7-8MB/sec.

Adolph
- Original Message -
From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Tuesday, March 13, 2001 9:24 AM
Subject: Re: Transfer rate in TSM 4.1 OS/390


> Thanks Adolph,
>
> The drives are 3590 E and I am using drives hardware compression.
>
> Wilfredo
>
>
>
>
>
> [EMAIL PROTECTED] con fecha 13/03/2001 10:02:00
> Destinatarios: [EMAIL PROTECTED]@Internet
> CC:  (cci: WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA)
>
> Asunto: Re: Transfer rate in TSM 4.1 OS/390
>
> You didn't mention which model of 3590 drive. The B models have a maximum
> native transfer rate of 9MB/sec and the E's have a maximum of 14MB/SEC.
How
> are the drives attached to your OS/390 system? Are you using TSM
compression
> or are you using the drives hardware compression? These can all impact
your
> throughput.
>
> Adolph
>
>
> - Original Message -
> From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
> To: <[EMAIL PROTECTED]>
> Sent: Tuesday, March 13, 2001 8:13 AM
> Subject: Transfer rate in TSM 4.1 OS/390
>
>
> > Anyone know about the highest transfer rate in TSM 4.1 OS/390 Server
from
> OMVS
> > Client through IBM 3494 Magstar 3590?. I have done some tests. The
highest
> > transfer rate that I have reached is 5MB/sec. Is it the maximum?
> >
> > I appreciate your help,
> >
> > Wilfredo Castillo
> > Data Center
> > Intesa - Caracas, Venezuela
> >
> >
> >
> > ***  PDVSA4S INTERNET E-MAIL USE  ***
> > This message may contain information solely  of the interest of PDVSA or
> > its businesses. Copying,  distribution,  disclosure  or any  use  of the
> > information   contained  in  this  transmission  is  permitted  only  to
> > authorized  parties. If you have  received this e-mail by  error, please
> > destroy it and notify [EMAIL PROTECTED] or the sender by reply email.
> >
> > **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> > Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
> > negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
> > autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
> > notifique al remitente o a [EMAIL PROTECTED]
>
>
>
>
>
> ***  PDVSA4S INTERNET E-MAIL USE  ***
> This message may contain information solely  of the interest of PDVSA or
> its businesses. Copying,  distribution,  disclosure  or any  use  of the
> information   contained  in  this  transmission  is  permitted  only  to
> authorized  parties. If you have  received this e-mail by  error, please
> destroy it and notify [EMAIL PROTECTED] or the sender by reply email.
>
> **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
> negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
> autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
> notifique al remitente o a [EMAIL PROTECTED]




***  PDVSA4S INTERNET E-MAIL USE  ***
This message may contain information solely  of the interest of PDVSA or
its businesses. Copying,  distribution,  disclosure  or any  use  of the
information   contained  in  this  transmission  is  permitted  only  to
authorized  parties. If you have  received this e-mail by  error, please
destroy it and notify [EMAIL PROTECTED] or the sender by reply email.

**  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
notifique al remitente o a [EMAIL PROTECTED]

Re: Transfer rate in TSM 4.1 OS/390

[Richard Sims]

>Anyone know about the highest transfer rate in TSM 4.1 OS/390 Server
>from OMVS Client through IBM 3494 Magstar 3590?. I have done some
>tests. The highest transfer rate that I have reached is 5MB/sec.
>Is it the maximum?

Wilfredo - The rate you get through an application like TSM is
   dependent upon all the things that the application has
to do in addition to transferring data.  The big factor in TSM is,
of course, database updating as part of file transfer.  The more
(small) files you have, the more db updating, and thus reduced
throughput.

The best course is to first get some benchmark figures for the
optimal transfer rate possible in your environment.  Do this by
taking over one of the drives and then use a simple command that
will transfer a large file (a gigabyte would be good) of known
size to a mounted + ready tape, and time the transfer.  I would
either send randomized data or disable tape drive compression
in order to get true write performance numbers.  (Use an empty
tape that does not belong to TSM, as the test will either write
over the label or create its own label.)

Thereafer, use TSM incremental backup to back up the same file,
to a fresh tape, and compare the numbers.

  Richard Sims, BU

Re: Transfer rate in TSM 4.1 OS/390

[Adolph Kahan]

Wilfredo, then you need to look at how the drives are connected Escon or
Ficon - how many connections to the controller. Was anything else using tape
drives at the same time?

I'm seeing rates around 20MB/sec which after compression would be about
7-8MB/sec.

Adolph
- Original Message -
From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Tuesday, March 13, 2001 9:24 AM
Subject: Re: Transfer rate in TSM 4.1 OS/390


> Thanks Adolph,
>
> The drives are 3590 E and I am using drives hardware compression.
>
> Wilfredo
>
>
>
>
>
> [EMAIL PROTECTED] con fecha 13/03/2001 10:02:00
> Destinatarios: [EMAIL PROTECTED]@Internet
> CC:  (cci: WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA)
>
> Asunto: Re: Transfer rate in TSM 4.1 OS/390
>
> You didn't mention which model of 3590 drive. The B models have a maximum
> native transfer rate of 9MB/sec and the E's have a maximum of 14MB/SEC.
How
> are the drives attached to your OS/390 system? Are you using TSM
compression
> or are you using the drives hardware compression? These can all impact
your
> throughput.
>
> Adolph
>
>
> - Original Message -
> From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
> To: <[EMAIL PROTECTED]>
> Sent: Tuesday, March 13, 2001 8:13 AM
> Subject: Transfer rate in TSM 4.1 OS/390
>
>
> > Anyone know about the highest transfer rate in TSM 4.1 OS/390 Server
from
> OMVS
> > Client through IBM 3494 Magstar 3590?. I have done some tests. The
highest
> > transfer rate that I have reached is 5MB/sec. Is it the maximum?
> >
> > I appreciate your help,
> >
> > Wilfredo Castillo
> > Data Center
> > Intesa - Caracas, Venezuela
> >
> >
> >
> > ***  PDVSA4S INTERNET E-MAIL USE  ***
> > This message may contain information solely  of the interest of PDVSA or
> > its businesses. Copying,  distribution,  disclosure  or any  use  of the
> > information   contained  in  this  transmission  is  permitted  only  to
> > authorized  parties. If you have  received this e-mail by  error, please
> > destroy it and notify [EMAIL PROTECTED] or the sender by reply email.
> >
> > **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> > Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
> > negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
> > autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
> > notifique al remitente o a [EMAIL PROTECTED]
>
>
>
>
>
> ***  PDVSA4S INTERNET E-MAIL USE  ***
> This message may contain information solely  of the interest of PDVSA or
> its businesses. Copying,  distribution,  disclosure  or any  use  of the
> information   contained  in  this  transmission  is  permitted  only  to
> authorized  parties. If you have  received this e-mail by  error, please
> destroy it and notify [EMAIL PROTECTED] or the sender by reply email.
>
> **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
> negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
> autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
> notifique al remitente o a [EMAIL PROTECTED]

Re: Transfer rate in TSM 4.1 OS/390

[Castillo, Wilfredo]

Thanks Adolph,

The drives are 3590 E and I am using drives hardware compression.

Wilfredo





[EMAIL PROTECTED] con fecha 13/03/2001 10:02:00
Destinatarios: [EMAIL PROTECTED]@Internet
CC:  (cci: WILFREDO CASTILLO/CASTILLOWU/INS/PDVSA)

Asunto: Re: Transfer rate in TSM 4.1 OS/390

You didn't mention which model of 3590 drive. The B models have a maximum
native transfer rate of 9MB/sec and the E's have a maximum of 14MB/SEC. How
are the drives attached to your OS/390 system? Are you using TSM compression
or are you using the drives hardware compression? These can all impact your
throughput.

Adolph


- Original Message -
From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Tuesday, March 13, 2001 8:13 AM
Subject: Transfer rate in TSM 4.1 OS/390


> Anyone know about the highest transfer rate in TSM 4.1 OS/390 Server from
OMVS
> Client through IBM 3494 Magstar 3590?. I have done some tests. The highest
> transfer rate that I have reached is 5MB/sec. Is it the maximum?
>
> I appreciate your help,
>
> Wilfredo Castillo
> Data Center
> Intesa - Caracas, Venezuela
>
>
>
> ***  PDVSA4S INTERNET E-MAIL USE  ***
> This message may contain information solely  of the interest of PDVSA or
> its businesses. Copying,  distribution,  disclosure  or any  use  of the
> information   contained  in  this  transmission  is  permitted  only  to
> authorized  parties. If you have  received this e-mail by  error, please
> destroy it and notify [EMAIL PROTECTED] or the sender by reply email.
>
> **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
> negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
> autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
> notifique al remitente o a [EMAIL PROTECTED]





***  PDVSA4S INTERNET E-MAIL USE  ***
This message may contain information solely  of the interest of PDVSA or
its businesses. Copying,  distribution,  disclosure  or any  use  of the
information   contained  in  this  transmission  is  permitted  only  to
authorized  parties. If you have  received this e-mail by  error, please
destroy it and notify [EMAIL PROTECTED] or the sender by reply email.

**  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
notifique al remitente o a [EMAIL PROTECTED]

Re: Transfer rate in TSM 4.1 OS/390

[Adolph Kahan]

You didn't mention which model of 3590 drive. The B models have a maximum
native transfer rate of 9MB/sec and the E's have a maximum of 14MB/SEC. How
are the drives attached to your OS/390 system? Are you using TSM compression
or are you using the drives hardware compression? These can all impact your
throughput.

Adolph


- Original Message -
From: "Castillo, Wilfredo" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Tuesday, March 13, 2001 8:13 AM
Subject: Transfer rate in TSM 4.1 OS/390


> Anyone know about the highest transfer rate in TSM 4.1 OS/390 Server from
OMVS
> Client through IBM 3494 Magstar 3590?. I have done some tests. The highest
> transfer rate that I have reached is 5MB/sec. Is it the maximum?
>
> I appreciate your help,
>
> Wilfredo Castillo
> Data Center
> Intesa - Caracas, Venezuela
>
>
>
> ***  PDVSA4S INTERNET E-MAIL USE  ***
> This message may contain information solely  of the interest of PDVSA or
> its businesses. Copying,  distribution,  disclosure  or any  use  of the
> information   contained  in  this  transmission  is  permitted  only  to
> authorized  parties. If you have  received this e-mail by  error, please
> destroy it and notify [EMAIL PROTECTED] or the sender by reply email.
>
> **  USO DEL CORREO ELECTRONICO DE PDVSA HACIA INTERNET  **
> Esta nota puede contener informacion de interes solo  para  PDVSA o  sus
> negocios. Solo esta  permitida su  copia, distribucion  o uso a personas
> autorizadas. Si recibio esta  nota  por  error,  por  favor destruyala y
> notifique al remitente o a [EMAIL PROTECTED]