[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
Our numbers vary greatly according to the clients. We have very old Solaris machines that backup at 50+ MB/sec. We have very new Windows machines where throughput varies greatly between different volumes on the same machine (e.g. a volume with 5 million tiny files backs up at 30 MB/sec via FlashBackup, while another volume on the same machine gets about 7 MB/sec backing up small files via FlashBackup). It's difficult to get good numbers because we use multi-streaming and multiplexing like crazy. So the actual throughput to the drive is the sum of the jobs using the drive at that moment. Individual jobs vary between 5 MB/sec and about 65 MB/sec. But the total throughput to the tape heads is unknown. Anyone know an easy way to calculate that? +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
I spoke with the network guys in our shop and I got the following: 1. the IOS version is: 12.2, rev. 18 sfx 7 native 2. there is no minumum HW version 3. the hardware we're using is a Catalyst WS-X6748-GE-TX 4. they configured the ports as LCP in active mode Being a Unix guys, I haven't the foggiest idea what that means. But that's the best I can relate their info. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
I spoke with our Network guys and got the following: 1. the IOS version is 12.2, revision 18, sfx 7 native 2. there is no minimum hardware version 3. we are running on a Catalyst WS-X6748-GE-TX 4. they configured LCP ports in active mode Being a Unix guy and knowing virtually nothing about Cisco gear, I haven't the foggiest idea what any of that means. But that's the best I can relate their info. Paul Keating wrote: > Is anything particular required on the Switch? > Minimum IOS version? > Minimum hardware version? > > Paul > > -- > > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of sauderd > > Sent: May 8, 2007 11:27 AM > > To: VERITAS-BU@mailman.eng.auburn.edu > > Subject: [Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server > > > > > > > > It was driver code to get the dladm command to work properly > > with the Cisco switch. > > > > > La version française suit le texte anglais. > > > > This email may contain privileged and/or confidential information, and the > Bank of > Canada does not waive any related rights. Any distribution, use, or copying > of this > email or the information it contains by other than the intended recipient is > unauthorized. If you received this email in error please delete it > immediately from > your system and notify the sender promptly by email that you have done so. > > > > Le présent courriel peut contenir de l'information privilégiée ou > confidentielle. > La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute > diffusion, > utilisation ou copie de ce courriel ou des renseignements qu'il contient par > une > personne autre que le ou les destinataires désignés est interdite. Si vous > recevez > ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans > délai à > l'expéditeur un message électronique pour l'aviser que vous avez éliminé > de votre > ordinateur toute copie du courriel reçu. > > ___ > Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu > http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
It was driver code to get the dladm command to work properly with the Cisco switch. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
Oh, I almost forgot to mention something. We got a specially created fix from Sun to get the Solaris 10 part to work. A publicly available patch will forthcoming soon. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
The four onboard NICs as well as an extra 2-port NIC we installed are all GLDv3 devices. So, they take advantage of the new dladm command to do link aggregation. We had the networking guys configure the 6 ports on the Cisco switch (LACP protocol) and then we did the aggregation as follows: dladm create-aggr -P L2 -l active -d e1000g0 -d e1000g1 -d e1000g2 -d e1000g3 -d e1000g4 -d e1000g5 18 ifconfig aggr18 plumb nvsun14 up One would only use Sun trunking if the NICs or software could not take advantage of the new GLDv3 stack. In particular, we found that the ce (Cassini NIC) devices will never take advantage to of the dladm aggregation. Their performance is also much poorer because they bury the CPU. So stay away from them. But dladm rocks! ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
How are you aggregating those 6 gigE links? Sun trunking? Heck, if there is that much power I'd consider adding more links to our T2000 backup servers for more throughput. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
Before we put our T2000's into service as Netbackup master servers, I benchmarked their network throughput using ttcp and it was amazing. We pushed 5 simultaneous ttcp streams into the T2000 for a cumulative throughput of 495 MB/sec (that's megabytes). All of this was without it breaking a sweat on the CPU--quite low utilization. Take careful note that we were using the 6/06 version of Solaris 10; it takes advantage of the GLDv3 rewrite of the Solaris 10 networking stack, including network link aggregation. We put it into service as a Netbackup master server and we aggregated 6 incoming GigE links. Like the post above, I used 256K as the buffer size (recommended by the the LTO3 drive manufacturer, HP). I used empirical methods to find the miniumal number of buffers that still provided benefit. I doubled the number of buffers, tested, doubled, tested, etc. I found that 128 buffer provide a slight increase in speed vs. 64 buffers. But beyond 128 there was no gain. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
ahh good to know..just saw the bug report on that. well regardless, the iostat metrics tell the real story and it's a pretty picture for the T2000 if you have all the other bases covered. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
Well, on our one our T2000s, we are doing several things at once. many large SAN filesystems are mounted directly on the backup server to write to tape. None of this data has to traverse the network so it is very fast...80-100MB/sec on a single LTO3 drive. At the same time, incoming client backups may be writing to a VTL configured on the same server. Those are typically limited to the network bandwidth of the gigE link. If you have enough fast clients and/or parallel jobs active, you should be able to get 80-90MB/sec of incoming client backups writing. And then you may have one or more jobs thats that are copying data from the VTL to real LTO3 tape drives (i.e. Vault duplication jobs). With the 8 core 8GB T2000, using 4GB FC HBAs to the VTL/LTO3 we've been able to do this all with ease. i.e. 80MB/sec incoming client backups (network->VTL/LTO3) 100MB/sec local backups to tape (local fs ->VTL/LTO3) 100-200MB/sec VTL vault to 1-2 LTO3 drives (VTL -> LTO3) This is about as loaded up as we have a T2000 and it maybe hits a load of 4-5 but still 0% iowait and sustained throughput of all three tasks mentioned above. With 4GB FC, you can probably do more. The host is not the bottleneck. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
Honestly, you shouldn't have to do much. As long as the media server is gigE and your tape drives are working properly (FC ones are pretty easy) I would just make sure you got the buffers set something higher than the default: /usr/openv/netbackup/db/config/NUMBER_DATA_BUFFERS /usr/openv/netbackup/db/config/SIZE_DATA_BUFFERS Solaris 10 defaults to 25% of system memory for shared memory. As long as you have more than a couple GB I recommend you use 64 and 262144 respectively. Your mpx settings also calculate into how much max shared mem will get used by buffers. We've had great success with our T2000 servers that use FC LTO3. In our environment, some higher end linux/solaris clients over the network can write 70-80MB/sec cumulatively via a couple jobs multiplexed to a single LTO3 drive. We have the 8 core 8GB T2000 systems and they don't even break a sweat (load <.5 0% iowait, etc). We usually load em up with lots of other tasks. Windows clients just don't backup very fast over the network, even tuned. You'll have to mpx several of those clients to a single drive just to meet the native write speed. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
