Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim -- *From:* Khurram Tariq [mailto:[EMAIL PROTECTED] *Sent:* Wednesday, 13 June 2007 3:19 PM *To:* Wilkinson, Tim *Subject:* Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim -- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Khurram Tariq *Sent:* Tuesday, 12 June 2007 6:07 PM *To:* veritas-bu@mailman.eng.auburn.edu *Subject:* Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram *IMPORTANT:* This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
flashbackup is a separately licensed feature -Message d'origine- De : Khurram Tariq [mailto:[EMAIL PROTECTED] Envoyé : mercredi 13 juin 2007 08:03 À : veritas-bu@mailman.eng.auburn.edu Objet : Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim _ From: Khurram Tariq [mailto: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] Sent: Wednesday, 13 June 2007 3:19 PM To: Wilkinson, Tim Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim _ From: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu mailto:veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu mailto:Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu Ce message ainsi que toutes pièces jointes (le message) sont confidentiels et sont exclusivement destinés à l'usage de la personne à laquelle ils sont adressés. Tout point de vue ou toute opinion contenus dans ce message expriment la pensée personnelle de leur auteur et ne représentent pas nécessairement la position des sociétés du Groupe GEFCO. Si vous n'êtes pas la personne à laquelle ce message est destiné, veuillez noter que vous avez reçu cet e-mail par erreur et qu'il vous est strictement interdit d'utiliser, de diffuser, de transférer, d'imprimer ou de copier ce message. Si vous avez reçu ce message par erreur, merci de contacter la personne qui vous l'a adressé et de l'effacer immédiatement. Les sociétés du Groupe GEFCO déclinent toute responsabilité en cas d'altération, de modification, d'édition, de diffusion sans autorisation de ce message ou en cas d'affection de ce message par un virus. This message and any attachments (the message) are confidential and intended solely for the use of the individual to whom they are addressed. Any views or opinions presented are solely those of the author and do not necessarily represent those of the GEFCO Group of Companies. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing, or copying of this message is strictly prohibited. If you have received this message in error please contact the sender and delete the message immediately. The GEFCO Group of Companies shall not be liable for the message if altered, changed, falsified, edited, diffused without authorization or affected by any virus. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Its part of the Advanced Client I believe. -aW From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of LAGUERRE Cyril - Ext Sent: Wednesday, 13 June 2007 2:08 PM To: 'Khurram Tariq'; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup flashbackup is a separately licensed feature -Message d'origine- De : Khurram Tariq [mailto:[EMAIL PROTECTED] Envoyé : mercredi 13 juin 2007 08:03 À : veritas-bu@mailman.eng.auburn.edu Objet : Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim From: Khurram Tariq [mailto:[EMAIL PROTECTED] Sent: Wednesday, 13 June 2007 3:19 PM To: Wilkinson, Tim Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim From: [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu Ce message ainsi que toutes pièces jointes (le message) sont confidentiels et sont exclusivement destinés à l'usage de la personne à laquelle ils sont adressés. Tout point de vue ou toute opinion contenus dans ce message expriment la pensée personnelle de leur auteur et ne représentent pas nécessairement la position des sociétés du Groupe GEFCO. Si vous n'êtes pas la personne à laquelle ce message est destiné, veuillez noter que vous avez reçu cet e-mail par erreur et qu'il vous est strictement interdit d'utiliser, de diffuser, de transférer, d'imprimer ou de copier ce message. Si vous avez reçu ce message par erreur, merci de contacter la personne qui vous l'a adressé et de l'effacer immédiatement. Les sociétés du Groupe GEFCO déclinent toute responsabilité en cas d'altération, de modification, d'édition, de diffusion sans autorisation de ce
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Yes you need to purchase a license for the function to work :-) Regards Simon Weaver 3rd Line Technical Support Windows Domain Administrator EADS Astrium Limited, B23AA IM (DCS) Anchorage Road, Portsmouth, PO3 5PU Email: mailto:[EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Khurram Tariq Sent: 13 June 2007 07:03 To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim _ From: Khurram Tariq [mailto:[EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] Sent: Wednesday, 13 June 2007 3:19 PM To: Wilkinson, Tim Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim _ From: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu mailto:veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu mailto:Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput. Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb ! No tuning was done, no flashback was implemented. Regards Simon Weaver 3rd Line Technical Support Windows Domain Administrator EADS Astrium Limited, B23AA IM (DCS) Anchorage Road, Portsmouth, PO3 5PU Email: mailto:[EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Wilkinson, Tim Sent: 13 June 2007 05:38 To: Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
The file sizes are 1KB to 4MB and are in hundreds of thousands totaling to ~400GB most of the time. On 6/13/07, WEAVER, Simon (external) [EMAIL PROTECTED] wrote: *what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput.* ** *Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb !* ** *No tuning was done, no flashback was implemented.* *Regards* *Simon Weaver 3rd Line Technical Support Windows Domain Administrator* *EADS Astrium Limited, B23AA IM (DCS)* *Anchorage Road, Portsmouth, PO3 5PU* *Email: [EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Wilkinson, Tim *Sent:* 13 June 2007 05:38 *To:* Khurram Tariq; veritas-bu@mailman.eng.auburn.edu *Subject:* Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim -- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Khurram Tariq *Sent:* Tuesday, 12 June 2007 6:07 PM *To:* veritas-bu@mailman.eng.auburn.edu *Subject:* Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram *IMPORTANT:* This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Ø Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. What FlashBackup really does is snapshot the volume and then do a *physical* backup of the volume in other words, block by block, rather than walking the file system. For file systems with lots of files, this can be a huge savings we typically see FlashBackups complete in half the time that regular backups do. The cache volume only needs to be as large as necessary to cache the writes to the volume while it was being backed up. Unless you are in a very intensive write mode, this volume does not need to be as large as the volume being backed up in fact, Ive backed up in excess of 10TB of data with a shared cache volume of under 100GB and it was not getting close to filling (several GB would have sufficed). The FlashBackup documentation explains how to size the cache volume. The performance gain for FlashBackup depends on the overhead of your file system operations. For NTFS, the overhead is quite high (but our big file systems are in the millions of files). Additionally, NTFS is not very efficient in walking the file system in terms of allocating resources. We find that FlashBackup is much more polite to the target than a traditional client backup. /Ed -- Ed Wilts, Mounds View, MN, USA mailto:[EMAIL PROTECTED] I GoodSearch for Bundles Of Love http://www.goodsearch.com/?charityid=821118 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Simon, Is this 4TB on a single filesystem? I'm guessing not how many different drive letters? how big is each? Is each drive letter on a sparate LUN/RG on the SAN, or do you have a couple of 1TB LUNs that you partition or combine on the host side into what you need. I've got one server here with a single drive letter on a single 2TB LUN (one large volume) that has only about 1.2TB utilized, but it has over 4 million files. Attaching a tape drive will do nothing for that guy.it just takes forever for NBU to walk the filesystem. Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of WEAVER, Simon (external) Sent: June 13, 2007 1:08 AM To: 'Wilkinson, Tim'; Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput. Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb ! No tuning was done, no flashback was implemented. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Tim, are you sure about this? I can't imagine having 100% of the original valume available as cache space, nor the load on the client, and the time that would be required to completely mirror a multi TB filesystem! Could it be that it uses something more along the lines of a Copy-On-Write snapshot, vs a complete mirror? Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Wilkinson, Tim Sent: June 13, 2007 12:38 AM To: Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, . but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Hi Paul Its 2 systems, multiple Fibre attached drives, hosted on a HP EVA disk based system. Servers are SAN Media - again fibre attached LTO3 drives. roughly 3 - 400GB per volume. Regards Simon Weaver 3rd Line Technical Support Windows Domain Administrator EADS Astrium Limited, B23AA IM (DCS) Anchorage Road, Portsmouth, PO3 5PU Email: mailto:[EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: 13 June 2007 13:59 To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Simon, Is this 4TB on a single filesystem? I'm guessing not how many different drive letters? how big is each? Is each drive letter on a sparate LUN/RG on the SAN, or do you have a couple of 1TB LUNs that you partition or combine on the host side into what you need. I've got one server here with a single drive letter on a single 2TB LUN (one large volume) that has only about 1.2TB utilized, but it has over 4 million files. Attaching a tape drive will do nothing for that guy.it just takes forever for NBU to walk the filesystem. Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of WEAVER, Simon (external) Sent: June 13, 2007 1:08 AM To: 'Wilkinson, Tim'; Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput. Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb ! No tuning was done, no flashback was implemented. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] storage nodes
Hi list, Got an interesting question (I think) :-) We run on Netbackup version 5.1 mp5, most of our servers run Sun Solaris. Our master server has a disk-cache device attached. This is 10TB of disks divided in three separate LUN's and filesystems. We have three LTO3-tapedrives, to which we flush the disks to. The LTO3 drives are configured as HCART3 in NBU. We made three storage-nodes in NBU which are configured to use one LTO3 tape-drive. But, and this is where my problem is, when NBU start to duplicate it still takes more then one LTO3-drive per disk-device. The problem is as soon as NBU start to read with more then one tape-drive the performance drops significant. I need to find a way to prevent this. What I want is that one disk-device uses only one tape-drive. Any ideas? Regards, Rob Dullaart Senior Netbackup Specialist * This message and any attachments (the message) are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. Messages are susceptible to alteration. France Telecom Group shall not be liable for the message if altered, changed or falsified. If you are not the intended addressee of this message, please cancel it immediately and inform the sender. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam Spam Spam Spam Spam - I don't like spam...: NBU 6 Tuning for Small Files Backup
Any reason you guys can't delete the Spam: from the subject line when you reply? From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of WEAVER, Simon (external) Sent: Wednesday, June 13, 2007 9:40 AM To: 'Paul Keating'; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Hi Paul Its 2 systems, multiple Fibre attached drives, hosted on a HP EVA disk based system. Servers are SAN Media - again fibre attached LTO3 drives. roughly 3 - 400GB per volume. Regards Simon Weaver 3rd Line Technical Support Windows Domain Administrator EADS Astrium Limited, B23AA IM (DCS) Anchorage Road, Portsmouth, PO3 5PU Email: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: 13 June 2007 13:59 To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Simon, Is this 4TB on a single filesystem? I'm guessing not how many different drive letters? how big is each? Is each drive letter on a sparate LUN/RG on the SAN, or do you have a couple of 1TB LUNs that you partition or combine on the host side into what you need. I've got one server here with a single drive letter on a single 2TB LUN (one large volume) that has only about 1.2TB utilized, but it has over 4 million files. Attaching a tape drive will do nothing for that guy.it just takes forever for NBU to walk the filesystem. Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of WEAVER, Simon (external) Sent: June 13, 2007 1:08 AM To: 'Wilkinson, Tim'; Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput. Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb ! No tuning was done, no flashback was implemented. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] storage nodes
If you are using DSSU's as the disk-cache, have you used /usr/openv/netbackup/MAX_STAGING_JOBS files to limit the number of staging jobs to tape? Bobby. -- Original message -- From: DULLAART Rob ONL [EMAIL PROTECTED] Hi list, Got an interesting question (I think) J We run on Netbackup version 5.1 mp5, most of our servers run Sun Solaris. Our master server has a disk-cache device attached. This is 10TB of disks divided in three separate LUNs and filesystems. We have three LTO3-tapedrives, to which we flush the disks to. The LTO3 drives are configured as HCART3 in NBU. We made three storage-nodes in NBU which are configured to use one LTO3 tape-drive. But, and this is where my problem is, when NBU start to duplicate it still takes more then one LTO3-drive per disk-device. The problem is as soon as NBU start to read with more then one tape-drive the performance drops significant. I need to find a way to prevent this. What I want is that one disk-device uses only one tape-drive. Any ideas? Regards, Rob Dullaart Senior Netbackup Specialist * This message and any attachments (the message) are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. Messages are susceptible to alteration. France Telecom Group shall not be liable for the message if altered, changed or falsified. If you are not the intended addressee of this message, please cancel it immediately and inform the sender. ---BeginMessage--- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ---End Message--- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam Spam Spam Spam Spam - I don't like spam...: NBU 6 Tuning for Small Files Backup
Any reason you guys can't delete the Spam: from the subject line when you reply? And the thousand lines of re-re-re-re-quoted text, too? Nah. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] NBU 6 Tuning for Small Files Backup
The performance gain for FlashBackup depends on the overhead of your file system operations. For NTFS, the overhead is quite high (but our big file systems are in the millions of files). Additionally, NTFS is not very efficient in walking the file system in terms of allocating resources. Word. Related comments: o Several years ago I had to back up some software distribution systems with zillions of files and lots o' disk (Yet Another Misapplication of Windows, NTFS and PCs). It was ugly. I could demonstrate the extent of ugly to PC people who didn't think that a command line was some sort of Tool of the Devil or Dirty Trick with time nul dir /s nul time nul showing anything from 42 minutes to a couple of hours--just to traverse the directory structure from that point. So (referring to an earlier post) I don't think it just takes forever for NBU to walk the filesystem speaks to the problem, which is that it takes _NTFS_ forever to walk the filesystem--one needs to work on improving or bypassing NTFS to make improvement. BTW, re-running that line will show a small fraction of the elapsed time--good directory caching in NTFS, I assume. (3m58s for my laptop's C:/ drive the first time, 1m00s the second.) o This finding prompted the app vendor to look into it and they claimed to discover a Microsoft bug that caused a directory-walking exercise as above to pause for long periods when going over the ~500,000-files mark. For all I know, that might have been buffer flushing or maybe it was a real bug. I don't have those boxes any more. o Backing up one problem Windows system (I'll skip the easy lay-up) took 34 hours with Nortan AntiVirus enabled and 17 hours with it disabled. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] BPCLNTCMD -HN truncates IP address
Has anyone ever seen BPCLNTCMD -HN truncate the IP address? For instance, the IP in the hosts file is 10.10.10.100 and BPCLNTCMD looks like this: /usr/openv/netbackup/bin mailto:rmajor@:/usr/openv/netbackup/bin ./bpclntcmd -hn hostname host hostname: hostname at 10.10.10.10 (0xabcde0) checkhname: aliases: I have at least two boxes that this is happening on, first one is above, the other is .200 and comes out as .20 in bpclntcmd, and of course they are failing with a 54. The only correlation I can draw between these two is that they were new additions to the existing hosts file. Other hosts entries are fine and backups are successful. This is a new Solaris 10 media server that is barely in production and nsswitch.conf lists files first. NBU 5.1MP6. A quick internet search turned up nothing. Any ideas? Rusty Major, MCSE, BCFP Sr. Data Assurance Engineer (281) 584-4693 VeriCenter, Inc. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Re: Tuning Solaris 10 for NetBackup Media Server
Our numbers vary greatly according to the clients. We have very old Solaris machines that backup at 50+ MB/sec. We have very new Windows machines where throughput varies greatly between different volumes on the same machine (e.g. a volume with 5 million tiny files backs up at 30 MB/sec via FlashBackup, while another volume on the same machine gets about 7 MB/sec backing up small files via FlashBackup). It's difficult to get good numbers because we use multi-streaming and multiplexing like crazy. So the actual throughput to the drive is the sum of the jobs using the drive at that moment. Individual jobs vary between 5 MB/sec and about 65 MB/sec. But the total throughput to the tape heads is unknown. Anyone know an easy way to calculate that? +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Hmmm - I thought I was but probably have to read up on it now :) And then a bit of testing.. From: Paul Keating [mailto:[EMAIL PROTECTED] Sent: Wednesday, 13 June 2007 10:53 PM To: Wilkinson, Tim; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Tim, are you sure about this? I can't imagine having 100% of the original valume available as cache space, nor the load on the client, and the time that would be required to completely mirror a multi TB filesystem! Could it be that it uses something more along the lines of a Copy-On-Write snapshot, vs a complete mirror? Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Wilkinson, Tim Sent: June 13, 2007 12:38 AM To: Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, . but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Tuning Solaris 10 for NetBackup Media Server
Our numbers vary greatly according to the clients. We have very old Solaris machines that backup at 50+ MB/sec. We have very new Windows machines where throughput varies greatly between different volumes on the same machine (e.g. a volume with 5 million tiny files backs up at 30 MB/sec via FlashBackup, while another volume on the same machine gets about 7 MB/sec backing up small files via FlashBackup). It's difficult to get good numbers because we use multi-streaming and multiplexing like crazy. So the actual throughput to the drive is the sum of the jobs using the drive at that moment. Individual jobs vary between 5 MB/sec and about 65 MB/sec. But the total throughput to the tape heads is unknown. Anyone know an easy way to calculate that? If your drives are fibre-attached, use something like MRTG to grab the fibre port stats and graph that. That gives us a pretty good idea as to what the tape speeds are. -- Ed Wilts, Mounds View, MN, USA mailto:[EMAIL PROTECTED] I GoodSearch for Bundles Of Love: http://www.goodsearch.com/?charityid=821118 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Tuning Solaris 10 for NetBackup Media Server
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 If your running the tapes on Solaris, the iostat utility will show the throughput on st devices as well as disks and ttys. If thats what your looking for, start with iostat -xE to list all the device names as needed by the iostat utility. Might show something like this: st15 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0 Vendor: HP Product: Ultrium 2-SCSI Revision: S33H Serial No: You can then run that against iostat as in iostat st15 2 Thanks Peter Peter DrakeUnderkoffler Xinupro, LLC 617-834-2352 Ed Wilts wrote: Our numbers vary greatly according to the clients. We have very old Solaris machines that backup at 50+ MB/sec. We have very new Windows machines where throughput varies greatly between different volumes on the same machine (e.g. a volume with 5 million tiny files backs up at 30 MB/sec via FlashBackup, while another volume on the same machine gets about 7 MB/sec backing up small files via FlashBackup). It's difficult to get good numbers because we use multi-streaming and multiplexing like crazy. So the actual throughput to the drive is the sum of the jobs using the drive at that moment. Individual jobs vary between 5 MB/sec and about 65 MB/sec. But the total throughput to the tape heads is unknown. Anyone know an easy way to calculate that? If your drives are fibre-attached, use something like MRTG to grab the fibre port stats and graph that. That gives us a pretty good idea as to what the tape speeds are. -- Ed Wilts, Mounds View, MN, USA mailto:[EMAIL PROTECTED] I GoodSearch for Bundles Of Love: http://www.goodsearch.com/?charityid=821118 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (FreeBSD) iD8DBQFGcIISl+lekZRM55oRAgwPAKCwOXeHU66dOtdEevWstDSZ/Rv7owCfeAhb LnvzECvM4VkhddgjyBdj5n4= =k2DP -END PGP SIGNATURE- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
