Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim -- *From:* Khurram Tariq [mailto:[EMAIL PROTECTED] *Sent:* Wednesday, 13 June 2007 3:19 PM *To:* Wilkinson, Tim *Subject:* Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim -- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Khurram Tariq *Sent:* Tuesday, 12 June 2007 6:07 PM *To:* veritas-bu@mailman.eng.auburn.edu *Subject:* Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram *IMPORTANT:* This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
flashbackup is a separately licensed feature -Message d'origine- De : Khurram Tariq [mailto:[EMAIL PROTECTED] Envoyé : mercredi 13 juin 2007 08:03 À : veritas-bu@mailman.eng.auburn.edu Objet : Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim _ From: Khurram Tariq [mailto: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] Sent: Wednesday, 13 June 2007 3:19 PM To: Wilkinson, Tim Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim _ From: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu mailto:veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu mailto:Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu Ce message ainsi que toutes pièces jointes (le message) sont confidentiels et sont exclusivement destinés à l'usage de la personne à laquelle ils sont adressés. Tout point de vue ou toute opinion contenus dans ce message expriment la pensée personnelle de leur auteur et ne représentent pas nécessairement la position des sociétés du Groupe GEFCO. Si vous n'êtes pas la personne à laquelle ce message est destiné, veuillez noter que vous avez reçu cet e-mail par erreur et qu'il vous est strictement interdit d'utiliser, de diffuser, de transférer, d'imprimer ou de copier ce message. Si vous avez reçu ce message par erreur, merci de contacter la personne qui vous l'a adressé et de l'effacer immédiatement. Les sociétés du Groupe GEFCO déclinent toute responsabilité en cas d'altération, de modification, d'édition, de diffusion sans autorisation de ce message ou en cas d'affection de ce message par un virus. This message and any attachments (the message) are confidential and intended solely for the use of the individual to whom they are addressed. Any views or opinions presented are solely those of the author and do not necessarily represent those of the GEFCO Group of Companies. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing, or copying of this message is strictly prohibited. If you have received this message in error please contact the sender and delete the message immediately. The GEFCO Group of Companies shall not be liable for the message if altered, changed, falsified, edited, diffused without authorization or affected by any virus. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Its part of the Advanced Client I believe. -aW From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of LAGUERRE Cyril - Ext Sent: Wednesday, 13 June 2007 2:08 PM To: 'Khurram Tariq'; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup flashbackup is a separately licensed feature -Message d'origine- De : Khurram Tariq [mailto:[EMAIL PROTECTED] Envoyé : mercredi 13 juin 2007 08:03 À : veritas-bu@mailman.eng.auburn.edu Objet : Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim From: Khurram Tariq [mailto:[EMAIL PROTECTED] Sent: Wednesday, 13 June 2007 3:19 PM To: Wilkinson, Tim Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim From: [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu Ce message ainsi que toutes pièces jointes (le message) sont confidentiels et sont exclusivement destinés à l'usage de la personne à laquelle ils sont adressés. Tout point de vue ou toute opinion contenus dans ce message expriment la pensée personnelle de leur auteur et ne représentent pas nécessairement la position des sociétés du Groupe GEFCO. Si vous n'êtes pas la personne à laquelle ce message est destiné, veuillez noter que vous avez reçu cet e-mail par erreur et qu'il vous est strictement interdit d'utiliser, de diffuser, de transférer, d'imprimer ou de copier ce message. Si vous avez reçu ce message par erreur, merci de contacter la personne qui vous l'a adressé et de l'effacer immédiatement. Les sociétés du Groupe GEFCO déclinent toute responsabilité en cas d'altération, de modification, d'édition, de diffusion sans autorisation de ce
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Yes you need to purchase a license for the function to work :-) Regards Simon Weaver 3rd Line Technical Support Windows Domain Administrator EADS Astrium Limited, B23AA IM (DCS) Anchorage Road, Portsmouth, PO3 5PU Email: mailto:[EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Khurram Tariq Sent: 13 June 2007 07:03 To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup I mean to ask is Flashbackup a separately licensed feature? On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Do you mean is Flashbackup a separately licensed feature or do you mean is there another feature that can do this? Cheers, Tim _ From: Khurram Tariq [mailto:[EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] Sent: Wednesday, 13 June 2007 3:19 PM To: Wilkinson, Tim Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim _ From: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu mailto:veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu mailto:Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput. Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb ! No tuning was done, no flashback was implemented. Regards Simon Weaver 3rd Line Technical Support Windows Domain Administrator EADS Astrium Limited, B23AA IM (DCS) Anchorage Road, Portsmouth, PO3 5PU Email: mailto:[EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Wilkinson, Tim Sent: 13 June 2007 05:38 To: Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
The file sizes are 1KB to 4MB and are in hundreds of thousands totaling to ~400GB most of the time. On 6/13/07, WEAVER, Simon (external) [EMAIL PROTECTED] wrote: *what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput.* ** *Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb !* ** *No tuning was done, no flashback was implemented.* *Regards* *Simon Weaver 3rd Line Technical Support Windows Domain Administrator* *EADS Astrium Limited, B23AA IM (DCS)* *Anchorage Road, Portsmouth, PO3 5PU* *Email: [EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Wilkinson, Tim *Sent:* 13 June 2007 05:38 *To:* Khurram Tariq; veritas-bu@mailman.eng.auburn.edu *Subject:* Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim -- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Khurram Tariq *Sent:* Tuesday, 12 June 2007 6:07 PM *To:* veritas-bu@mailman.eng.auburn.edu *Subject:* Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram *IMPORTANT:* This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Ø Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. What FlashBackup really does is snapshot the volume and then do a *physical* backup of the volume in other words, block by block, rather than walking the file system. For file systems with lots of files, this can be a huge savings we typically see FlashBackups complete in half the time that regular backups do. The cache volume only needs to be as large as necessary to cache the writes to the volume while it was being backed up. Unless you are in a very intensive write mode, this volume does not need to be as large as the volume being backed up in fact, Ive backed up in excess of 10TB of data with a shared cache volume of under 100GB and it was not getting close to filling (several GB would have sufficed). The FlashBackup documentation explains how to size the cache volume. The performance gain for FlashBackup depends on the overhead of your file system operations. For NTFS, the overhead is quite high (but our big file systems are in the millions of files). Additionally, NTFS is not very efficient in walking the file system in terms of allocating resources. We find that FlashBackup is much more polite to the target than a traditional client backup. /Ed -- Ed Wilts, Mounds View, MN, USA mailto:[EMAIL PROTECTED] I GoodSearch for Bundles Of Love http://www.goodsearch.com/?charityid=821118 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Simon, Is this 4TB on a single filesystem? I'm guessing not how many different drive letters? how big is each? Is each drive letter on a sparate LUN/RG on the SAN, or do you have a couple of 1TB LUNs that you partition or combine on the host side into what you need. I've got one server here with a single drive letter on a single 2TB LUN (one large volume) that has only about 1.2TB utilized, but it has over 4 million files. Attaching a tape drive will do nothing for that guy.it just takes forever for NBU to walk the filesystem. Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of WEAVER, Simon (external) Sent: June 13, 2007 1:08 AM To: 'Wilkinson, Tim'; Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput. Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb ! No tuning was done, no flashback was implemented. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Tim, are you sure about this? I can't imagine having 100% of the original valume available as cache space, nor the load on the client, and the time that would be required to completely mirror a multi TB filesystem! Could it be that it uses something more along the lines of a Copy-On-Write snapshot, vs a complete mirror? Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Wilkinson, Tim Sent: June 13, 2007 12:38 AM To: Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, . but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Hi Paul Its 2 systems, multiple Fibre attached drives, hosted on a HP EVA disk based system. Servers are SAN Media - again fibre attached LTO3 drives. roughly 3 - 400GB per volume. Regards Simon Weaver 3rd Line Technical Support Windows Domain Administrator EADS Astrium Limited, B23AA IM (DCS) Anchorage Road, Portsmouth, PO3 5PU Email: mailto:[EMAIL PROTECTED] [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: 13 June 2007 13:59 To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Simon, Is this 4TB on a single filesystem? I'm guessing not how many different drive letters? how big is each? Is each drive letter on a sparate LUN/RG on the SAN, or do you have a couple of 1TB LUNs that you partition or combine on the host side into what you need. I've got one server here with a single drive letter on a single 2TB LUN (one large volume) that has only about 1.2TB utilized, but it has over 4 million files. Attaching a tape drive will do nothing for that guy.it just takes forever for NBU to walk the filesystem. Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of WEAVER, Simon (external) Sent: June 13, 2007 1:08 AM To: 'Wilkinson, Tim'; Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup what sort of files are they? We have a SAN Media Server, via fibre, with NBU 5.1 via LTO3 Tapes and get good throughput. Its a Windows box though! But does the job - used to take 42 hours, but now down to 16 hours - approx 4TB - huge mix and match of file sizes. from 2kb to 1mb ! No tuning was done, no flashback was implemented. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. - Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Hmmm - I thought I was but probably have to read up on it now :) And then a bit of testing.. From: Paul Keating [mailto:[EMAIL PROTECTED] Sent: Wednesday, 13 June 2007 10:53 PM To: Wilkinson, Tim; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Tim, are you sure about this? I can't imagine having 100% of the original valume available as cache space, nor the load on the client, and the time that would be required to completely mirror a multi TB filesystem! Could it be that it uses something more along the lines of a Copy-On-Write snapshot, vs a complete mirror? Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Wilkinson, Tim Sent: June 13, 2007 12:38 AM To: Khurram Tariq; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup Khurram, . but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Khurram Tariq Sent: Tuesday, 12 June 2007 6:07 PM To: veritas-bu@mailman.eng.auburn.edu Subject: Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Spam: NBU 6 Tuning for Small Files Backup
Thanks. I've not used Flashbackup before so I'll have to read about it. The utilization of the file systems I want to backup goes up and down drastically (in a day) but it still worth giving it a shot. Is there a separately licensed feature? Regards, Khurram On 6/13/07, Wilkinson, Tim [EMAIL PROTECTED] wrote: Khurram, Flashbackup will improve the performance (it caches the data as a sort of snapshot then backs-up the snapshot so it's like a large file rather than loads of small ones, or something like that) but because it works per volume, you need the space for the cache, which is at least the same size as the volume you are backing-up. It will improve performance for loads of small files but probably won't help too much if they are on a huge volume and they take up a small % of the space. Cheers, Tim -- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Khurram Tariq *Sent:* Tuesday, 12 June 2007 6:07 PM *To:* veritas-bu@mailman.eng.auburn.edu *Subject:* Spam: [Veritas-bu] NBU 6 Tuning for Small Files Backup Hi All, We have just migrated to a NBU 6 SAN based environment. We have a server with a large number of small files (100k to 4MB) and its performing quite poorly on SAN based backup (5MB per stream). Can anyone advise some tuning parameters to improve this speed? The library is L500 with FC LTO3 drives. Regards, Khurram *IMPORTANT:* This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
