Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Curtis Preston
I'm not convinced either. Although our numbers are a little different, you and I end up roughly at the same place. There are a number of vendors whose de-dupe targets top out at about 200-300 MB/s, which is roughly the speed of 2-3 LTO-3 drives, depending on how well you use them. If you need mo

Re: [Veritas-bu] De-Dupe with NBU PureDisk

2007-09-24 Thread Curtis Preston
That scenario is exactly what Puredisk was designed for. If it's typical user data (i.e. not auto-generated data like seismic or medical imaging), I'd estimate less than 1% a day going across the wire, often less than 0.5%. (Your mileage may vary, of course.) --- W. Curtis Preston Backup Blog @

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Ed Wilts
I'm not convinced that writing to a DataDomain is going to be faster than writing to multiple LTO-3 drives over a SAN. The DD is limited to about 90MB/sec which is on par with 1-2 LTO-3 drives and not much more than that. Unless, of course, you consider adding extra DD units for every 2 LTO-3 driv

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Liddle, Stuart
Curtis, Yes, that is correct. I am remembering all of the PAIN associated with having NetBackup Vault make copies to physical tape. It went something like this: 1) do the backup to VTL 2) vault images from VTL to physical tape 3) keep track of the stuff that has been vaulted and then expire im

Re: [Veritas-bu] Changing Schedule Names

2007-09-24 Thread Haskins, Steve
This will be the case, even when an Incremental is scheduled, when the policy name is changed or a client put in to a different policy altogether. Regards From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Patrick Sent: Monday, September 24, 200

[Veritas-bu] De-Dupe with NBU PureDisk

2007-09-24 Thread Robin Small
The talk about the tapeless environments has got me thinking, and oddly enough, we just got a visit from our Quantum sales reps talking about the DXi series dedupe products. Any of you folks have much experience with the Symantec NBU PureDisk approach? We have some remote offices that I current

Re: [Veritas-bu] Changing Schedule Names

2007-09-24 Thread Curtis Preston
I don't think there are any issues with that. Changing a policy name is a problem, but not schedule names. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTE

Re: [Veritas-bu] Changing Schedule Names

2007-09-24 Thread Patrick
The only possible reason that I can think of, is that might cause a full backup instead of a incremental the next time it runs, but that should be about it. Regards, Patrick Whelan [EMAIL PROTECTED] VERITAS Certified NetBackup Support Engineer for UNIX English From: [EMAIL PROTECTED]

[Veritas-bu] Changing Schedule Names

2007-09-24 Thread Ellis, Jason
Is there any reason that I would not want to change a schedule name? I see that it is tracked in the images file, but from what I understand it isn't needed to perform a restore. Would one not want to change this for any reason? Jason Ellis Technical Consultant IT Storage - Data Protecti

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Larry Mascarenhas
Hmm.. That's a problem. Oh well, back to the drawing board. Curtis Preston wrote: >> This is because an expired tape gets labelled and put into the Scratch > pool >automatically. > > No it doesn't. It gets put in the Scratch, but it is not relabeled. > -- Larry Mascarenhas [EMAIL PROTECTED]

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Curtis Preston
I think you nailed it, Stu. I remember your previous posts on this topic, and that you said you went to this method because the NBU Vault method wasn't duping the tapes fast enough for you. As I recall, it was because your backups had millions of files in them, and this was slowing down your d

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Curtis Preston
There are no products in the market that rely solely on a checksum to identify redundant data. There are a few that rely solely on a 160-bit hash, which is significantly larger than a checksum (typically 12-16 bits). There are some who are concerned about hash collisions in this scenario. I am n

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread A Darren Dunham
On Mon, Sep 24, 2007 at 05:08:31PM -0400, bob944 wrote: > In the technologies I'm familiar with--one of them is old, another new, > it's conceptually simple. "The system," whether that's a standalone > system or a box of disk with some smarts or an agent on the backup > client, receives data and e

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Curtis Preston
>Simplistically, it checksums the "block" and looks in a table of >checksums-of-"blocks"-that-it-already-stores to see if the identical > data already lives there. To what hole do you refer? I see one in your simplistic example, but not in what actually happens (which require a much longer tech

[Veritas-bu] Restoring Log Data

2007-09-24 Thread gturner
Retention is 1 week. But I have expired images going back to 06 on media. +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +--

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread bob944
> Question : I gather Deduplication is using other software. > DataDomain i > think i saw mentioned. Where does this fit in with Netbackup and does > the software reside on every client or just a server somewhere? In the technologies I'm familiar with--one of them is old, another new, it's concep

Re: [Veritas-bu] Restoring Log Data

2007-09-24 Thread Martin, Jonathan
How long do you keep your catalog backup tapes? -Jonathan -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of gturner Sent: Monday, September 24, 2007 3:28 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Restoring Log Data Running 6.0MP4 ove

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Liddle, Stuart
I think I'm beginning to understand my confusion to some of the earlier comments and now see from the conversations that are taking place that the way we are using our VTL's is vastly different from the way that most of the respondents to this thread are using theirs. Correct me if I'm wrong, b

[Veritas-bu] Restoring Log Data

2007-09-24 Thread gturner
Yes, I went digging around and I believe I found it. But wasnt sure. I was going to restore the Program Files\Veritas\Netbackup\logs directory. I believe that will solve my issues. +-- |This was sent by [EMAIL PROTECTED] via B

Re: [Veritas-bu] Restoring Log Data

2007-09-24 Thread Justin Piszcz
On Mon, 24 Sep 2007, gturner wrote: > > Running 6.0MP4 over W2K3 standard svr SP2 > > I recently changed the Clean-up on my Master server from 90 to 365 days. > Does anyone know of a way to recover the data that has been cleaned up? > Going back to say... The beginning of the year? > > I need

Re: [Veritas-bu] Restoring Log Data

2007-09-24 Thread Mike L. Varney
Do you have backups of the master server? -- M gturner VERITAS-BU@mailman.eng.auburn.edu Sent

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Curtis Preston
Dave, Dude, you've got to get our more. ;) I'd recommend continually perusing some of these sites to stay current on what's going on in the industry. De-dupe is kind of the most-mentioned topic in the storage industry since I don't know what. http://www.searchstorage.com http://www.byteandswit

[Veritas-bu] Restoring Log Data

2007-09-24 Thread gturner
Running 6.0MP4 over W2K3 standard svr SP2 I recently changed the Clean-up on my Master server from 90 to 365 days. Does anyone know of a way to recover the data that has been cleaned up? Going back to say... The beginning of the year? I need to be able to verify if a certain database backup ra

[Veritas-bu] Calculating physical/virtual tape library utilization via NBU

2007-09-24 Thread mikemclain
<> Attached is a Perl script that we use to calculate the capacity and usage of our physical and virtual tape libraries. It parses the available_media output and based on the average capacity of each "FULL" tape, it is able to determine an approximate capacity and usage of the whole library.

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Curtis Preston
All of those Paul said and Data Domain too. They have both a NAS and a virtual tape interface. And yes, all of these do de-dupe. I keep a directory of de-dupe vendors at Backup Central Wiki: http://www.backupcentral.com/components/com_mambowiki/index.php/Disk_Targets%2C_currently_shipping Here

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Curtis Preston
The problem is not de-dupe; the problem is thin provisioning and oversubscription. There are a lot of VTLs that allow both (with or w/o de-dupe), and if you define more tapes than you actually have disk, you will have this problem. I'll concede that oversubscription is a natural state in a de

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Curtis Preston
Paul said: >But in other cases, yes, as you said, even though Netbackup expires a VT, the >VTL doesn't know it's "allowed" to delete the pointers for the VT untill NBU >does a bplabel on that Cart ID. Or starts writing to it from the beginning, such as when it reuses a tape. Either way,

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Martin, Jonathan
My understanding is that the "file system" is completely virtual. The file list you can pull as a CIFS or NFS share, but each file is made up of "chunks" on the back end. I think by definition deduplication involves LOTS of fragments. :) I questioned the performance myself - I haven't test dr

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Paul Keating
What filesystem is on the appliance? Does the app then "defrag" the small chunks of dereferenced space into contiguous chunks? Or does the next backup write to whatever chunks of free space it can find (performance?) -- > -Original Message- > From: Martin, Jonathan [mailto:[EMAIL PROTEC

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Martin, Jonathan
Per my Data Domain rep - when a DSU image expires, NBU deletes it. Data Domain's product then checks all the blocks associated with that image file and removes any that are not shared by any other backups. -Jonathan -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Clem Kruger
I am not quite sure how it is done there. I would contact Symantec in your area and ask how they will manage your license. Kind Regards, Clem Kruger -Original Message- From: Justin Piszcz [mailto:[EMAIL PROTECTED] Sent: 24 September 2007 19:16 PM To: Clem Kruger Cc: [EMAIL PROTEC

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Justin Piszcz
Do you need a special license for 6.5 or can those with 6.0 licenses upgrade? I assume you need to open a case with NetBackup to get the download links? Justin. On Mon, 24 Sep 2007, Clem Kruger wrote: > Hi Dave, > > Yes it is a difficult decision I have looked at DataDomain with > NetBackup.

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Clem Kruger
Haha, Yes Paul, when you have made life so easy that DBA's decide they can make backups without letting the storage group know, it is not so easy. Kind Regards, Clem Kruger -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: 24 Se

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Clem Kruger
Hi Dave, Yes it is a difficult decision I have looked at DataDomain with NetBackup. I have found that the backups are faster and there is a vast amount of disk being saved. NetBackup 6.5 includes de-duplication and I have become a great friend of it. To use the words of a supplier, "Saving me Tim

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Jim Horalek
On a similar note how does NDMP play with Disk de-dup? All of the de-dups I've seem are NAS devices. NDMP only talks to tape or VTL. Are there VTL's with De-dup that would solve the NDMP problem? Jim -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dave Ma

Re: [Veritas-bu] How to roll back if nbpushdata failed on media server ?

2007-09-24 Thread bob944
> Thanks to refer me to below links which I had done all the reading. > http://library.veritas.com/docs/282326 > http://support.veritas.com/docs/285223). > > If yours read my question carefully, there is not roll back > procedure for media server. > The links above is the roll back procedure fo

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Paul Keating
There are several. FalconStor, Diligent, Quantum and Sepaton I believe will all present a "tape" to an NDMP device, and provide de-dupe on the backend. Paul -- > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf > Of Jim Horalek > Sent: September 24,

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Paul Keating
It's not as complicated as you make it sound. Like tape, you need to keep some overhead in free disk. If you want to maximize the contiguous free disk available, then you would bplable tapes as they expire and go back to scratch. As you write to a scratch tape, the space that cart previously occu

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Schaefer, Harry
For on-demand type database backups, I had great success with setting up a simple SATA-based DSU which was seen by one of the media servers. It had a vault policy to dump it to tape after 4-5 days, then expire the DSU image. It worked out great for informix onbar log dumps especially... Harry S. A

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Jeff Lightner
Data Domain makes a hardware storage device (disks) which does deduplication. Rather than backing up block for block all the time it does it only for the first backup. For subsequent backups rather than doing an incremental backup at file level it backups up incrementally at block level meaning o

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Clem Kruger
Hi All, This is exactly right. The space is not available! Let us assume that you need to write an urgent backup to a different set of tapes. Although there are tapes that have expired, you may not have space on the DISK to write to those tapes, your backup will fail. Now go back to the direc

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Justin Piszcz
On Mon, 24 Sep 2007, Dave Markham wrote: > Guys i've just read this thread and can say im very interested in it. > The first thing is i learned a new term called deduplication which i > didn't know existed. > > Question : I gather Deduplication is using other software. DataDomain i > think i saw

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Dave Markham
Guys i've just read this thread and can say im very interested in it. The first thing is i learned a new term called deduplication which i didn't know existed. Question : I gather Deduplication is using other software. DataDomain i think i saw mentioned. Where does this fit in with Netbackup and d

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Paul Keating
unless the VTL has the option to "free" the disk space on a schedule, which it sounds like what Stuart is saying about the NetApp. ie, your tape retention is set to 3 weeks, then your VTL essentially has a 3+ week "time to live" on pointers. would be kinda scarey if you entended the retention on

[Veritas-bu] VTL vs. DSSU with Data Domain

2007-09-24 Thread Jeff Lightner
Anyone using de-dupe devices like Data Domain? If so do you use VTL or DSSU? If you use vtl is the licensing cost worth it and if so why? We currently have a SAN environment (on the UNIX side) and were intending to add the Data Domains to it using VTL. We're getting push back from vendor that

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Paul Keating
NBU does not relabel expired tapes before assigning back to Scratch. Inline copy to physical and virtual tape is a pain because you lose the advantage of defining as many virtual drives as you want, and are limited by the number of physical drives, unless you have priorities on data...ie, your imp

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Paul Keating
With VTL there is no need to multistream. Instead of writing 8 stream to 1 drive, just create 8 Virtual drives, and not multiplex. It's not because of a performance issue, it's an advantage of virtualization. As far as performance goes, with a Disk as disk config, to create a high perf target,

Re: [Veritas-bu] Tapeless backup environments?

2007-09-24 Thread Paul Keating
I currently backup 9TB of data to VTL during a FULL window which writes ~100GB of data to the VTL repository in that window. Another state is one thing, but across town via DWDM is no prob. out of state is handled by duping that data to phys tapewouldn't want to dupe disk outside of a DWDM

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Kevin Whittaker
I agree with Paul on this issue. The same is true with the VTL that I currently use. Kevin Whittaker -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: Monday, September 24, 2007 9:34 AM To: Curtis Preston; Clem Kruger; VERITAS-BU@mailma

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Paul Keating
Not entirely true, Curtis. When your virutal tape expires, the VTL has no way of knowing this untill the tape is written to again. Depending on the VTL, this may be too late. I've got about 2TB of "free" space on my VTL, and about 1000 scratch VTs (2800 total). After a couple of weeks of Netback

Re: [Veritas-bu] Catalog sharing

2007-09-24 Thread Preston, Douglas L
NBU 6.0 and 6.5 the master server license and media server license are the same licennse. If you have master servers at your remote locations you can change them to media servers and point them to your EMM server. Doug Preston Systems Engineer Land America Tax and Flood Services Phone 626-339-5

[Veritas-bu] There is a bug with 6.0MP5 upgrade if using ACSLS environments.

2007-09-24 Thread Justin Piszcz
In an ACSLS environment it hangs, running it again, it works, how do I know this? I have more than 1 ACSLS environment, same bug occurred more than once. It fails on the tpext update command: It looks like this: Running /usr/openv/netbackup/bin/admincmd/bpsyncinfo add_paths command ... Upgradi

Re: [Veritas-bu] Netbackup upgrade 6 or 6.5

2007-09-24 Thread Justin Piszcz
It can be hard to find if you look around you may find a PDF but basically the Enterprise allows more control/allows you do use the -h/-M commands for better remote control and it includes some features not found in the regular version. On Mon, 24 Sep 2007, Dave Markham wrote: > Does Anyone ha

Re: [Veritas-bu] Netbackup upgrade 6 or 6.5

2007-09-24 Thread Dave Markham
Does Anyone have a pointer to the differences between Netbackup 6 Server and Netbackup 6 Enterprise Server? I cant seem to find a comparison on symantec. Cheers DULLAART, Rob ONL wrote: > > I am currently facing the same question. > > > > We have Netbackup 5.1 with mp5, > I am thinking of fir

Re: [Veritas-bu] windows 2003 system state restore problem

2007-09-24 Thread Spearman, David
Len, Whether this is applicable or not I don't know, however we have found with w2k3 that in order to make a restore work that includes sys state the target must be at the same build level as the data you have on your backup. So if your data was of a w2k3 SP1 system then you need to build the targ

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread A Darren Dunham
> In the Legato world, relabelling the VTL volume resulted in the space > being returned to the disk. This is true even for an expired tape. ie I > needed to relabel it. > > In Netbackup, I think it is significantly better. This is because an > expired tape gets labelled and put into the Scratc

Re: [Veritas-bu] Script to label expired tapes in a VTL

2007-09-24 Thread Curtis Preston
I try not to comment on specific named products in a public forum. (People tend to do crazy things like sue me.) Having said that, make sure you ask an SE familiar with that product what type of performance you should expect. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Prote