[Bacula-users] Copying backups from Disk to Tape
Hello Everyone, I'm interested in knowing if there is a feature that allows you to automatically send a copy of a backup to disk off to tape for offsite storage. I'm trying not to have to run two separate backups of the same server but instead just run one backup and then have it copied off to tape. Also this way I know that the same data that's on disk is also on tape. Any suggestions? -Clyde - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copying backups from Disk to Tape
Thanks in advanced! On 6/26/07, Clyde O Goffe <[EMAIL PROTECTED]> wrote: Hello Everyone, I'm interested in knowing if there is a feature that allows you to automatically send a copy of a backup to disk off to tape for offsite storage. I'm trying not to have to run two separate backups of the same server but instead just run one backup and then have it copied off to tape. Also this way I know that the same data that's on disk is also on tape. Any suggestions? -Clyde - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copying backups from Disk to Tape
Hey Peter, Thanks for your reply. I'm not sure if this is what I want though. If I could migrate the data to Tape but also keep the data on disk for fast restores then that would be ideal. The Tapes will be kept offsite. I only want to use the Tape for restores in the event that a restore from Disk fails or if I need to rebuilt my site at a alternate location. It seems your solution is a step in the right direction only I need to keep the data on Disk as well. Do you know if that's possible without having to do a separate backup to Tape of the same data? -Clyde On 6/26/07, Peter Eisch <[EMAIL PROTECTED]> wrote: Hi Clyde, In your pool definition include the key (Next Pool) with the right value: Pool { Name = host Use Volume Once = yes Pool Type = Backup Auto Prune = yes Volume Retention = 13 days Label Format = host- Maximum Volumes = 15 Recycle = yes Storage = hostFiles Next Pool = DSI-Tape } Pool { Name = DSI-Tape Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 31 days # rotate tapes monthly Storage = TL2000 } Then create a job to do the migration. Below is an example. Take care to note that I name my pools (separate pool for each host) the same name as the host. Then replace the named 'host' with the client's name. Also note the bacula server is named ''. : Job { Name = "host-migrate" Type = Migrate Level = Full Client = -fd Write Bootstrap = "/u1/bacula/working/host-migrate.bsr" FileSet = "Host Set" Schedule = "MigrateCycle" Messages = Standard Pool = host Selection Type = Volume Selection Pattern = ".*" Priority = 12 } The Migrate cycle, at my site, fires off on Thursday nights so the tape can be rotated on Friday. In the Migrate job, you could change what's written to tape to be a subset of what was written in the disk backup by manipulating the FileSet. The Migrate job draw from the Pool using the bacula-server's FD. Does this help? Hopefully between the on-line manual and my example you can find a solution. NB: once the backup has been migrated, you can no longer use the disk copy of the backup in the event you need to restore. If you restart the sd between migrate jobs (like a system reboot or add/change to the sd.conf) the next migrate will fail appending to the current tape. It's for these two reasons that I only migrate weekly. peter On 6/26/07 1:58 PM, "Clyde O Goffe" <[EMAIL PROTECTED]> wrote: Thanks in advanced! On 6/26/07, *Clyde O Goffe* <[EMAIL PROTECTED]> wrote: Hello Everyone, I'm interested in knowing if there is a feature that allows you to automatically send a copy of a backup to disk off to tape for offsite storage. I'm trying not to have to run two separate backups of the same server but instead just run one backup and then have it copied off to tape. Also this way I know that the same data that's on disk is also on tape. Any suggestions? -Clyde -- - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copying backups from Disk to Tape
OK so I guess the answer is there's no real way to do it all with bacula. You have to use some outside utility which is kindof a nuisance in terms of managing your backups. If bacula had this functionality then I can use bacula can manage it for me and I can look to bacula for a record of everything copied off to tape. With rync and tar I'd have to create a separate system for managing those tapes. The workaround for me is run a separate backup of the same data since I want bacula to manage everything. This adds more stress to my clients but if this were implemented I'd only have to worry about stressing my storage agents because its just a copy of the data from one medium to another. I've used other enterprise level backup/recovery solutions and they all seem to have this functionality implemented as having multiple copies of the same data stored in multiple places is an essential part of any Disaster Recovery Plan. I would definitely commit resources to the development of this feature. -Clyde On 6/27/07, Brian Debelius <[EMAIL PROTECTED]> wrote: Pool Type = This directive defines the pool type, which corresponds to the type of Job being run. It is required and may be one of the following: Backup *Archive *Cloned *Migration *Copy *Save *Note, only Backup is current implemented. I knew I saw it somewhere. But it does say its not implemented. Arno Lehmann wrote: > Hi, > > 27.06.2007 00:26,, Brian Debelius wrote:: > >> But its in the docs. :) >> > > Where? :-) > > I guess this is a problem with terminology - What is called "cloning" > in the manual, and what you refer to, is probably this (Director > configuration, Job resource): > >> Run = >> The Run directive (not to be confused with the Run option in a Schedule) allows you to start other jobs or to clone jobs. >> > > This does not refer to actual job data cloning, but to the feature > that jobs can start other jobs. > > Not quite what Clyde wants... > > Arno > > >> Arno Lehmann wrote: >> >>> Hi, >>> >>> 26.06.2007 23:21,, Brian Debelius wrote:: >>> >>> >>>> You want what is called cloning. I'm not sure if it has been fully >>>> implemented yet. I would like to do that also. >>>> >>>> >>> No, that's not implemented. I would even say that's not even been >>> started to be implemented. >>> >>> Arno >>> >>> >>> >>>> brian- >>>> >>>> Clyde O Goffe wrote: >>>> >>>> >>>>> Hey Peter, >>>>> >>>>> Thanks for your reply. I'm not sure if this is what I want though. >>>>> If I could migrate the data to Tape but also keep the data on disk >>>>> for fast restores then that would be ideal. The Tapes will be kept >>>>> offsite. I only want to use the Tape for restores in the event that >>>>> a restore from Disk fails or if I need to rebuilt my site at a >>>>> alternate location. It seems your solution is a step in the right >>>>> direction only I need to keep the data on Disk as well. Do you know >>>>> if that's possible without having to do a separate backup to Tape of >>>>> the same data? >>>>> -Clyde >>>>> >>>>> On 6/26/07, *Peter Eisch* <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> >>>>> wrote: >>>>> >>>>> >>>>> Hi Clyde, >>>>> >>>>> In your pool definition include the key (Next Pool) with the right >>>>> value: >>>>> >>>>> Pool { >>>>> Name = host >>>>> Use Volume Once = yes >>>>> Pool Type = Backup >>>>> Auto Prune = yes >>>>> Volume Retention = 13 days >>>>> Label Format = host- >>>>> Maximum Volumes = 15 >>>>> Recycle = yes >>>>> Storage = hostFiles >>>>> Next Pool = DSI-Tape >>>>> } >>>>> >>>>> Pool { >>>>> Name = DSI-Tape >>>>> Pool Type = Backup >>>>> Recycle = yes >>>>> AutoPrune = yes >>>>> Volume Retention = 31 days # rotate tapes monthly >>>>> Storage = TL2000 >>>>> } >>>>> >>>>> Then create a job to do the migration. Below is an example. Take &
Re: [Bacula-users] Copying backups from Disk to Tape
BTW, thanks for the responses! On 6/27/07, Clyde O Goffe <[EMAIL PROTECTED]> wrote: OK so I guess the answer is there's no real way to do it all with bacula. You have to use some outside utility which is kindof a nuisance in terms of managing your backups. If bacula had this functionality then I can use bacula can manage it for me and I can look to bacula for a record of everything copied off to tape. With rync and tar I'd have to create a separate system for managing those tapes. The workaround for me is run a separate backup of the same data since I want bacula to manage everything. This adds more stress to my clients but if this were implemented I'd only have to worry about stressing my storage agents because its just a copy of the data from one medium to another. I've used other enterprise level backup/recovery solutions and they all seem to have this functionality implemented as having multiple copies of the same data stored in multiple places is an essential part of any Disaster Recovery Plan. I would definitely commit resources to the development of this feature. -Clyde On 6/27/07, Brian Debelius <[EMAIL PROTECTED]> wrote: > > Pool Type = This directive defines the pool type, which > corresponds > to the type of Job being run. It is required and may be one of > the following: > Backup > *Archive > *Cloned > *Migration > *Copy > *Save > *Note, only Backup is current implemented. > > I knew I saw it somewhere. But it does say its not implemented. > > > Arno Lehmann wrote: > > Hi, > > > > 27.06.2007 00:26,, Brian Debelius wrote:: > > > >> But its in the docs. :) > >> > > > > Where? :-) > > > > I guess this is a problem with terminology - What is called "cloning" > > in the manual, and what you refer to, is probably this (Director > > configuration, Job resource): > > > >> Run = > >> The Run directive (not to be confused with the Run option in a > Schedule) allows you to start other jobs or to clone jobs. > >> > > > > This does not refer to actual job data cloning, but to the feature > > that jobs can start other jobs. > > > > Not quite what Clyde wants... > > > > Arno > > > > > >> Arno Lehmann wrote: > >> > >>> Hi, > >>> > >>> 26.06.2007 23:21,, Brian Debelius wrote:: > >>> > >>> > >>>> You want what is called cloning. I'm not sure if it has been fully > > >>>> implemented yet. I would like to do that also. > >>>> > >>>> > >>> No, that's not implemented. I would even say that's not even been > >>> started to be implemented. > >>> > >>> Arno > >>> > >>> > >>> > >>>> brian- > >>>> > >>>> Clyde O Goffe wrote: > >>>> > >>>> > >>>>> Hey Peter, > >>>>> > >>>>> Thanks for your reply. I'm not sure if this is what I want > though. > >>>>> If I could migrate the data to Tape but also keep the data on disk > >>>>> for fast restores then that would be ideal. The Tapes will be > kept > >>>>> offsite. I only want to use the Tape for restores in the event > that > >>>>> a restore from Disk fails or if I need to rebuilt my site at a > >>>>> alternate location. It seems your solution is a step in the right > > >>>>> direction only I need to keep the data on Disk as well. Do you > know > >>>>> if that's possible without having to do a separate backup to Tape > of > >>>>> the same data? > >>>>> -Clyde > >>>>> > >>>>> On 6/26/07, *Peter Eisch* <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> > >>>>> wrote: > >>>>> > >>>>> > >>>>> Hi Clyde, > >>>>> > >>>>> In your pool definition include the key (Next Pool) with the > right > >>>>> value: > >>>>> > >>>>> Pool { > >>>>> Name = host > >>>>> Use Volume Once = yes > >>>>> Pool Type = Backup > >>>>> Auto Prune = yes > >>>>> Volume Retention = 13 days > >>>>> Label Format = host- > >>>>> Maximum Volumes = 15 > >>>>> Recycle = yes >
[Bacula-users] How different pools affect Backup Levels
Hey All, I have 2 different pools. One for Differentials and one for Fulls. If I backup a full set to my Fulls pool and then backup changes to my Differentials pool will the first backup to the Differentials pool automatically convert to a full because the previous full wasn't apart of that pool? Thanks for your help! -Clyde - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Conditional statements in FileSets
Hey All, Is it possible to have conditional statements within your FileSet definitions? I'd like to backup or not backup a certain file depending on the Backup Level. I know this might be a stretch. Any ideas? Thanks. -Clyde - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Conditional statements in FileSets
Hey Arno, Thanks, something like this is exactly what I was looking for. -Clyde On 6/28/07, Arno Lehmann <[EMAIL PROTECTED]> wrote: Hi, 28.06.2007 22:13,, Clyde O Goffe wrote:: > Hey All, > > Is it possible to have conditional statements within your FileSet > definitions? I'd like to backup or not backup a certain file depending > on the Backup Level. I know this might be a stretch. Any ideas? Thanks. Without trying this, I think the way to go is to use a script to generate the file list. Probably on the client, but as long as your file list is static, you could also do this on the server. You have to make sure you don't include things multiple times, like /etc /etc/apache and so on. Arno > -Clyde > > > > > - > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > > > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula/Open files
Hey, Does anyone have an idea of how Bacula handles open files on Linux and Windows Systems but especially Linux. I haven't been able to find any documentation on this so if you can point me to some that would be great. Thanks. Regards, Clyde Goffe - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula/Open files
No actually I meant if a file is already open and in use(i.e. being read or updated) will Bacula complain when it tries to back it up. If Bacula does not handle this by default can it be made to. I'm evaluating Bacula for my organization and that's one of the key things we're looking for. Thanks, Clyde On Nov 12, 2007 11:00 AM, Dan Langille <[EMAIL PROTECTED]> wrote: > > On 12 Nov 2007 at 10:40, Clyde O Goffe wrote: > > > Does anyone have an idea of how Bacula handles open files on Linux and > > Windows Systems but especially Linux. I haven't been able to find any > > documentation on this so if you can point me to some that would be > > great. Thanks. > > Can you be more specific as to what you are looking for? > > I think you mean: does it open then read-only? exclusive? Is that > what you are looking for? > > -- > Dan Langille - http://www.langille.org/ > Available for hire: http://www.freebsddiary.org/dan_langille.php > > > - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula/Open files
Great. Do you know if Bacula can be made to take advantage of VSS on Windows? -Clyde On Nov 12, 2007 11:25 AM, John Drescher <[EMAIL PROTECTED]> wrote: > On Nov 12, 2007 11:06 AM, Clyde O Goffe <[EMAIL PROTECTED]> wrote: > > No actually I meant if a file is already open and in use(i.e. being > > read or updated) will Bacula complain when it tries to back it up. If > > Bacula does not handle this by default can it be made to. I'm > > evaluating Bacula for my organization and that's one of the key things > > we're looking for. > > > On linux the os does not prevent reading of in use files so bacula > will back them up. > John > - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula/Open files
Hey I want to thank you guys for the info. It was very helpful. -Clyde On Nov 12, 2007 1:00 PM, Dan Langille <[EMAIL PROTECTED]> wrote: > On 12 Nov 2007 at 9:48, Jason Martin wrote: > > > On Mon, Nov 12, 2007 at 12:37:01PM -0500, Dan Langille wrote: > > > If you are backing up databases or other data files which may be in > > > use, best practice is to dump the data to an ASCII file, then backup > > > the file. > > I'd suggest that it would be better to follow whatever procedure > > is proscribed by the DBMS documentation :> This would be a very > > poor way to back up Oracle, for example. > > Why is this a very poor way to back up Oracle? > > -- > Dan Langille - http://www.langille.org/ > Available for hire: http://www.freebsddiary.org/dan_langille.php > > > > - > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a browser. > Download your FREE copy of Splunk now >> http://get.splunk.com/ > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users