[Bacula-users] Copying backups from Disk to Tape

2007-06-26 Thread Clyde O Goffe

Hello Everyone,

I'm interested in knowing if there is a feature that allows you to
automatically send a copy of a backup to disk off to tape for offsite
storage.  I'm trying not to have to run two separate backups of the same
server but instead just run one backup and then have it copied off to tape.
Also this way I know that the same data that's on disk is also on tape.  Any
suggestions?

-Clyde
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Copying backups from Disk to Tape

2007-06-26 Thread Clyde O Goffe

Thanks in advanced!

On 6/26/07, Clyde O Goffe <[EMAIL PROTECTED]> wrote:


Hello Everyone,

I'm interested in knowing if there is a feature that allows you to
automatically send a copy of a backup to disk off to tape for offsite
storage.  I'm trying not to have to run two separate backups of the same
server but instead just run one backup and then have it copied off to tape.
Also this way I know that the same data that's on disk is also on tape.  Any
suggestions?

-Clyde

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Copying backups from Disk to Tape

2007-06-26 Thread Clyde O Goffe

Hey Peter,

Thanks for your reply.  I'm not sure if this is what I want though.  If I
could migrate the data to Tape but also keep the data on disk for fast
restores then that would be ideal.  The Tapes will be kept offsite.  I only
want to use the Tape for restores in the event that a restore from Disk
fails or if I need to rebuilt my site at a alternate location.  It seems
your solution is a step in the right direction only I need to keep the data
on Disk as well.  Do you know if that's possible without having to do a
separate backup to Tape of the same data?

-Clyde

On 6/26/07, Peter Eisch <[EMAIL PROTECTED]> wrote:



Hi Clyde,

In your pool definition include the key (Next Pool) with the right value:

Pool {
  Name = host
  Use Volume Once = yes
  Pool Type = Backup
  Auto Prune = yes
  Volume Retention = 13 days
  Label Format = host-
  Maximum Volumes = 15
  Recycle = yes
  Storage = hostFiles
  Next Pool = DSI-Tape
}

Pool {
  Name = DSI-Tape
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 31 days # rotate tapes monthly
  Storage = TL2000
}


Then create a job to do the migration.  Below is an example.  Take care to
note that I name my pools (separate pool for each host) the same name as the
host.   Then replace the named 'host'  with the client's name.  Also note
the bacula server is named ''.  :


Job {
  Name = "host-migrate"
  Type = Migrate
  Level = Full
  Client = -fd
  Write Bootstrap = "/u1/bacula/working/host-migrate.bsr"
  FileSet = "Host Set"
  Schedule = "MigrateCycle"
  Messages = Standard
  Pool = host
  Selection Type = Volume
  Selection Pattern = ".*"
  Priority = 12
}

The Migrate cycle, at my site, fires off on Thursday nights so the tape
can be rotated on Friday.  In the Migrate job, you could change what's
written to tape to be a subset of  what was written in the disk backup by
manipulating the FileSet.  The Migrate job draw from the Pool using the
bacula-server's FD.

Does this help?  Hopefully between the on-line manual and my example you
can find a solution.

NB: once the backup has been migrated, you can no longer use the disk copy
of the backup in the event you need to restore.  If you restart the sd
between migrate jobs (like a system reboot or add/change to the sd.conf)
the next migrate will fail appending to the current tape.  It's for these
two reasons that I only migrate weekly.

peter



On 6/26/07 1:58 PM, "Clyde O Goffe" <[EMAIL PROTECTED]> wrote:

Thanks in advanced!

On 6/26/07, *Clyde O Goffe* <[EMAIL PROTECTED]> wrote:

Hello Everyone,

I'm interested in knowing if there is a feature that allows you to
automatically send a copy of a backup to disk off to tape for offsite
storage.  I'm trying not to have to run two separate backups of the same
server but instead just run one backup and then have it copied off to tape.
 Also this way I know that the same data that's on disk is also on tape.
 Any suggestions?

-Clyde



--
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Copying backups from Disk to Tape

2007-06-27 Thread Clyde O Goffe

OK so I guess the answer is there's no real way to do it all with bacula.
You have to use some outside utility which is kindof a nuisance in terms of
managing your backups.  If bacula had this functionality then I can use
bacula can manage it for me and I can look to bacula for a record of
everything copied off to tape.  With rync and tar I'd have to create a
separate system for managing those tapes.

The workaround for me is run a separate backup of the same data since I want
bacula to manage everything.  This adds more stress to my clients but if
this were implemented I'd only have to worry about stressing my storage
agents because its just a copy of the data from one medium to another.

I've used other enterprise level backup/recovery solutions and they all seem
to have this functionality implemented as having multiple copies of the same
data stored in multiple places is an essential part of any Disaster Recovery
Plan.  I would definitely commit resources to the development of this
feature.

-Clyde

On 6/27/07, Brian Debelius <[EMAIL PROTECTED]> wrote:


Pool Type =  This directive defines the pool type, which corresponds
to the type of Job being run. It is required and may be one of
the following:
Backup
*Archive
*Cloned
*Migration
*Copy
*Save
*Note, only Backup is current implemented.

I knew I saw it somewhere.  But it does say its not implemented.


Arno Lehmann wrote:
> Hi,
>
> 27.06.2007 00:26,, Brian Debelius wrote::
>
>> But its in the docs. :)
>>
>
> Where? :-)
>
> I guess this is a problem with terminology - What is called "cloning"
> in the manual, and what you refer to, is probably this (Director
> configuration, Job resource):
>
>> Run = 
>> The Run directive (not to be confused with the Run option in a
Schedule) allows you to start other jobs or to clone jobs.
>>
>
> This does not refer to actual job data cloning, but to the feature
> that jobs can start other jobs.
>
> Not quite what Clyde wants...
>
> Arno
>
>
>> Arno Lehmann wrote:
>>
>>> Hi,
>>>
>>> 26.06.2007 23:21,, Brian Debelius wrote::
>>>
>>>
>>>> You want what is called cloning.  I'm not sure if it has been fully
>>>> implemented yet.  I would like to do that also.
>>>>
>>>>
>>> No, that's not implemented. I would even say that's not even been
>>> started to be implemented.
>>>
>>> Arno
>>>
>>>
>>>
>>>> brian-
>>>>
>>>> Clyde O Goffe wrote:
>>>>
>>>>
>>>>> Hey Peter,
>>>>>
>>>>> Thanks for your reply.  I'm not sure if this is what I want though.
>>>>> If I could migrate the data to Tape but also keep the data on disk
>>>>> for fast restores then that would be ideal.  The Tapes will be kept
>>>>> offsite.  I only want to use the Tape for restores in the event that
>>>>> a restore from Disk fails or if I need to rebuilt my site at a
>>>>> alternate location.  It seems your solution is a step in the right
>>>>> direction only I need to keep the data on Disk as well.  Do you know
>>>>> if that's possible without having to do a separate backup to Tape of
>>>>> the same data?
>>>>> -Clyde
>>>>>
>>>>> On 6/26/07, *Peter Eisch* <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
>>>>> wrote:
>>>>>
>>>>>
>>>>> Hi Clyde,
>>>>>
>>>>> In your pool definition include the key (Next Pool) with the
right
>>>>> value:
>>>>>
>>>>> Pool {
>>>>>   Name = host
>>>>>   Use Volume Once = yes
>>>>>   Pool Type = Backup
>>>>>   Auto Prune = yes
>>>>>   Volume Retention = 13 days
>>>>>   Label Format = host-
>>>>>   Maximum Volumes = 15
>>>>>   Recycle = yes
>>>>>   Storage = hostFiles
>>>>>   Next Pool = DSI-Tape
>>>>> }
>>>>>
>>>>> Pool {
>>>>>   Name = DSI-Tape
>>>>>   Pool Type = Backup
>>>>>   Recycle = yes
>>>>>   AutoPrune = yes
>>>>>   Volume Retention = 31 days # rotate tapes monthly
>>>>>   Storage = TL2000
>>>>> }
>>>>>
>>>>> Then create a job to do the migration.  Below is an
example.  Take
&

Re: [Bacula-users] Copying backups from Disk to Tape

2007-06-27 Thread Clyde O Goffe

BTW, thanks for the responses!



On 6/27/07, Clyde O Goffe <[EMAIL PROTECTED]> wrote:


OK so I guess the answer is there's no real way to do it all with bacula.
You have to use some outside utility which is kindof a nuisance in terms of
managing your backups.  If bacula had this functionality then I can use
bacula can manage it for me and I can look to bacula for a record of
everything copied off to tape.  With rync and tar I'd have to create a
separate system for managing those tapes.

The workaround for me is run a separate backup of the same data since I
want bacula to manage everything.  This adds more stress to my clients but
if this were implemented I'd only have to worry about stressing my storage
agents because its just a copy of the data from one medium to another.

I've used other enterprise level backup/recovery solutions and they all
seem to have this functionality implemented as having multiple copies of the
same data stored in multiple places is an essential part of any Disaster
Recovery Plan.  I would definitely commit resources to the development of
this feature.

-Clyde

On 6/27/07, Brian Debelius <[EMAIL PROTECTED]> wrote:
>
> Pool Type =  This directive defines the pool type, which
> corresponds
> to the type of Job being run. It is required and may be one of
> the following:
> Backup
> *Archive
> *Cloned
> *Migration
> *Copy
> *Save
> *Note, only Backup is current implemented.
>
> I knew I saw it somewhere.  But it does say its not implemented.
>
>
> Arno Lehmann wrote:
> > Hi,
> >
> > 27.06.2007 00:26,, Brian Debelius wrote::
> >
> >> But its in the docs. :)
> >>
> >
> > Where? :-)
> >
> > I guess this is a problem with terminology - What is called "cloning"
> > in the manual, and what you refer to, is probably this (Director
> > configuration, Job resource):
> >
> >> Run = 
> >> The Run directive (not to be confused with the Run option in a
> Schedule) allows you to start other jobs or to clone jobs.
> >>
> >
> > This does not refer to actual job data cloning, but to the feature
> > that jobs can start other jobs.
> >
> > Not quite what Clyde wants...
> >
> > Arno
> >
> >
> >> Arno Lehmann wrote:
> >>
> >>> Hi,
> >>>
> >>> 26.06.2007 23:21,, Brian Debelius wrote::
> >>>
> >>>
> >>>> You want what is called cloning.  I'm not sure if it has been fully
>
> >>>> implemented yet.  I would like to do that also.
> >>>>
> >>>>
> >>> No, that's not implemented. I would even say that's not even been
> >>> started to be implemented.
> >>>
> >>> Arno
> >>>
> >>>
> >>>
> >>>> brian-
> >>>>
> >>>> Clyde O Goffe wrote:
> >>>>
> >>>>
> >>>>> Hey Peter,
> >>>>>
> >>>>> Thanks for your reply.  I'm not sure if this is what I want
> though.
> >>>>> If I could migrate the data to Tape but also keep the data on disk
> >>>>> for fast restores then that would be ideal.  The Tapes will be
> kept
> >>>>> offsite.  I only want to use the Tape for restores in the event
> that
> >>>>> a restore from Disk fails or if I need to rebuilt my site at a
> >>>>> alternate location.  It seems your solution is a step in the right
>
> >>>>> direction only I need to keep the data on Disk as well.  Do you
> know
> >>>>> if that's possible without having to do a separate backup to Tape
> of
> >>>>> the same data?
> >>>>> -Clyde
> >>>>>
> >>>>> On 6/26/07, *Peter Eisch* <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> >>>>> wrote:
> >>>>>
> >>>>>
> >>>>> Hi Clyde,
> >>>>>
> >>>>> In your pool definition include the key (Next Pool) with the
> right
> >>>>> value:
> >>>>>
> >>>>> Pool {
> >>>>>   Name = host
> >>>>>   Use Volume Once = yes
> >>>>>   Pool Type = Backup
> >>>>>   Auto Prune = yes
> >>>>>   Volume Retention = 13 days
> >>>>>   Label Format = host-
> >>>>>   Maximum Volumes = 15
> >>>>>   Recycle = yes
> 

[Bacula-users] How different pools affect Backup Levels

2007-06-28 Thread Clyde O Goffe

Hey All,

I have 2 different pools.  One for Differentials and one for Fulls.  If I
backup a full set to my Fulls pool and then backup changes to my
Differentials pool will the first backup to the Differentials pool
automatically convert to a full because the previous full wasn't apart of
that pool?  Thanks for your help!

-Clyde
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Conditional statements in FileSets

2007-06-28 Thread Clyde O Goffe

Hey All,

Is it possible to have conditional statements within your FileSet
definitions?  I'd like to backup or not backup a certain file depending on
the Backup Level.  I know this might be a stretch.  Any ideas?  Thanks.

-Clyde
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Conditional statements in FileSets

2007-06-28 Thread Clyde O Goffe

Hey Arno,

Thanks, something like this is exactly what I was looking for.

-Clyde

On 6/28/07, Arno Lehmann <[EMAIL PROTECTED]> wrote:


Hi,

28.06.2007 22:13,, Clyde O Goffe wrote::
> Hey All,
>
> Is it possible to have conditional statements within your FileSet
> definitions?  I'd like to backup or not backup a certain file depending
> on the Backup Level.  I know this might be a stretch.  Any
ideas?  Thanks.

Without trying this, I think the way to go is to use a script to
generate the file list. Probably on the client, but as long as your
file list is static, you could also do this on the server.

You have to make sure you don't include things multiple times, like
/etc
/etc/apache
and so on.

Arno

> -Clyde
>
>
> 
>
>
-
> This SF.net email is sponsored by DB2 Express
> Download DB2 Express C - the FREE version of DB2 express and take
> control of your XML. No limits. Just data. Click to get it now.
> http://sourceforge.net/powerbar/db2/
>
>
> 
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula/Open files

2007-11-12 Thread Clyde O Goffe
Hey,

Does anyone have an idea of how Bacula handles open files on Linux and
Windows Systems but especially Linux.  I haven't been able to find any
documentation on this so if you can point me to some that would be
great.  Thanks.

Regards,

Clyde Goffe

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula/Open files

2007-11-12 Thread Clyde O Goffe
No actually I meant if a file is already open and in use(i.e. being
read or updated) will Bacula complain when it tries to back it up.  If
Bacula does not handle this by default can it be made to.  I'm
evaluating Bacula for my organization and that's one of the key things
we're looking for.

Thanks,

Clyde

On Nov 12, 2007 11:00 AM, Dan Langille <[EMAIL PROTECTED]> wrote:
>
> On 12 Nov 2007 at 10:40, Clyde O Goffe wrote:
>
> > Does anyone have an idea of how Bacula handles open files on Linux and
> > Windows Systems but especially Linux.  I haven't been able to find any
> > documentation on this so if you can point me to some that would be
> > great.  Thanks.
>
> Can you be more specific as to what you are looking for?
>
> I think you mean: does it open then read-only?  exclusive?  Is that
> what you are looking for?
>
> --
> Dan Langille - http://www.langille.org/
> Available for hire: http://www.freebsddiary.org/dan_langille.php
>
>
>

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula/Open files

2007-11-12 Thread Clyde O Goffe
Great.  Do you know if Bacula can be made to take advantage of VSS on Windows?

-Clyde

On Nov 12, 2007 11:25 AM, John Drescher <[EMAIL PROTECTED]> wrote:
> On Nov 12, 2007 11:06 AM, Clyde O Goffe <[EMAIL PROTECTED]> wrote:
> > No actually I meant if a file is already open and in use(i.e. being
> > read or updated) will Bacula complain when it tries to back it up.  If
> > Bacula does not handle this by default can it be made to.  I'm
> > evaluating Bacula for my organization and that's one of the key things
> > we're looking for.
> >
> On linux the os does not prevent reading of in use files so bacula
> will back them up.
> John
>

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula/Open files

2007-11-12 Thread Clyde O Goffe
Hey I want to thank you guys for the info.  It was very helpful.

-Clyde

On Nov 12, 2007 1:00 PM, Dan Langille <[EMAIL PROTECTED]> wrote:
> On 12 Nov 2007 at 9:48, Jason Martin wrote:
>
> > On Mon, Nov 12, 2007 at 12:37:01PM -0500, Dan Langille wrote:
> > > If you are backing up databases or other data files which may be in
> > > use, best practice is to dump the data to an ASCII file, then backup
> > > the file.
> > I'd suggest that it would be better to follow whatever procedure
> > is proscribed by the DBMS documentation :> This would be a very
> > poor way to back up Oracle, for example.
>
> Why is this a very poor way to back up Oracle?
>
> --
> Dan Langille - http://www.langille.org/
> Available for hire: http://www.freebsddiary.org/dan_langille.php
>
>
>
> -
> This SF.net email is sponsored by: Splunk Inc.
> Still grepping through log files to find problems?  Stop.
> Now Search log events and configuration files using AJAX and a browser.
> Download your FREE copy of Splunk now >> http://get.splunk.com/
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users