[Bacula-users] Job vs volume retention periods

2009-06-24 Thread phatrik

Hi,

I'm confused in regards to job retention vs volume retention.  From the little 
bit I understand, if the volume retention period is passed and bacula is unable 
to find any other appendable volumes in the client's stoarge pool, it will 
delete all file and job records and then re-use that volume.  However, how 
about if all the jobs in that volume have been pruned but the volume retention 
period hasn't passed yet (and of course recycling is enabled) Will bacula still 
re-use the volume since no more jobs remained after they've all been pruned?  
If it does, what's the purpose of having a volume retention period which is 
usually without a doubt longer than the job retention period?  If it doesn't, 
what's the point of keeping a volume which doesn't contain jobIDs which can't 
be restored anymore?  


thanks in advance,



Erik

+--
|This was sent by erik.go...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Job vs volume retention periods

2009-06-24 Thread Fahrer, Julian
Hi Erik,

volumes will only be reused after the volume retention period is reached.
And the point of keeping a volume which doesn't contain jobIDs is that you 
could import the tape or recover data from it using btape since it still 
contains all files.

Kind regards

Julian


-Ursprüngliche Nachricht-
Von: phatrik [mailto:bacula-fo...@backupcentral.com] 
Gesendet: Mittwoch, 24. Juni 2009 03:46
An: bacula-users@lists.sourceforge.net
Betreff: [Bacula-users] Job vs volume retention periods


Hi,

I'm confused in regards to job retention vs volume retention.  From the little 
bit I understand, if the volume retention period is passed and bacula is unable 
to find any other appendable volumes in the client's stoarge pool, it will 
delete all file and job records and then re-use that volume.  However, how 
about if all the jobs in that volume have been pruned but the volume retention 
period hasn't passed yet (and of course recycling is enabled) Will bacula still 
re-use the volume since no more jobs remained after they've all been pruned?  
If it does, what's the purpose of having a volume retention period which is 
usually without a doubt longer than the job retention period?  If it doesn't, 
what's the point of keeping a volume which doesn't contain jobIDs which can't 
be restored anymore?  


thanks in advance,



Erik

+--
|This was sent by erik.go...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Job vs volume retention periods

2009-06-24 Thread Dirk Bartley
On Wed, 2009-06-24 at 09:14 +0200, Fahrer, Julian wrote:
 Hi Erik,
 
 volumes will only be reused after the volume retention period is reached.
 And the point of keeping a volume which doesn't contain jobIDs is that you 
 could import the tape or recover data from it using btape since it still 
 contains all files.

Greetings

Julian is correct with exceptions.

  Recycle Oldest Volume = yes
  Recycle Current Volume = yes
  PurgeOldestVolume = yes

Warning, the following description may not be perfect:

I use recycle oldest and purge oldest.  This way, the job records can be
maintained in the catalog with an unresonably long job retention period.
When the director completes jobs, it will still perform pruning
operations pruning file records.

Then when the director goes to schedule a job, it will purge job records
from the volume and label it recycled if all jobs have had their file
records pruned.  The volume chosen to recyle will be the one that has
not been written to for the longest period.

The status dir will show the recycled volume as the volume scheduled to
use.

For instance, I have a pool with two tapes for Tuesday and Thursday.  I
want to use it four times then have it schedule using the othe tape
rotating every two weeks.

Pool {
  Name = LTO_TueThu
  Pool Type = Backup
  Recycle = yes   
  AutoPrune = yes   
  Volume Retention = 16 Days 
  Volume Use Duration = 10 Days 
  Recycle Oldest Volume = yes
  PurgeOldestVolume = yes
  Storage = LTO
}


Set it up recently and it seems to work so far.  Best of luck.  The
documentation is awesome because there are so many possible parameters.
The one thing that may be missing is more recipes from current users.

Dirk

 
 Kind regards
 
 Julian
 
 
 -Ursprüngliche Nachricht-
 Von: phatrik [mailto:bacula-fo...@backupcentral.com] 
 Gesendet: Mittwoch, 24. Juni 2009 03:46
 An: bacula-users@lists.sourceforge.net
 Betreff: [Bacula-users] Job vs volume retention periods
 
 
 Hi,
 
 I'm confused in regards to job retention vs volume retention.  From the 
 little bit I understand, if the volume retention period is passed and bacula 
 is unable to find any other appendable volumes in the client's stoarge pool, 
 it will delete all file and job records and then re-use that volume.  
 However, how about if all the jobs in that volume have been pruned but the 
 volume retention period hasn't passed yet (and of course recycling is 
 enabled) Will bacula still re-use the volume since no more jobs remained 
 after they've all been pruned?  If it does, what's the purpose of having a 
 volume retention period which is usually without a doubt longer than the job 
 retention period?  If it doesn't, what's the point of keeping a volume which 
 doesn't contain jobIDs which can't be restored anymore?  
 
 
 thanks in advance,
 
 
 
 Erik
 
 +--
 |This was sent by erik.go...@gmail.com via Backup Central.
 |Forward SPAM to ab...@backupcentral.com.
 +--
 
 
 
 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 
 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Job vs volume retention periods

2009-06-24 Thread phatrik


Dirk Bartley wrote:
 On Wed, 2009-06-24 at 09:14 +0200, Fahrer, Julian wrote:
 
  Hi Erik,
  
  volumes will only be reused after the volume retention period is reached.
  And the point of keeping a volume which doesn't contain jobIDs is that you 
  could import the tape or recover data from it using btape since it still 
  contains all files.
  
 
 Greetings
 
 Julian is correct with exceptions.
 
 Recycle Oldest Volume = yes
 Recycle Current Volume = yes
 PurgeOldestVolume = yes
 
 Warning, the following description may not be perfect:
 
 I use recycle oldest and purge oldest.  This way, the job records can be
 maintained in the catalog with an unresonably long job retention period.
 When the director completes jobs, it will still perform pruning
 operations pruning file records.
 
 Then when the director goes to schedule a job, it will purge job records
 from the volume and label it recycled if all jobs have had their file
 records pruned.  The volume chosen to recyle will be the one that has
 not been written to for the longest period.
 
 The status dir will show the recycled volume as the volume scheduled to
 use.
 
 For instance, I have a pool with two tapes for Tuesday and Thursday.  I
 want to use it four times then have it schedule using the othe tape
 rotating every two weeks.
 
 Pool {
 Name = LTO_TueThu
 Pool Type = Backup
 Recycle = yes   
 AutoPrune = yes   
 Volume Retention = 16 Days 
 Volume Use Duration = 10 Days 
 Recycle Oldest Volume = yes
 PurgeOldestVolume = yes
 Storage = LTO
 }
 
 
 Set it up recently and it seems to work so far.  Best of luck.  The
 documentation is awesome because there are so many possible parameters.
 The one thing that may be missing is more recipes from current users.
 
 Dirk
 
 
  
  Kind regards
  
  Julian
  
  
  -Ursprüngliche Nachricht-
  Von: phatrik [mailto:bacula-forum  at  backupcentral.com] 
  Gesendet: Mittwoch, 24. Juni 2009 03:46
  An: bacula-users  at  lists.sourceforge.net
  Betreff: [Bacula-users] Job vs volume retention periods
  
  
  Hi,
  
  I'm confused in regards to job retention vs volume retention.  From the 
  little bit I understand, if the volume retention period is passed and 
  bacula is unable to find any other appendable volumes in the client's 
  stoarge pool, it will delete all file and job records and then re-use that 
  volume.  However, how about if all the jobs in that volume have been pruned 
  but the volume retention period hasn't passed yet (and of course recycling 
  is enabled) Will bacula still re-use the volume since no more jobs remained 
  after they've all been pruned?  If it does, what's the purpose of having a 
  volume retention period which is usually without a doubt longer than the 
  job retention period?  If it doesn't, what's the point of keeping a volume 
  which doesn't contain jobIDs which can't be restored anymore?  
  
  
  thanks in advance,
  
  
  
  Erik
  
  +--
  |This was sent by erik.godin  at  gmail.com via Backup Central.
  |Forward SPAM to abuse  at  backupcentral.com.
  +--
  
  
  
  --
  ___
  Bacula-users mailing list
  Bacula-users  at  lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
  
  --
  ___
  Bacula-users mailing list
  Bacula-users  at  lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
  
 
 
 --
 ___
 Bacula-users mailing list
 Bacula-users  at  lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users









Hi,


Thanks for the help provided so far, it's very much appreciated.   I do have a 
few follow-up questions:


In a case where the client's storage pool would of reached it's maximum volume 
limit (I use this combined with maximum volume bytes to control the size of 
their allocated storage pools) and recycle oldest volume would be equal to 
yes... If all the jobs have already passed their retention period, bacula would 
recycle the oldest volume regardless of the volume retention period, is this 
correct (on what date is this based btw, the date of the last written job?)  
And that, as long as the volume wasn't recycled/overwritten, there's always 
possibility to use bscan, re-write the catalogue and restore file-by-file?  In 
a case where the file records have expired but not the job records, can I 
simply decide to restore an entire jobid instead of using bscan?  How about 
when a volume is purged?  My understanding is, files can still be recovered, 
however

Re: [Bacula-users] Job vs volume retention periods

2009-06-24 Thread Dirk Bartley

 
 Thanks for the help provided so far, it's very much appreciated.   I do have 
 a few follow-up questions:
 
 
 In a case where the client's storage pool

Pools don't belong to a client unless you set up the directors schedules
that way and don't run any manually to the pool.

  would of reached it's maximum volume limit (I use this combined with maximum 
 volume bytes to control the size of their allocated storage pools) and 
 recycle oldest volume would be equal to yes... If all the jobs have already 
 passed their retention period, bacula would recycle the oldest volume

if recycle oldest is set yes.  If you also set purge oldest, then it
will purge the jobs as well

  regardless of the volume retention period, 

recycle oldest respects retention of files and jobs.

 is this correct (on what date is this based btw, the date of the last written 
 job?)

I think first written, not totally sure

   And that, as long as the volume wasn't recycled/overwritten, there's always 
 possibility to use bscan, re-write the catalogue and restore file-by-file?  
 In a case where the file records have expired but not the job records, can I 
 simply decide to restore an entire jobid instead of using bscan?

yes, restoring the entire job is always an option if the job record
exists with purged files.

   How about when a volume is purged?

If the volume is purged, then there will be no knowledge of the job or
where it is on the tape, so bscan would be required.

   My understanding is, files can still be recovered, however in this case I'm 
 presuming using bscan isn't optional?

bscan required is my understanding.

Dirk

 
 
 I think this should be the last of my question :)

Bacula is pretty flexible.  I had to read the pool directives, try some
stuff for a bit, then read it again to fully appreciate what it took to
get the results I wanted.  Heck, I'm still not sure if I'm quite there
yet.

 
 
 Thanks in advance,
 
 
 
 Erik



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users