Re: [Bacula-users] Using removable SATA disks as media

2010-05-20 Thread Joseph Spenner
--- On Wed, 4/14/10, Phil Stracchino ala...@metrocast.net wrote:

 
 Once purged, you can either let Bacula recycle them itself,
 or you can
 use the Update Volume command to manually change the volume
 status to
 Recycle.  This is a particularly straightforward
 operation if you are
 using BAT, since you can do it on all the volumes at once.
 

I think I have my volumes set wrong.  I had an error today after every volume 
finally had been used at least once:

==
20-May 02:05 bacula-va-sd JobId 75: Job Bacula_Server.2010-05-20_01.05.00_02 is 
waiting. Cannot find any appendable volumes.
Please use the label command to create a new Volume for:
Storage:  FileStorage (/opt/bacula/volumes)
Pool: File
Media type:   File
==

I thought I fixed this, but apparently not.  How should the Volume Status be 
set in order to cycle through volumes and start over after the last one is 
used?  When the above failure occurred, all my Volume Status's were Used.




  

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-05-20 Thread John Drescher
On Thu, May 20, 2010 at 10:53 AM, Joseph Spenner joseph85...@yahoo.com wrote:
 --- On Wed, 4/14/10, Phil Stracchino ala...@metrocast.net wrote:


 Once purged, you can either let Bacula recycle them itself,
 or you can
 use the Update Volume command to manually change the volume
 status to
 Recycle.  This is a particularly straightforward
 operation if you are
 using BAT, since you can do it on all the volumes at once.


 I think I have my volumes set wrong.  I had an error today after every volume 
 finally had been used at least once:

 ==
 20-May 02:05 bacula-va-sd JobId 75: Job Bacula_Server.2010-05-20_01.05.00_02 
 is
 waiting. Cannot find any appendable volumes.
 Please use the label command to create a new Volume for:
    Storage:      FileStorage (/opt/bacula/volumes)
    Pool:         File
    Media type:   File
 ==

 I thought I fixed this, but apparently not.  How should the Volume Status be 
 set in order to cycle through volumes and start over after the last one is 
 used?  When the above failure occurred, all my Volume Status's were Used.


All of the volume status of Used is good. Next look at the lastwritten
time to see if any of the volumes are available for recycling.

list media pool=File

John

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-05-20 Thread Joseph Spenner
--- On Thu, 5/20/10, John Drescher dresche...@gmail.com wrote:


 
  I thought I fixed this, but apparently not.  How
 should the Volume Status be set in order to cycle through
 volumes and start over after the last one is used?  When
 the above failure occurred, all my Volume Status's were
 Used.
 
 
 All of the volume status of Used is good. Next look at the
 lastwritten
 time to see if any of the volumes are available for
 recycling.
 
 list media pool=File
 

Ok, I purged and set all my volumes to Recycle.  I also added my new 3 volumes 
so now I have 3 sets of 7 instead of 3 sets of 6:


*list media pool=File
+-++---+-+-+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes| VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+-+--+--+-+--+---+---+-+
|   1 | file_0001  | Recycle   |   1 |  11,680 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-20 14:45:06 |
|   2 | file_0002  | Recycle   |   1 |   9,253,254,931 |2 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-20 14:50:48 |
|   3 | file_0003  | Recycle   |   1 | 103,174,447 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-12 06:44:32 |
|   4 | file_0004  | Recycle   |   1 | 301,651,823,407 |   70 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-12 22:30:03 |
|   5 | file_0005  | Recycle   |   1 | 143,252,733 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-12 23:10:26 |
|   6 | file_0006  | Recycle   |   1 |   8,068,070,781 |1 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-13 15:46:13 |
|   7 | file_0007  | Recycle   |   1 |  17,415,085,284 |4 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-13 19:02:48 |
|   8 | file_0008  | Recycle   |   1 |  24,341,622,352 |5 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-13 22:47:36 |
|   9 | file_0009  | Recycle   |   1 | 301,677,627,734 |   70 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-14 06:56:09 |
|  10 | file_0010  | Recycle   |   1 |   1,482,610,438 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-14 06:56:56 |
|  11 | file_0011  | Recycle   |   1 | 297,785,468,267 |   69 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-15 06:14:48 |
|  12 | file_0012  | Recycle   |   1 | 326,827,091 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-15 06:15:21 |
|  13 | file_0013  | Recycle   |   1 | 687,959,903 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-15 23:10:10 |
|  14 | file_0014  | Recycle   |   1 | 700,460,095 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-16 23:10:12 |
|  15 | file_0015  | Recycle   |   1 |   5,408,772,092 |1 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-17 14:02:57 |
|  16 | file_0016  | Recycle   |   1 |  85,692,487 |0 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-17 22:02:59 |
|  17 | file_0017  | Recycle   |   1 |   5,479,213,260 |1 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-18 14:58:46 |
|  18 | file_0018  | Recycle   |   1 |   7,391,498,443 |1 |
1,728,000 |   1 |0 | 0 | File  | 2010-05-19 01:15:46 |
|  19 | file_0019  | Recycle   |   1 |   0 |0 |
1,728,000 |   1 |0 | 0 | File  | -00-00 00:00:00 |
|  20 | file_0020  | Recycle   |   1 |   0 |0 |
1,728,000 |   1 |1 | 0 | File  | -00-00 00:00:00 |
|  21 | file_0021  | Recycle   |   1 |   0 |0 |
1,728,000 |   1 |2 | 0 | File  | -00-00 00:00:00 |
+-++---+-+-+--+--+-+--+---+---+-+
*

We'll see how that works.
Thanks!



  

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-05-20 Thread John Drescher
On Thu, May 20, 2010 at 12:02 PM, Joseph Spenner joseph85...@yahoo.com wrote:
 --- On Thu, 5/20/10, John Drescher dresche...@gmail.com wrote:


 
  I thought I fixed this, but apparently not.  How
 should the Volume Status be set in order to cycle through
 volumes and start over after the last one is used?  When
 the above failure occurred, all my Volume Status's were
 Used.
 

 All of the volume status of Used is good. Next look at the
 lastwritten
 time to see if any of the volumes are available for
 recycling.

 list media pool=File


 Ok, I purged and set all my volumes to Recycle.  I also added my new 3 
 volumes so now I have 3 sets of 7 instead of 3 sets of 6:


 *list media pool=File
 +-++---+-+-+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes        | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten         |
 +-++---+-+-+--+--+-+--+---+---+-+
 |       1 | file_0001  | Recycle   |       1 |          11,680 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-20 14:45:06 |
 |       2 | file_0002  | Recycle   |       1 |   9,253,254,931 |        2 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-20 14:50:48 |
 |       3 | file_0003  | Recycle   |       1 |     103,174,447 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-12 06:44:32 |
 |       4 | file_0004  | Recycle   |       1 | 301,651,823,407 |       70 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-12 22:30:03 |
 |       5 | file_0005  | Recycle   |       1 |     143,252,733 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-12 23:10:26 |
 |       6 | file_0006  | Recycle   |       1 |   8,068,070,781 |        1 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-13 15:46:13 |
 |       7 | file_0007  | Recycle   |       1 |  17,415,085,284 |        4 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-13 19:02:48 |
 |       8 | file_0008  | Recycle   |       1 |  24,341,622,352 |        5 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-13 22:47:36 |
 |       9 | file_0009  | Recycle   |       1 | 301,677,627,734 |       70 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-14 06:56:09 |
 |      10 | file_0010  | Recycle   |       1 |   1,482,610,438 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-14 06:56:56 |
 |      11 | file_0011  | Recycle   |       1 | 297,785,468,267 |       69 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-15 06:14:48 |
 |      12 | file_0012  | Recycle   |       1 |     326,827,091 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-15 06:15:21 |
 |      13 | file_0013  | Recycle   |       1 |     687,959,903 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-15 23:10:10 |
 |      14 | file_0014  | Recycle   |       1 |     700,460,095 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-16 23:10:12 |
 |      15 | file_0015  | Recycle   |       1 |   5,408,772,092 |        1 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-17 14:02:57 |
 |      16 | file_0016  | Recycle   |       1 |      85,692,487 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-17 22:02:59 |
 |      17 | file_0017  | Recycle   |       1 |   5,479,213,260 |        1 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-18 14:58:46 |
 |      18 | file_0018  | Recycle   |       1 |   7,391,498,443 |        1 |   
  1,728,000 |       1 |    0 |         0 | File      | 2010-05-19 01:15:46 |
 |      19 | file_0019  | Recycle   |       1 |               0 |        0 |   
  1,728,000 |       1 |    0 |         0 | File      | -00-00 00:00:00 |
 |      20 | file_0020  | Recycle   |       1 |               0 |        0 |   
  1,728,000 |       1 |    1 |         0 | File      | -00-00 00:00:00 |
 |      21 | file_0021  | Recycle   |       1 |               0 |        0 |   
  1,728,000 |       1 |    2 |         0 | File      | -00-00 00:00:00 |
 +-++---+-+-+--+--+-+--+---+---+-+
 *

 We'll see how that works.
 Thanks!


It looks like the problem was that 5/12/2010 was the oldest volume and
and that is not 20 days ago so it could not have been purged.

John

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net

Re: [Bacula-users] Using removable SATA disks as media

2010-04-22 Thread Ralf Gross
Phil Stracchino schrieb:
  The /usr slice is about 4.8G, and shouldn't be changing-- at least
  not at the tune of 51M every night.
 
 
 Shouldn't is a powerful word.  You might want to test the theory by
 doing something like this:
 
 find /usr /opt/bacula/bin -mtime -1 -ls
 
 to list all files that have been modified in the last 24 hours (or
 -mtime -2 to check the last 48 hours) and see what's changing.  Another
 alternative would be to start up BAT, go to Jobs Run, select job 183,
 right-click, and select List Files On Job; Bacula will tell you
 precisely which files were backed up.  (You can accomplish the same
 thing using bconsole, but it'll require a manual SQL query.)  Then you
 can look at the specific files that you know were backed up, and
 determine why they got backed up.

'list files jobid=xxx' in bconsole will also show all backed up files
for a jobid without a custom sql query.

Ralf

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-22 Thread Joseph Spenner
--- On Thu, 4/22/10, John Drescher dresche...@gmail.com wrote:

 From: John Drescher dresche...@gmail.com
 Subject: Re: [Bacula-users] Using removable SATA disks as media
 To: Joseph Spenner joseph85...@yahoo.com
 Cc: bacula-users@lists.sourceforge.net
 Date: Thursday, April 22, 2010, 4:04 PM
 On Thu, Apr 22, 2010 at 6:03 PM, John
 Drescher dresche...@gmail.com
 wrote:
  I am still testing, using run at the bconsole,
 and selecting:
      2: BackupCatalog
 
  I've run it a few times in one hour, and I see it
 appending the backup to the same volume.  Is this because
 the runs are happening too fast (same cycle)?  The
 setting:
 
   Volume Use Duration = 23h
 
  responsible?
 
 
  Yes. That means use the volume for up to 23 hours.
 
 Slight correction, if a job started before 23 hours was up
 it would
 not switch volumes because of time.
 
 John
 

Ok, I just need to come up with a reasonable value.  My backups will never take 
more than 10 hours.

Thanks!



  

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-22 Thread Joseph Spenner
--- On Thu, 4/22/10, Phil Stracchino ala...@metrocast.net wrote:

 From: Phil Stracchino ala...@metrocast.net
 Subject: Re: [Bacula-users] Using removable SATA disks as media
 To: bacula-users@lists.sourceforge.net
 Date: Thursday, April 22, 2010, 4:02 PM
 On 04/22/10 17:47, Joseph Spenner
 wrote:
  --- On Wed, 4/14/10, Phil Stracchino ala...@metrocast.net
 wrote:
  
 
  Joseph,
 
  That looks much better.  Now your volumes
 have the
  correct nine days
  retention time for your desired ten-day cycle,
 instead of
  zero, so your
  jobs will actually be kept around instead of being
 pruned
  as soon as
  they complete.  (That's why you were always
 seeing No
  prior job found.)
 
  I suggest you now purge and recycle all of your
 existing
  volumes so that
  you're starting over from a clean slate, let it
 run, and
  see how it
  goes.  Right now, you have only one
 appendable
  volume.
 
 
  
  I am still testing, using run at the bconsole, and
 selecting:
       2: BackupCatalog
  
  I've run it a few times in one hour, and I see it
 appending the backup to the same volume.  Is this
 because the runs are happening too fast (same cycle)? 
 The setting:
  
    Volume Use Duration = 23h
  
  responsible?
 
 Yes.  That setting says the volume is to remain
 writeable for 23 hours
 from the time it is first written.  If you look back
 at the job results
 you posted earlier, you'll see that each day, the three
 jobs you ran
 were all written to the same volume, but the next day, when
 the next set
 of jobs ran 24 hours after you first wrote to the volume,
 the use
 duration was exceeded and Bacula had to recycle the next
 volume and use
 it.  All of this is exactly what should be happening.
 

Ok, thanks for the great help guys.  Makes sense.
I'm getting there!


  

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-21 Thread John Drescher
 17-Apr 23:05 backula-dir JobId 175: Start Backup JobId 175, 
 Job=DefaultBackupClient.2010-04-17_23.05.00_23
 17-Apr 23:05 backula-dir JobId 175: Max configured use duration exceeded. 
 Marking Volume disk_0005 as Used.
 17-Apr 23:05 backula-dir JobId 175: Recycled volume disk_0006
 17-Apr 23:05 backula-dir JobId 175: Using Device FileStorage
 17-Apr 23:05 backula-sd JobId 175: Recycled volume disk_0006 on device 
 FileStorage (/opt/bacula/volumes), all previous data lost.
 17-Apr 23:05 backula-sd JobId 175: Job write elapsed time = 00:00:01, 
 Transfer rate = 0  Bytes/second
 17-Apr 23:05 backula-dir JobId 175: Bacula backula-dir 5.0.1 (24Feb10): 
 17-Apr-2010 23:05:04
 ..
 ..
 It mentions above all previous data lost on disk_0006
 But later in the messages, I see:

 17-Apr 23:05 backula-sd JobId 176: Volume disk_0006 previously written, 
 moving to end of data.
 17-Apr 23:05 backula-sd JobId 176: Ready to append to end of Volume 
 disk_0006 size=621

 I checked the file sizes of the files, and they continue to grow every night. 
  I would expect an incremental file to be very small, but this is not what 
 I'm seeing.

 Or is this normal?


From your logs It looks like it did not grow. I mean at job 175 it
recycled the disk_0006 volume purging all jobs on the volume and
setting its size to zero. After that it continued job 175 and then ran
176 on that volume.

John

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-21 Thread John Drescher
 19-Apr 23:10 backula-sd JobId 183: Job write elapsed time = 00:00:01, 
 Transfer rate = 51.14 M Bytes/second
 19-Apr 23:10 backula-dir JobId 183: Bacula backula-dir 5.0.1 (24Feb10): 
 19-Apr-2010 23:10:04
  Build OS:               x86_64-unknown-linux-gnu redhat
  JobId:                  183
  Job:                    BackupCatalog.2010-04-19_23.10.00_31
  Backup Level:           Full
  Client:                 backula-fd 5.0.1 (24Feb10) 
 x86_64-unknown-linux-gnu,redhat,
  FileSet:                Catalog 2010-03-09 14:09:54
  Pool:                   File (From Job resource)
  Catalog:                MyCatalog (From Client resource)
  Storage:                File (From Job resource)
  Scheduled time:         19-Apr-2010 23:10:00
  Start time:             19-Apr-2010 23:10:03
  End time:               19-Apr-2010 23:10:04
  Elapsed time:           1 sec
  Priority:               11
  FD Files Written:       1
  SD Files Written:       1
  FD Bytes Written:       51,143,523 (51.14 MB)
  SD Bytes Written:       51,143,643 (51.14 MB)
  Rate:                   51143.5 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               no
  Volume name(s):         disk_0002
  Volume Session Id:      24
  Volume Session Time:    1271098297
  Last Volume Bytes:      51,182,974 (51.18 MB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

 19-Apr 23:10 backula-dir JobId 183: Begin pruning Jobs older than 9 days .
 19-Apr 23:10 backula-dir JobId 183: No Jobs found to prune.
 19-Apr 23:10 backula-dir JobId 183: Begin pruning Jobs.
 19-Apr 23:10 backula-dir JobId 183: No Files found to prune.
 19-Apr 23:10 backula-dir JobId 183: End auto prune.

 19-Apr 23:10 backula-dir JobId 183: shell command: run AfterJob 
 /opt/bacula/bin/delete_catalog_backup


This is your catalog backup which is 51MB.

John

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-21 Thread Phil Stracchino
On 04/21/10 19:18, Joseph Spenner wrote:
 --- On Wed, 4/21/10, John Drescher dresche...@gmail.com wrote:
 
 From: John Drescher dresche...@gmail.com
 Subject: Re: [Bacula-users] Using removable SATA disks as media
 To: Joseph Spenner joseph85...@yahoo.com
 Cc: bacula-users@lists.sourceforge.net
 Date: Wednesday, April 21, 2010, 12:10 PM
 On Wed, Apr 21, 2010 at 2:08 PM, John
 Drescher dresche...@gmail.com
 wrote:
 Here are the file sizes (in date order):

 7009019184 Apr 14 23:21 disk_0003
 51149798   Apr 15 23:10 disk_0004
 51159533   Apr 16 23:10 disk_0005
 51167844   Apr 17 23:10 disk_0006
 51177531   Apr 18 23:10 disk_0001
 51182974   Apr 19 23:10 disk_0002

 There shouldn't be 51M+ of updates every night,
 since these systems are not doing too much.  ?

 
 
 My bacula-dir.conf has a default Fileset which I'm using, which includes:
 
 /usr
 /opt/bacula/bin
 
 The /usr slice is about 4.8G, and shouldn't be changing-- at least
 not at the tune of 51M every night.


Shouldn't is a powerful word.  You might want to test the theory by
doing something like this:

find /usr /opt/bacula/bin -mtime -1 -ls

to list all files that have been modified in the last 24 hours (or
-mtime -2 to check the last 48 hours) and see what's changing.  Another
alternative would be to start up BAT, go to Jobs Run, select job 183,
right-click, and select List Files On Job; Bacula will tell you
precisely which files were backed up.  (You can accomplish the same
thing using bconsole, but it'll require a manual SQL query.)  Then you
can look at the specific files that you know were backed up, and
determine why they got backed up.



-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-21 Thread Phil Stracchino
On 04/21/10 19:42, John Drescher wrote:
 19-Apr 23:10 backula-sd JobId 183: Job write elapsed time = 00:00:01, 
 Transfer rate = 51.14 M Bytes/second
 19-Apr 23:10 backula-dir JobId 183: Bacula backula-dir 5.0.1 (24Feb10): 
 19-Apr-2010 23:10:04
  Build OS:   x86_64-unknown-linux-gnu redhat
  JobId:  183
  Job:BackupCatalog.2010-04-19_23.10.00_31
 
 This is your catalog backup which is 51MB.
 
 John

Doh!  So it is.  I missed that...  The other backups, indeed, are 0
bytes exactly as they should be.

Still, knowing how to determine exactly what got backed up by a specific
job is a useful thing.



-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-21 Thread Joseph Spenner

--- On Wed, 4/21/10, Phil Stracchino ala...@metrocast.net wrote:

 From: Phil Stracchino ala...@metrocast.net
 Subject: Re: [Bacula-users] Using removable SATA disks as media
 To: bacula-users@lists.sourceforge.net
 Date: Wednesday, April 21, 2010, 5:53 PM
 On 04/21/10 19:42, John Drescher
 wrote:
  19-Apr 23:10 backula-sd JobId 183: Job write
 elapsed time = 00:00:01, Transfer rate = 51.14 M
 Bytes/second
  19-Apr 23:10 backula-dir JobId 183: Bacula
 backula-dir 5.0.1 (24Feb10): 19-Apr-2010 23:10:04
   Build OS:         
      x86_64-unknown-linux-gnu redhat
   JobId:         
         183
   Job:         
          
 BackupCatalog.2010-04-19_23.10.00_31
  
  This is your catalog backup which is 51MB.
  
  John
 
 Doh!  So it is.  I missed that...  The other
 backups, indeed, are 0
 bytes exactly as they should be.
 
 Still, knowing how to determine exactly what got backed up
 by a specific
 job is a useful thing.
 

Oh good point.  Thanks for the clarification!  I'll check it out tomorrow.

Thanks again!



  

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner
--- On Mon, 4/12/10, Phil Stracchino ala...@metrocast.net wrote:


    File Retention = 1 days
    Job Retention = 6 months
  }
  ===
  
  Is the client specific File Retention causing my
 problem?
 
 Yes, that's exactly the problem.
 
 I'm also a bit confused (obviously) with:
     File Retention
     Job Retention
     Volume Retention
     Volume Use Duration
 
 Basically, whichever is the SHORTEST of the retention
 settings will
 dictate when data begins getting pruned.  In most
 cases, you probably
 want all three retention settings to be the same.
 
 Volume Use Duration is not a retention setting at all; it
 is the time
 window during which data may be written to the volume,
 starting from
 when it is first written after creation or recycling. 
 When that window
 ends, the volume will be marked Used even if not full, and
 no new jobs
 not already running will be allowed to write to it. 
 (I'm honestly not
 certain what happens to the running job if the use duration
 expires
 while a job is still writing to the volume; I've never
 tried it.)
 
 If all your clients will have the same settings, then I
 would remofe the
 File Retention setting from your clients altogether. 
 Unless a specific
 client NEEDS its retention settings to be different from
 the Pool
 defaults, there's no reason to have retention settings in
 the client
 resource at all.
 

Phil:
  It's still using a new file every night.  Here's the top of the 'messages' 
log, if it's any help:

===
12-Apr 23:05 backula-dir JobId 160: No prior Full backup Job record found.
12-Apr 23:05 backula-dir JobId 160: No prior or suitable Full backup found in 
catalog. Doing FULL backup.
12-Apr 23:05 backula-dir JobId 160: Start Backup JobId 160, 
Job=DefaultBackupClient.2010-04-12_23.05.00_03
12-Apr 23:05 backula-dir JobId 160: Using Device FileStorage
12-Apr 23:05 backula-sd JobId 160: Volume disk_0002 previously written, 
moving to end of data.
12-Apr 23:05 backula-sd JobId 160: Ready to append to end of Volume disk_0002 
size=2566554688
12-Apr 23:05 backula-sd JobId 160: Job write elapsed time = 00:00:19, Transfer 
rate = 132.2 M Bytes/second
12-Apr 23:05 backula-dir JobId 160: Bacula backula-dir 5.0.1 (24Feb10): 
12-Apr-2010 23:05:29
===

I made all those settings be 9 days, as you suggested.  So, currently, I have:

no 'retention' definitions in any of my Client sections.

# Default pool definition
Pool {
Name = Default
  Pool Type = Backup
Recycle = yes
 AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 day
}

# File Pool definition
Pool {
  Name = File
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Job Retention = 9 days
  Volume Retention = 9 days
  Volume Use Duration = 23h
  Maximum Volume Bytes = 1400G
  Maximum Volumes = 10
}

Could it be the Volume Use Retetion ?  Currently, my backups run fast since 
there are only 2 clients.  So, if they're done within an hour, maybe this 
setting isn't doing what it would normally do when backups take a few hours to 
run?



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner
--- On Mon, 4/12/10, Phil Stracchino ala...@metrocast.net  wrote:

File Retention = 1 days
Job Retention = 6 months
  }
  ===
 
  Is the client specific File Retention causing my
 problem?

 Yes, that's exactly the problem.

 I'm also a bit confused (obviously) with:
 File Retention
 Job Retention
 Volume Retention
 Volume Use Duration

 Basically, whichever is the SHORTEST of the retention
 settings will
 dictate when data begins getting pruned.  In most
 cases, you probably
 want all three retention settings to be the same.

 Volume Use Duration is not a retention setting at all; it
 is the time
 window during which data may be written to the volume,
 starting from
 when it is first written after creation or recycling. 
 When that window
 ends, the volume will be marked Used even if not full, and
 no new jobs
 not already running will be allowed to write to it. 
 (I'm honestly not
 certain what happens to the running job if the use duration
 expires
 while a job is still writing to the volume; I've never
 tried it.)

 If all your clients will have the same settings, then I
 would remofe the
 File Retention setting from your clients altogether. 
 Unless a specific
 client NEEDS its retention settings to be different from
 the Pool
 defaults, there's no reason to have retention settings in
 the client
 resource at all.


Phil:
  I just realized a typo.  I meant to say it's still using the same file every 
night.  I also just noticed something after the post-- the appending 
information in the log below.  So, it's not re-writing over the top of the same 
file every night; it's appending to it-- and not using a new file every night 
as I initially wanted.

  Here's the top of the 'messages' log, if it's any help:

===
12-Apr 23:05 backula-dir JobId 160: No prior Full backup Job record found.
12-Apr 23:05 backula-dir JobId 160: No prior or suitable Full backup found in 
catalog. Doing FULL backup.
12-Apr 23:05 backula-dir JobId 160: Start Backup JobId 160, 
Job=DefaultBackupClient.2010-04-12_23.05.00_03
12-Apr 23:05 backula-dir JobId 160: Using Device FileStorage
12-Apr 23:05 backula-sd JobId 160: Volume disk_0002 previously written, 
moving to end of data.
12-Apr 23:05 backula-sd JobId 160: Ready to append to end of Volume disk_0002 
size=2566554688
12-Apr 23:05 backula-sd JobId 160: Job write elapsed time = 00:00:19, Transfer 
rate = 132.2 M Bytes/second
12-Apr 23:05 backula-dir JobId 160: Bacula backula-dir 5.0.1 (24Feb10): 
12-Apr-2010 23:05:29
===

I made all those settings be 9 days, as you suggested.  So, currently, I have:

no 'retention' definitions in any of my Client sections.

# Default pool definition
Pool {
Name = Default
  Pool Type = Backup
Recycle = yes
AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 day
}

# File Pool definition
Pool {
  Name = File
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Job Retention = 9 days
  Volume Retention = 9 days
  Volume Use Duration = 23h
  Maximum Volume Bytes = 1400G
  Maximum Volumes = 10
}

Could it be the Volume Use Retetion ?  Currently, my backups run fast since 
there are only 2 clients.  So, if they're done within an hour, maybe this 
setting isn't doing what it would normally do when backups take a few hours to 
run?



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread John Drescher
  I just realized a typo.  I meant to say it's still using the same file every 
 night.  I also just noticed something after the post-- the appending 
 information in the log below.  So, it's not re-writing over the top of the 
 same file every night; it's appending to it-- and not using a new file 
 every night as I initially wanted.


Can you post the output of list media

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Phil Stracchino
On 04/14/10 07:51, Joseph Spenner wrote:
 Phil:
   I just realized a typo.  I meant to say it's still using the same file 
 every night.  I also just noticed something after the post-- the appending 
 information in the log below.  So, it's not re-writing over the top of the 
 same file every night; it's appending to it-- and not using a new file 
 every night as I initially wanted.
 
   Here's the top of the 'messages' log, if it's any help:
 
 ===
 12-Apr 23:05 backula-dir JobId 160: No prior Full backup Job record found.
 12-Apr 23:05 backula-dir JobId 160: No prior or suitable Full backup found in 
 catalog. Doing FULL backup.
 12-Apr 23:05 backula-dir JobId 160: Start Backup JobId 160, 
 Job=DefaultBackupClient.2010-04-12_23.05.00_03
 12-Apr 23:05 backula-dir JobId 160: Using Device FileStorage
 12-Apr 23:05 backula-sd JobId 160: Volume disk_0002 previously written, 
 moving to end of data.
 12-Apr 23:05 backula-sd JobId 160: Ready to append to end of Volume 
 disk_0002 size=2566554688
 12-Apr 23:05 backula-sd JobId 160: Job write elapsed time = 00:00:19, 
 Transfer rate = 132.2 M Bytes/second
 12-Apr 23:05 backula-dir JobId 160: Bacula backula-dir 5.0.1 (24Feb10): 
 12-Apr-2010 23:05:29
 ===
 
 I made all those settings be 9 days, as you suggested.  So, currently, I have:
 
 no 'retention' definitions in any of my Client sections.
 
 # Default pool definition
 Pool {
 Name = Default
   Pool Type = Backup
 Recycle = yes
 AutoPrune = yes
 Job Retention = 9 days
 Volume Retention = 9 day
 }
 
 # File Pool definition
 Pool {
   Name = File
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   Job Retention = 9 days
   Volume Retention = 9 days
   Volume Use Duration = 23h
   Maximum Volume Bytes = 1400G
   Maximum Volumes = 10
 }
 
 Could it be the Volume Use Retetion ?  Currently, my backups run fast since 
 there are only 2 clients.  So, if they're done within an hour, maybe this 
 setting isn't doing what it would normally do when backups take a few hours 
 to run?


Did you Update the pools from the resources, and the volumes from the pools?

What do the 'List Volumes' and 'Show Pools' commands return?


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:


 
 Can you post the output of list media
 
 John
 

John:
  Here's the results of list media

===
*list media
Automatically selected Catalog: MyCatalog
Using Catalog MyCatalog
Pool: Default
No results to list.
Pool: File
+-++---+-+---+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+---+--+--+-+--+---+---+-+
|  25 | disk_0001  | Used  |   1 |37,353,382 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-08 23:10:03 |
|  26 | disk_0002  | Append|   1 | 5,125,873,046 |1 |   
 0 |   1 |0 | 0 | File  | 2010-04-13 23:10:02 |
|  27 | disk_0003  | Used  |   1 | 4,440,507,545 |1 |   
 0 |   1 |0 | 0 | File  | 2010-04-07 23:21:26 |
|  28 | disk_0004  | Used  |   1 |51,194,220 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-07 23:21:59 |
|  29 | disk_0005  | Used  |   1 |10,436 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-08 23:05:03 |
|  30 | disk_0006  | Used  |   1 |   561 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-08 23:07:14 |
+-++---+-+---+--+--+-+--+---+---+-+
Pool: Scratch
No results to list.
*
===



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner
--- On Wed, 4/14/10, Phil Stracchino ala...@metrocast.net wrote:

 
 
 Did you Update the pools from the resources, and the
 volumes from the pools?
 
 What do the 'List Volumes' and 'Show Pools' commands
 return?


Phil:
  Sorry.  I did not do that.  So, I just now did the update the pools.  As 
far as volumes from the pools, I wasn't sure what this meant.  Which commands 
(series of commands) perform this?

Here's the output of the commands you requested:

---
list volumes:
---

===
 *list volumes
Pool: Default
No results to list.
Pool: File
+-++---+-+---+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+---+--+--+-+--+---+---+-+
|  25 | disk_0001  | Used  |   1 |37,353,382 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-08 23:10:03 |
|  26 | disk_0002  | Append|   1 | 5,125,873,046 |1 |   
 0 |   1 |0 | 0 | File  | 2010-04-13 23:10:02 |
|  27 | disk_0003  | Used  |   1 | 4,440,507,545 |1 |   
 0 |   1 |0 | 0 | File  | 2010-04-07 23:21:26 |
|  28 | disk_0004  | Used  |   1 |51,194,220 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-07 23:21:59 |
|  29 | disk_0005  | Used  |   1 |10,436 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-08 23:05:03 |
|  30 | disk_0006  | Used  |   1 |   561 |0 |   
 0 |   1 |0 | 0 | File  | 2010-04-08 23:07:14 |
+-++---+-+---+--+--+-+--+---+---+-+
Pool: Scratch
No results to list.
*
===
--
and show pools
--

===
*show pools
Pool: name=Default PoolType=Backup
  use_cat=1 use_once=0 cat_files=1
  max_vols=0 auto_prune=1 VolRetention=9 days 
  VolUse=0 secs recycle=1 LabelFormat=*None*
  CleaningPrefix=*None* LabelType=0
  RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0
  MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0
  MigTime=0 secs MigHiBytes=0 MigLoBytes=0
  JobRetention=0 secs FileRetention=0 secs
Pool: name=File PoolType=Backup
  use_cat=1 use_once=0 cat_files=1
  max_vols=10 auto_prune=1 VolRetention=9 days 
  VolUse=23 hours  recycle=1 LabelFormat=*None*
  CleaningPrefix=*None* LabelType=0
  RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0
  MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=1503238553600
  MigTime=0 secs MigHiBytes=0 MigLoBytes=0
  JobRetention=0 secs FileRetention=0 secs
Pool: name=Scratch PoolType=Backup
  use_cat=1 use_once=0 cat_files=1
  max_vols=0 auto_prune=1 VolRetention=1 year 
  VolUse=0 secs recycle=1 LabelFormat=*None*
  CleaningPrefix=*None* LabelType=0
  RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0
  MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0
  MigTime=0 secs MigHiBytes=0 MigLoBytes=0
  JobRetention=0 secs FileRetention=0 secs
*
===





  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread John Drescher
On Wed, Apr 14, 2010 at 9:28 AM, Joseph Spenner joseph85...@yahoo.com wrote:
 --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:



 Can you post the output of list media

 John


 John:
  Here's the results of list media

 ===
 *list media
 Automatically selected Catalog: MyCatalog
 Using Catalog MyCatalog
 Pool: Default
 No results to list.
 Pool: File
 +-++---+-+---+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes      | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten         |
 +-++---+-+---+--+--+-+--+---+---+-+
 |      25 | disk_0001  | Used      |       1 |    37,353,382 |        0 |     
        0 |       1 |    0 |         0 | File      | 2010-04-08 23:10:03 |
 |      26 | disk_0002  | Append    |       1 | 5,125,873,046 |        1 |     
        0 |       1 |    0 |         0 | File      | 2010-04-13 23:10:02 |
 |      27 | disk_0003  | Used      |       1 | 4,440,507,545 |        1 |     
        0 |       1 |    0 |         0 | File      | 2010-04-07 23:21:26 |
 |      28 | disk_0004  | Used      |       1 |    51,194,220 |        0 |     
        0 |       1 |    0 |         0 | File      | 2010-04-07 23:21:59 |
 |      29 | disk_0005  | Used      |       1 |        10,436 |        0 |     
        0 |       1 |    0 |         0 | File      | 2010-04-08 23:05:03 |
 |      30 | disk_0006  | Used      |       1 |           561 |        0 |     
        0 |       1 |    0 |         0 | File      | 2010-04-08 23:07:14 |
 +-++---+-+---+--+--+-+--+---+---+-+
 Pool: Scratch
 No results to list.
 *
 ===


All of these volumes are in the Default pool where you have no
restrictions on volume usage. You placed the restrictions on the
Backup pool. For these volumes you have Volume Retention of 0 which I
believe means never recycle.

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread John Drescher
On Wed, Apr 14, 2010 at 10:06 AM, John Drescher dresche...@gmail.com wrote:
 On Wed, Apr 14, 2010 at 9:28 AM, Joseph Spenner joseph85...@yahoo.com wrote:
 --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:



 Can you post the output of list media

 John


 John:
  Here's the results of list media

 ===
 *list media
 Automatically selected Catalog: MyCatalog
 Using Catalog MyCatalog
 Pool: Default
 No results to list.
 Pool: File
 +-++---+-+---+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes      | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten         |
 +-++---+-+---+--+--+-+--+---+---+-+
 |      25 | disk_0001  | Used      |       1 |    37,353,382 |        0 |    
         0 |       1 |    0 |         0 | File      | 2010-04-08 23:10:03 |
 |      26 | disk_0002  | Append    |       1 | 5,125,873,046 |        1 |    
         0 |       1 |    0 |         0 | File      | 2010-04-13 23:10:02 |
 |      27 | disk_0003  | Used      |       1 | 4,440,507,545 |        1 |    
         0 |       1 |    0 |         0 | File      | 2010-04-07 23:21:26 |
 |      28 | disk_0004  | Used      |       1 |    51,194,220 |        0 |    
         0 |       1 |    0 |         0 | File      | 2010-04-07 23:21:59 |
 |      29 | disk_0005  | Used      |       1 |        10,436 |        0 |    
         0 |       1 |    0 |         0 | File      | 2010-04-08 23:05:03 |
 |      30 | disk_0006  | Used      |       1 |           561 |        0 |    
         0 |       1 |    0 |         0 | File      | 2010-04-08 23:07:14 |
 +-++---+-+---+--+--+-+--+---+---+-+
 Pool: Scratch
 No results to list.
 *
 ===


 All of these volumes are in the Default pool where you have no
 restrictions on volume usage. You placed the restrictions on the
 Backup pool. For these volumes you have Volume Retention of 0 which I
 believe means never recycle.


I am sorry. I was misreading. You have the restrictions on the File
pool which is what your output says.

You need to execute the two update commands that Phil asked you about.


update

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread John Drescher
On Wed, Apr 14, 2010 at 10:09 AM, John Drescher dresche...@gmail.com wrote:
 On Wed, Apr 14, 2010 at 10:06 AM, John Drescher dresche...@gmail.com wrote:
 On Wed, Apr 14, 2010 at 9:28 AM, Joseph Spenner joseph85...@yahoo.com 
 wrote:
 --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:



 Can you post the output of list media

 John


 John:
  Here's the results of list media

 ===
 *list media
 Automatically selected Catalog: MyCatalog
 Using Catalog MyCatalog
 Pool: Default
 No results to list.
 Pool: File
 +-++---+-+---+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes      | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten         
 |
 +-++---+-+---+--+--+-+--+---+---+-+
 |      25 | disk_0001  | Used      |       1 |    37,353,382 |        0 |   
          0 |       1 |    0 |         0 | File      | 2010-04-08 23:10:03 |
 |      26 | disk_0002  | Append    |       1 | 5,125,873,046 |        1 |   
          0 |       1 |    0 |         0 | File      | 2010-04-13 23:10:02 |
 |      27 | disk_0003  | Used      |       1 | 4,440,507,545 |        1 |   
          0 |       1 |    0 |         0 | File      | 2010-04-07 23:21:26 |
 |      28 | disk_0004  | Used      |       1 |    51,194,220 |        0 |   
          0 |       1 |    0 |         0 | File      | 2010-04-07 23:21:59 |
 |      29 | disk_0005  | Used      |       1 |        10,436 |        0 |   
          0 |       1 |    0 |         0 | File      | 2010-04-08 23:05:03 |
 |      30 | disk_0006  | Used      |       1 |           561 |        0 |   
          0 |       1 |    0 |         0 | File      | 2010-04-08 23:07:14 |
 +-++---+-+---+--+--+-+--+---+---+-+
 Pool: Scratch
 No results to list.
 *
 ===


 All of these volumes are in the Default pool where you have no
 restrictions on volume usage. You placed the restrictions on the
 Backup pool. For these volumes you have Volume Retention of 0 which I
 believe means never recycle.


 I am sorry. I was misreading. You have the restrictions on the File
 pool which is what your output says.

 You need to execute the two update commands that Phil asked you about.


An example of what you need to do is here:


 # bconsole
Connecting to Director jmd0:9101
1000 OK: jmd0-dir Version: 5.0.1 (24 February 2010)
Enter a period to cancel a command.
*update
Automatically selected Catalog: MyCatalog
Using Catalog MyCatalog
Update choice:
 1: Volume parameters
 2: Pool from resource
 3: Slots from autochanger
 4: Long term statistics
Choose catalog item to update (1-4): 2
The defined Pool resources are:
 1: Default
 2: Catalogs
 3: Users
 4: Temp
 5: Scratch
Select Pool resource (1-5): 1



Select the File pool instead of the default pool.


Then run the update the volumes from pool

*update
Update choice:
 1: Volume parameters
 2: Pool from resource
 3: Slots from autochanger
 4: Long term statistics
Choose catalog item to update (1-4): 1
Parameters to modify:
 1: Volume Status
 2: Volume Retention Period
 3: Volume Use Duration
 4: Maximum Volume Jobs
 5: Maximum Volume Files
 6: Maximum Volume Bytes
 7: Recycle Flag
 8: Slot
 9: InChanger Flag
10: Volume Files
11: Pool
12: Volume from Pool
13: All Volumes from Pool
14: All Volumes from all Pools
15: Enabled
16: RecyclePool
17: Action On Purge
18: Done
Select parameter to modify (1-18): 13
The defined Pool resources are:
 1: Default
 2: Catalogs
 3: Users
 4: Temp
 5: Scratch
Select Pool resource (1-5): 1
All Volume defaults updated from Default Pool record.

Again select the File pool instead of default.


John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:


 
 You need to execute the two update commands that Phil asked
 you about.
 
 
 update
 

Ok, I ran the commands.  I'll see what happens tonight.  Anything else I should 
run to verify?

Thanks!



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread John Drescher
On Wed, Apr 14, 2010 at 10:28 AM, Joseph Spenner joseph85...@yahoo.com wrote:
 --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:



 You need to execute the two update commands that Phil asked
 you about.


 update


 Ok, I ran the commands.  I'll see what happens tonight.  Anything else I 
 should run to verify?


Post the output of list media pool=File

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:

 
 Post the output of list media pool=File
 
 John

John:
  Here are results:

===
*list media pool=File
+-++---+-+---+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+---+--+--+-+--+---+---+-+
|  25 | disk_0001  | Used  |   1 |37,353,382 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-08 23:10:03 |
|  26 | disk_0002  | Append|   1 | 5,125,873,046 |1 |  
777,600 |   1 |0 | 0 | File  | 2010-04-13 23:10:02 |
|  27 | disk_0003  | Used  |   1 | 4,440,507,545 |1 |  
777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:26 |
|  28 | disk_0004  | Used  |   1 |51,194,220 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:59 |
|  29 | disk_0005  | Used  |   1 |10,436 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-08 23:05:03 |
|  30 | disk_0006  | Used  |   1 |   561 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-08 23:07:14 |
+-++---+-+---+--+--+-+--+---+---+-+
*
===



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Phil Stracchino
On 04/14/10 10:55, Joseph Spenner wrote:
 --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:
 

 Post the output of list media pool=File

 John
 
 John:
   Here are results:
 
 ===
 *list media pool=File
 +-++---+-+---+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
 +-++---+-+---+--+--+-+--+---+---+-+
 |  25 | disk_0001  | Used  |   1 |37,353,382 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-08 23:10:03 |
 |  26 | disk_0002  | Append|   1 | 5,125,873,046 |1 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-13 23:10:02 |
 |  27 | disk_0003  | Used  |   1 | 4,440,507,545 |1 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:26 |
 |  28 | disk_0004  | Used  |   1 |51,194,220 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:59 |
 |  29 | disk_0005  | Used  |   1 |10,436 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-08 23:05:03 |
 |  30 | disk_0006  | Used  |   1 |   561 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-08 23:07:14 |
 +-++---+-+---+--+--+-+--+---+---+-+
 *
 ===

Joseph,

That looks much better.  Now your volumes have the correct nine days
retention time for your desired ten-day cycle, instead of zero, so your
jobs will actually be kept around instead of being pruned as soon as
they complete.  (That's why you were always seeing No prior job found.)

I suggest you now purge and recycle all of your existing volumes so that
you're starting over from a clean slate, let it run, and see how it
goes.  Right now, you have only one appendable volume.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner

If life gives you lemons, keep them-- because hey.. free lemons.

--- On Wed, 4/14/10, Phil Stracchino ala...@metrocast.net wrote:

 
 Joseph,
 
 That looks much better.  Now your volumes have the
 correct nine days
 retention time for your desired ten-day cycle, instead of
 zero, so your
 jobs will actually be kept around instead of being pruned
 as soon as
 they complete.  (That's why you were always seeing No
 prior job found.)
 
 I suggest you now purge and recycle all of your existing
 volumes so that
 you're starting over from a clean slate, let it run, and
 see how it
 goes.  Right now, you have only one appendable
 volume.
 

Phil:
  I believe I purged the volumes correctly, but not sure how to 'recycle' 
volumes..?

Here's what it looks like now:

===
*list media pool=File
+-++---+-+---+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+---+--+--+-+--+---+---+-+
|  25 | disk_0001  | Purged|   1 |37,353,382 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-08 23:10:03 |
|  26 | disk_0002  | Purged|   1 | 5,125,873,046 |1 |  
777,600 |   1 |0 | 0 | File  | 2010-04-13 23:10:02 |
|  27 | disk_0003  | Purged|   1 | 4,440,507,545 |1 |  
777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:26 |
|  28 | disk_0004  | Purged|   1 |51,194,220 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:59 |
|  29 | disk_0005  | Purged|   1 |10,436 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-08 23:05:03 |
|  30 | disk_0006  | Purged|   1 |   561 |0 |  
777,600 |   1 |0 | 0 | File  | 2010-04-08 23:07:14 |
+-++---+-+---+--+--+-+--+---+---+-+
*
===



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Phil Stracchino
On 04/14/10 14:01, Joseph Spenner wrote:
 Phil:
   I believe I purged the volumes correctly, but not sure how to 'recycle' 
 volumes..?
 
 Here's what it looks like now:
 
 ===
 *list media pool=File
 +-++---+-+---+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
 +-++---+-+---+--+--+-+--+---+---+-+
 |  25 | disk_0001  | Purged|   1 |37,353,382 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-08 23:10:03 |
 |  26 | disk_0002  | Purged|   1 | 5,125,873,046 |1 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-13 23:10:02 |
 |  27 | disk_0003  | Purged|   1 | 4,440,507,545 |1 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:26 |
 |  28 | disk_0004  | Purged|   1 |51,194,220 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-07 23:21:59 |
 |  29 | disk_0005  | Purged|   1 |10,436 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-08 23:05:03 |
 |  30 | disk_0006  | Purged|   1 |   561 |0 | 
  777,600 |   1 |0 | 0 | File  | 2010-04-08 23:07:14 |
 +-++---+-+---+--+--+-+--+---+---+-+
 *
 ===

Once purged, you can either let Bacula recycle them itself, or you can
use the Update Volume command to manually change the volume status to
Recycle.  This is a particularly straightforward operation if you are
using BAT, since you can do it on all the volumes at once.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-14 Thread Joseph Spenner
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote:
 
 
  OK, my next backup ran and it used the next volume.
  Success!
  However.. it appended.  Here's what my volumes look
 like now:
 
  *list volumes
  Automatically selected Catalog: MyCatalog
  Using Catalog MyCatalog
  Pool: Default
  No results to list.
  Pool: File
 
 +-++---+-+---+--+--+-+--+---+---+-+
  | MediaId | VolumeName | VolStatus | Enabled |
 VolBytes      | VolFiles | VolRetention | Recycle | Slot
 | InChanger | MediaType | LastWritten         |
 
 +-++---+-+---+--+--+-+--+---+---+-+
  |      25 | disk_0001  | Purged    |       1
 |    37,353,382 |        0 |      777,600 |    
   1 |    0 |         0 | File      | 2010-04-08
 23:10:03 |
  |      26 | disk_0002  | Purged    |       1
 | 5,125,873,046 |        1 |      777,600 |      
 1 |    0 |         0 | File      | 2010-04-13
 23:10:02 |
  |      27 | disk_0003  | Append    |       1
 | 7,009,019,184 |        1 |      777,600 |      
 1 |    0 |         0 | File      | 2010-04-14
 23:21:34 |
  |      28 | disk_0004  | Purged    |       1
 |    51,194,220 |        0 |      777,600 |    
   1 |    0 |         0 | File      | 2010-04-07
 23:21:59 |
  |      29 | disk_0005  | Purged    |       1
 |        10,436 |        0 |      777,600 |    
   1 |    0 |         0 | File      | 2010-04-08
 23:05:03 |
  |      30 | disk_0006  | Purged    |       1
 |           561 |        0 |      777,600 |  
     1 |    0 |         0 | File      | 2010-04-08
 23:07:14 |
 
 +-++---+-+---+--+--+-+--+---+---+-+
  Pool: Scratch
  No results to list.
  *
 
  Whatever was on disk_0003 was left in place, and the
 new backup data appended to that volume.  Is there a way to
 make it wipe the volume clean before writing?
 
 
 It should have done that. Are you sure you did not backup
 7G of data?
 

Perhaps I should let it run a few days to know for sure.  I'll keep everyone 
posted.

Thanks!



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-12 Thread Phil Stracchino
On 04/11/10 23:14, Joseph Spenner wrote:
 Phil:
   Thanks for the help!  Getting closer.  It's not breaking up the backup, but 
 now it uses the same file/device every night.  Maybe the Volume Use 
 Duration is too short?

Did you fix the retention period yet?  If it's immediately reusing the
first volume, it probably means your retention is too short.  If you're
trying to use these volumes in daily rotation, then the volume use
duration should be set so that it expires just before the next day's
backup (23 hours being a good number for that), and your retention
period needs to be set such that the first volume becomes available
again just after the last volume is used (for a ten-day rotation, nine
days should be right).

Make sure that after you update the Pool resource, you FIRST update the
Pool from the resource, THEN update ALL of the Volumes from the Pool.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-12 Thread Joseph Spenner
--- On Mon, 4/12/10, Phil Stracchino ala...@metrocast.net wrote:
 
 Did you fix the retention period yet?  If it's
 immediately reusing the
 first volume, it probably means your retention is too
 short.  If you're
 trying to use these volumes in daily rotation, then the
 volume use
 duration should be set so that it expires just before the
 next day's
 backup (23 hours being a good number for that), and your
 retention
 period needs to be set such that the first volume becomes
 available
 again just after the last volume is used (for a ten-day
 rotation, nine
 days should be right).
 
 Make sure that after you update the Pool resource, you
 FIRST update the
 Pool from the resource, THEN update ALL of the Volumes from
 the Pool.
 
 
Phil:
  Here are my retention settings:

===
Client {
  Name = backula-fd
  Address = backula
  File Retention = 1 days
  Job Retention = 6 months
}

Pool {
  Name = Default
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 1 days
}

Pool {
  Name = File
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 9 days
  Volume Use Duration = 23h
  Maximum Volume Bytes = 1400G
  Maximum Volumes = 10
}

Client {
  Name = tycho-fd
  Address = tycho
  File Retention = 1 days
  Job Retention = 6 months
}
===

Is the client specific File Retention causing my problem?  I suspect since 
I'm making 'retention' definitions withing the Client {} it might be the root 
of my problem.  I know all my clients will be backed up the same, so I'd like 
to have global settings inherited by all clients.  I'm also a bit confused 
(obviously) with:
   File Retention
   Job Retention
   Volume Retention
   Volume Use Duration

Thanks again!




  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-12 Thread Phil Stracchino
On 04/12/10 11:58, Joseph Spenner wrote:
 --- On Mon, 4/12/10, Phil Stracchino ala...@metrocast.net wrote:

 Did you fix the retention period yet?  If it's
 immediately reusing the
 first volume, it probably means your retention is too
 short.  If you're
 trying to use these volumes in daily rotation, then the
 volume use
 duration should be set so that it expires just before the
 next day's
 backup (23 hours being a good number for that), and your
 retention
 period needs to be set such that the first volume becomes
 available
 again just after the last volume is used (for a ten-day
 rotation, nine
 days should be right).

 Make sure that after you update the Pool resource, you
 FIRST update the
 Pool from the resource, THEN update ALL of the Volumes from
 the Pool.


 Phil:
   Here are my retention settings:
 
 ===
 Client {
   Name = backula-fd
   Address = backula
   File Retention = 1 days
   Job Retention = 6 months
 }
 
 Pool {
   Name = Default
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   Volume Retention = 1 days
 }
 
 Pool {
   Name = File
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   Volume Retention = 9 days
   Volume Use Duration = 23h
   Maximum Volume Bytes = 1400G
   Maximum Volumes = 10
 }
 
 Client {
   Name = tycho-fd
   Address = tycho
   File Retention = 1 days
   Job Retention = 6 months
 }
 ===
 
 Is the client specific File Retention causing my problem?

Yes, that's exactly the problem.

I'm also a bit confused (obviously) with:
File Retention
Job Retention
Volume Retention
Volume Use Duration

Basically, whichever is the SHORTEST of the retention settings will
dictate when data begins getting pruned.  In most cases, you probably
want all three retention settings to be the same.

Volume Use Duration is not a retention setting at all; it is the time
window during which data may be written to the volume, starting from
when it is first written after creation or recycling.  When that window
ends, the volume will be marked Used even if not full, and no new jobs
not already running will be allowed to write to it.  (I'm honestly not
certain what happens to the running job if the use duration expires
while a job is still writing to the volume; I've never tried it.)

If all your clients will have the same settings, then I would remofe the
File Retention setting from your clients altogether.  Unless a specific
client NEEDS its retention settings to be different from the Pool
defaults, there's no reason to have retention settings in the client
resource at all.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-11 Thread Joseph Spenner

--- On Fri, 4/9/10, Phil Stracchino ala...@metrocast.net wrote:

 From: Phil Stracchino ala...@metrocast.net
 Subject: Re: [Bacula-users] Using removable SATA disks as media
 To: bacula-users@lists.sourceforge.net
 Date: Friday, April 9, 2010, 12:47 PM
 On 04/09/10 11:57, Joseph Spenner
 wrote:
  Phil:
    Thanks for the reply.  Here's my
 Pool and Storage defs:
  
  =
  # Definition of file storage device
  Storage {
    Name = File
    Address = backula-va
    SDPort = 9103
    Password = somepass
    Device = FileStorage
    Media Type = File
  }
  
  
  # File Pool definition
  Pool {
    Name = File
    Pool Type = Backup
    Recycle = yes
    AutoPrune = yes
    Volume Retention = 1 days
    Use Volume Once = yes
 ^^^
    Maximum Volume Bytes = 1400G
    Maximum Volumes = 10
  }
 
 That's your problem, right there.  I had a suspicion
 that would be what
 was wrong.
 
 You've told it to use each volume once, and it's doing
 exactly what you
 told it to.  The problem is, that directive doesn't
 mean what you
 probably think it does.  You presumably meant Use
 this volume for one
 set of backups only.  But what that directive
 actually means is Allow
 EXACTLY ONE JOB on this volume.
 
 Try replacing that directive with this one:
 
 Volume Use Duration = 23h
 
 And you'll want to fix that Volume Retention directive,
 too, unless you
 really want the volume to be pruned the day after the
 backup.  If your
 plan is to use the volumes in a 10-day rotation, try
 setting the Volume
 Retention to 9 days.
 

Phil:
  Thanks for the help!  Getting closer.  It's not breaking up the backup, but 
now it uses the same file/device every night.  Maybe the Volume Use Duration 
is too short?



  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-09 Thread Joseph Spenner
--- On Thu, 4/8/10, Phil Stracchino ala...@metrocast.net wrote:


 On 04/08/10 14:05, Joseph Spenner
 wrote:
  But when the backup runs at the default time, it uses
 a different disk_ file for each system being backed up
 on the same day.  So, in 1 day, client 1 will use
 disk_0001 and client 2 will use disk_0002.  I would
 want client 1, client 2, and all future clients to use the
 same disk on that day.  Then, the next day, those same
 clients use the next disk, and so on.
  
  I believe the problem is in the bacula-dir.conf and/or
 bacula-sd.conf.
  
  Which setting would cause it to use a different
 disk/device for every client on every run?
  
  I suspect it is at least 1 of the following:
  
  File Retention
  Job Retention
  AutoPrune
  Recycle
  Volume Retention
 
 I strongly doubt it has anything to do with any of those
 settings.  Why
 not post your actual Pool and Storage definitions? 
 Then we won't have
 to guess.
 

Phil:
  Thanks for the reply.  Here's my Pool and Storage defs:

=
# Definition of file storage device
Storage {
  Name = File
  Address = backula-va
  SDPort = 9103
  Password = somepass
  Device = FileStorage
  Media Type = File
}


# File Pool definition
Pool {
  Name = File
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 1 days
  Use Volume Once = yes
  Maximum Volume Bytes = 1400G
  Maximum Volumes = 10
}

=

Thanks!


  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-09 Thread Phil Stracchino
On 04/09/10 11:57, Joseph Spenner wrote:
 Phil:
   Thanks for the reply.  Here's my Pool and Storage defs:
 
 =
 # Definition of file storage device
 Storage {
   Name = File
   Address = backula-va
   SDPort = 9103
   Password = somepass
   Device = FileStorage
   Media Type = File
 }
 
 
 # File Pool definition
 Pool {
   Name = File
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   Volume Retention = 1 days
   Use Volume Once = yes
^^^
   Maximum Volume Bytes = 1400G
   Maximum Volumes = 10
 }

That's your problem, right there.  I had a suspicion that would be what
was wrong.

You've told it to use each volume once, and it's doing exactly what you
told it to.  The problem is, that directive doesn't mean what you
probably think it does.  You presumably meant Use this volume for one
set of backups only.  But what that directive actually means is Allow
EXACTLY ONE JOB on this volume.

Try replacing that directive with this one:

Volume Use Duration = 23h

And you'll want to fix that Volume Retention directive, too, unless you
really want the volume to be pruned the day after the backup.  If your
plan is to use the volumes in a 10-day rotation, try setting the Volume
Retention to 9 days.



-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Using removable SATA disks as media

2010-04-08 Thread Joseph Spenner
I'm working on running bacula-5.0.1 in a configuration where my removable media 
are 1.5TB SATA disks with shuttles.  My system:

SuperMicro chasis with 8 removable SATA disks
QUAD core 2.66GHz CPU
CentOS 5.4, 64bit
8G memory

My goal is to have 6 of the 8 disks rotated in/out, with 2 more 'sets of 6' 
drives-- one of which will always be kept physically off site, and the other 
set ready to go, for a total of 18 removable disks.  The other 2 disks are 
always kept in the system (OS, and misc storage).

I want a setup where the disks are not spanned from night to night.  In other 
words, every night I want a disk used no matter how full it is.  If only 30% is 
used, I want the next disk to be used the next night.  If on any given night I 
need MORE than 1 disk, this is fine; spanning is acceptable.

As far as bacula is concerned, there will be 18 removable devices:

/opt/bacula/volumes/disk_0001 
...
/opt/bacula/volumes/disk_0018

the disk_ are links to a single file on each removable disk:

/opt/bacula/volumes/disk_0001 -- file in /dev/sdc1 (/mnt/disk1/disk_0001)
/opt/bacula/volumes/disk_0002 -- file in /dev/sdd1 (/mnt/disk2/disk_0002)
...
/opt/bacula/volumes/disk_0007 -- file in /dev/sdc1 (/mnt/disk1/disk_0007)
/opt/bacula/volumes/disk_0008 -- file in /dev/sdd1 (/mnt/disk2/disk_0008)

etc..

So, as far as bacula knows, there are always the files 0001 through 0018, and 
the automounter takes care of making 0001, 0007, 0013 be disk_0001.


I already have the devices created, and can do backups, but the behavior isn't 
what I want.  I currently have 2 clients (for testing):

1) the bacula server itself
2) a Suse 10.3 system

But when the backup runs at the default time, it uses a different disk_ 
file for each system being backed up on the same day.  So, in 1 day, client 1 
will use disk_0001 and client 2 will use disk_0002.  I would want client 1, 
client 2, and all future clients to use the same disk on that day.  Then, the 
next day, those same clients use the next disk, and so on.

I believe the problem is in the bacula-dir.conf and/or bacula-sd.conf.

Which setting would cause it to use a different disk/device for every client on 
every run?

I suspect it is at least 1 of the following:

File Retention
Job Retention
AutoPrune
Recycle
Volume Retention

I hope this is somewhat clear.  If not, let me know!
Any help would be great.

Thanks!




  

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using removable SATA disks as media

2010-04-08 Thread Phil Stracchino
On 04/08/10 14:05, Joseph Spenner wrote:
 But when the backup runs at the default time, it uses a different disk_ 
 file for each system being backed up on the same day.  So, in 1 day, client 1 
 will use disk_0001 and client 2 will use disk_0002.  I would want client 1, 
 client 2, and all future clients to use the same disk on that day.  Then, the 
 next day, those same clients use the next disk, and so on.
 
 I believe the problem is in the bacula-dir.conf and/or bacula-sd.conf.
 
 Which setting would cause it to use a different disk/device for every client 
 on every run?
 
 I suspect it is at least 1 of the following:
 
 File Retention
 Job Retention
 AutoPrune
 Recycle
 Volume Retention

I strongly doubt it has anything to do with any of those settings.  Why
not post your actual Pool and Storage definitions?  Then we won't have
to guess.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users