Re: [Bacula-users] External recylable hard drives as Bacula storage -how?
schedules to different jobs; some jobs do a full backup on the 3rd or 5th of the month. But this wreaks havoc with taking disks off site. - You have multiple pools that are identical except for the disk it connects to. A duplicate setup is always error prone. You can to some extent get around that by using bacula's ability to include files and even use the output of scripts (look at the @| operator). - If you manually run a backup, you have to remember to change the pool to the correct one. Worse: if you run an incremental backup, change the pool to Inc-1-Pool, and then bacula decides to upgrade to a full backup (which can happen for various legitimate reasons), it will still end up in your incremental pool. - Because I really had to fight bacula and to some extent force it to do what it wasn't designed to do, a number of the built-in features don't work very well. Overall, bacula is a great tool, and a lot of kudos to the development team. But backing up to hard disk files is something of a step child; it was grafted onto bacula and is clearly not an organic part of the design. That's really not so much a criticism of bacula as it is a statement that it may not be the right tool for the job. It will work exceedingly well if you have a NAS device or something of that nature permanently available for backup. But for taking disks offsite, well, it works well enough for my own office - where I can manually intervene easily - but I don't think I would roll it out to my customers for hard disk backup. I would not hesitate to use it for tape backups. Timo Neuvonen wrote: I'm considering the use of reasonably-priced external hard drives to replace my oldish tape drive. In the beginning this would apply my home system. Drives like this: http://www.wdc.com/en/products/products.asp?driveid=563 AFAIK Bacula has been very much designed with tapes (volumes) and tape pools in mind, though it is possible to create volumes on hard disks too. I haven't tried to plan this very much yet, so there certainly are some holes in my scenario. But let's suppose I had (for example) 3 pcs of one-terabyte drives like the one in the link above, I would keep at least one of them in a safehouse, and one or two (at a time) were attached to computer running Bacula SD. This 3-disk system is a minimized scenario, there would soon be a need for 4-5 disks, I guess. The goal could be writing all the backups to one drive for, say, one month. Then, this drive would be considered used (compare to volume use duration in Bacula) and the next one were taken into daily use, though both the disks were attached to the server at this time. Then, some day soon thereafter I would take the used one to safehouse, and some day bring the oldest one from the safehouse back to use, and attach it to the server before it actually is needed. Very much like I move tapes between a safehouse and an autoloader, making sure they are there when needed but not forced to do it at certain preset day. Basically, this is recycling the disk drives, like Bacula recycles volumes. Both full and incremental jobs were written to same disk, and I would propably like the system configured in a way that after a new disk is taken into use (after the previous one was considered used) the first jobs were run as full backups. How should this (or something even close to this) be set up? When the disks were attached to the server, they would get different device names at different times, and I wouldn't like to manually edit config files each time. I'm sure someone has at least been thinking about this already, maybe also implemented this. So, can Bacula currently handle this kind of setup in a reasonable way? Regards, Timo -- Martin Schmid APS systems AG, Neumatt 4, CH-4626 Niederbuchsiten Tel direkt: +41 62 389 8891, Fax: +41 62 389 8880, Tel: +41 62 389 www.aps-systems.ch -- Check out the new SourceForge.net Marketplace. It is the best place to buy or sell services for just about anything Open Source. http://p.sf.net/sfu/Xq1LFB ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] best config for removeable disk backup
Hello Everybody I've set up a disk backup that replaces an autochanger. It is working but I'm not sure if it's configuration is well done. The main goals are: - any person should be able to swap the drives - the drives should contain a unique sticker that the person knows which drive to insert when bacula asks for a volume I've set up udev and autofs so that I can hot-swap the drives and that the drive always get the same device file. I've removed the file size restriction from the pool resource so that there should be only one file created The main problem I see is the fact that using autolabel there is a chance that bacula creates a second volume on the drive which may be requested later but is not visible on the sticker A second issue could be that having such a big file of a few hundred GB (I'm currently using 160GB disks) could be ineffective ...? Is there a 'good' way to set this up? I mean, the very best way would be if bacula could use /dev/mydrive directly like it uses a tape. Without any file system on it. Regards Martin Schmid -- Martin Schmid APS systems AG, Neumatt 4, CH-4626 Niederbuchsiten Tel direkt: +41 62 389 8891, Fax: +41 62 389 8880, Tel: +41 62 389 www.aps-systems.ch -- Check out the new SourceForge.net Marketplace. It is the best place to buy or sell services for just about anything Open Source. http://p.sf.net/sfu/Xq1LFB ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Volume Size Mismatch: please, help me understand this
Hello Everybody I'm running bacula for quite a while now and also for a quite a high volume on NAS devices. Most of it is running smootly but I do not understand _that_ volume recycling issue: The files are generally limited to 2G in size. From previous backups, the volume Vol_0058 has been filled up to 136660 bytes. Now, the volume is recycled: --snip-- 14-Nov 23:06 tormore-dir: There are no more Jobs associated with Volume Vol_0058. Marking it purged. 14-Nov 23:06 tormore-dir: All records pruned from Volume Vol_0058; marking it Purged 14-Nov 23:06 tormore-dir: Recycled volume Vol_0058 14-Nov 23:06 tormore-sd: Recycled volume Vol_0058 on device FileStorage (/mnt/storage/bacula), all previous data lost. --snip-- I expect the volume being reused leaving the size as it is. The job runs thru and terminates with 522,632,654 written bytes on that volume that still is 136660 bytes. --snip-- 14-Nov 23:11 tormore-sd: Job write elapsed time = 00:04:50, Transfer rate = 1.800 M bytes/second 14-Nov 23:11 tormore-dir: Bacula tormore-dir 2.2.4 (14Sep07): 14-Nov-2007 23:11:36 Build OS: i686-pc-linux-gnu debian 4.0 JobId: 929 Job:srv_to_File.2007-11-14_23.05.02 Backup Level: Incremental, since=2007-11-13 23:11:20 Client: tormore-fd 2.2.4 (14Sep07) i686-pc-linux-gnu,debian,4.0 FileSet:srv 2007-06-12 20:32:19 Pool: Default (From Job resource) Storage:File (From Job resource) Scheduled time: 14-Nov-2007 23:05:01 Start time: 14-Nov-2007 23:06:43 End time: 14-Nov-2007 23:11:36 Elapsed time: 4 mins 53 secs Priority: 10 FD Files Written: 407 SD Files Written: 407 FD Bytes Written: 522,170,750 (522.1 MB) SD Bytes Written: 522,232,428 (522.2 MB) Rate: 1782.2 KB/s Software Compression: None VSS:no Encryption: no Volume name(s): Vol_0058 Volume Session Id: 181 Volume Session Time:1191482842 Last Volume Bytes: 522,632,654 (522.6 MB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination:Backup OK 14-Nov 23:11 tormore-dir: Begin pruning Jobs. 14-Nov 23:11 tormore-dir: No Jobs found to prune. 14-Nov 23:11 tormore-dir: Begin pruning Files. 14-Nov 23:11 tormore-dir: No Files found to prune. 14-Nov 23:11 tormore-dir: End auto prune. --snip-- Now, the next job starts which should continue writing to Vol_0058. But look at this: --snip-- 14-Nov 23:11 tormore-dir: BeforeJob: run command /etc/bacula/scripts/make_catalog_backup bacula bacula bacula 14-Nov 23:11 tormore-dir: Start Backup JobId 930, Job=BackupCatalog.2007-11-14_23.10.00 14-Nov 23:11 tormore-dir: Using Device FileStorage 14-Nov 23:11 tormore-sd: Volume Vol_0058 previously written, moving to end of data. 14-Nov 23:11 tormore-sd: BackupCatalog.2007-11-14_23.10.00 Error: Bacula cannot write on disk Volume Vol_0058 because: The sizes do not match! Volume=136660 Catalog=522632654 14-Nov 23:11 tormore-sd: Marking Volume Vol_0058 in Error in Catalog. --snip-- So why doesn't bacula delete the file and recreate it when recycling - if it can't handle a volume that keeps its size? or Why does it write a volume size into the catalog that does not reflect the true file size on disk? I've already reported this as a bug but I was told this behaviour was correct, which I do not understand. Veritas which I'm also using doesn't provoke such mismatches... Can someone explain me why bacula is correct here? Regards Martin - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] automount with single non-autoloader drive
I've now moved to bacula 2.1.28 but it's all the same. Polling does
something but the tape is not mounted, and a manual mount always
works... Is there no 'mount after poll' at all?
Martin Schmid schrieb:
has someone managed to use automatic mount and unmount just by configuring
the storage daemon the 'right' way with a bacula 2.0.3 (maybe on Debian
Linux)?
The goal is that the media change shall be sufficient for the normal
backup to work. No manual intervention at all shall be needed.
The closest I get is that tape gets ejected automatically when a new or
specific tape is needed. When I then insert the right tape, it gets
recognized at the next poll interval, which I have set to 3 minutes, but it
doesn't get mounted. Bacula then says that there is a tape in the drive
and the
drive is open, but it is not recognized: 'open but no Bacula volume is
currently mounted.'
Why does the 'Automatic Mount' not work when the device is opened at a poll?
Or, is it a known bug?
I've tested with several tape drives of several brands but all were DAT.
I've also tested on several servers but only with bacula 2.0.3. An I don't
have a changer.
I know that there were approaches using simulated changers with bacula 1.38,
but I'd prefer something less limiting...
My conf for the device:
Device {
Name = DDS-2 #
Media Type = DDS-2
Archive Device = /dev/nst0
Automatic Mount = yes; # when device opened, read it
Label Media = yes; # lets Bacula label unlabeled media
Always Open = yes;
Removable Media = yes;
Random Access = no;
#Maximum Changer Wait = 3d # 3 days in seconds
#Changer Command = /etc/bacula/scripts/ak-mtx-changer %c %o %S %a %d
#Changer Device = /dev/nst0
Offline On Unmount = Yes; # keep this too
Volume Poll Interval = 3m
#Close on Poll= Yes
Maximum Open Wait = 3d
#Auto Changer = yes
# Enable the Alert command only if you have the mtx package loaded
#Alert Command = sh -c 'tapeinfo -f /dev/nst0 |grep TapeAlert|cat'
#If you have smartctl, enable this, it has more info than tapeinfo
## Alert Command = sh -c 'smartctl -H -l error %c'
}
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] automount with single non-autoloader drive
has someone managed to use automatic mount and unmount just by configuring
the storage daemon the 'right' way with a bacula 2.0.3 (maybe on Debian
Linux)?
The goal is that the media change shall be sufficient for the normal
backup to work. No manual intervention at all shall be needed.
The closest I get is that tape gets ejected automatically when a new or
specific tape is needed. When I then insert the right tape, it gets
recognized at the next poll interval, which I have set to 3 minutes, but it
doesn't get mounted. Bacula then says that there is a tape in the drive
and the
drive is open, but it is not recognized: 'open but no Bacula volume is
currently mounted.'
Why does the 'Automatic Mount' not work when the device is opened at a poll?
Or, is it a known bug?
I've tested with several tape drives of several brands but all were DAT.
I've also tested on several servers but only with bacula 2.0.3. An I don't
have a changer.
I know that there were approaches using simulated changers with bacula 1.38,
but I'd prefer something less limiting...
My conf for the device:
Device {
Name = DDS-2 #
Media Type = DDS-2
Archive Device = /dev/nst0
Automatic Mount = yes; # when device opened, read it
Label Media = yes; # lets Bacula label unlabeled media
Always Open = yes;
Removable Media = yes;
Random Access = no;
#Maximum Changer Wait = 3d # 3 days in seconds
#Changer Command = /etc/bacula/scripts/ak-mtx-changer %c %o %S %a %d
#Changer Device = /dev/nst0
Offline On Unmount = Yes; # keep this too
Volume Poll Interval = 3m
#Close on Poll= Yes
Maximum Open Wait = 3d
#Auto Changer = yes
# Enable the Alert command only if you have the mtx package loaded
#Alert Command = sh -c 'tapeinfo -f /dev/nst0 |grep TapeAlert|cat'
#If you have smartctl, enable this, it has more info than tapeinfo
## Alert Command = sh -c 'smartctl -H -l error %c'
}
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Automated eject and automated mount of tapes
Unfortumately I cannot access the mail archive and censequently I cannot find out whether the answer has already been given. I have a DDS-3 DAT and it should eject as soon as a new tape is requested and the new tape should be mounted automatically. I have a configuration that does all this except that it does not read the fresh tape correctly. The tape is correctly ejected and the drive is then polled at intervals. The new tape is then actually detected but then the storage daemon falls into a status 'Device DDS-2 (/dev/nst0) open but no Bacula volume is currently mounted.'. But it actually _is_ a bacula volume and a simple mount in bconsole makes the job continue. What is the correct combination of configurations to accomplish this - if possible at all? I found some mails addressing versions 1.31 or 1.38 but I am using 2.0.3... Best Regards, Martin This is my config: Automatic Mount = yes; # when device opened, read it Label Media = yes; # lets Bacula label unlabeled media Always Open = no; Volume Poll Interval = 5m Close on Poll= Yes; Removable Media = yes; Random Access = no; Maximum Open Wait = 3d # 3 days in seconds Offline On Unmount = Yes; # keep this too - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
