Re: [Bacula-users] Bacula recycles Volumes instead of creating new ones
Hi List! John Drescher schrieb: On Fri, Oct 10, 2008 at 11:39 AM, John Drescher [EMAIL PROTECTED] wrote: On Fri, Oct 10, 2008 at 11:06 AM, Kjetil Torgrim Homme [EMAIL PROTECTED] wrote: Marc Richter [EMAIL PROTECTED] writes: Further, I want to know, why bacula recycles Volumes (which destroys data) instead of creating new ones and if this is a Bug which should be reported. I believe this is intended behaviour, and it's the behaviour I want. after all, when I tell Bacula I want to keep that backup for 180 days, that's what I actually mean, and I don't want Bacula to start using a fresh tape when an old tape can be recycled instead. (Note, Bacula should only recycle media which is present and available without human interaction.) OK, it's correct, that Bacula can per configuration choose free between recycling outimed volumes or label a new one. Neither the Outtimed ones, nor the new ones should contain any data that is still needed. If so, the Retention Period is defined to short... But: In our company, the Storage is a NAS and each Volume is a 4GB file. Noone has to change any tapes and I think, that the most people responsible for backups have any mechanism to NOT have to sit in the company at Saturday 3 am because there's the next tape to change ... Bacula's logic of Tapes, Pools and Storages is a great way to handle media, but I'd like to be able to configure the following scenario: When there's a storage with 3 TB space available, and the data to backup is not more than let's say 40 GB per day, and the volume retention period is configured to 1 month, then after 31 days, the (uncompressed) backups would be 1240 GB of size. As everyone knows, data on productive Servers rather grow than shrink. So while you can say that a 3 TB storage can master 2 months of backup easily during an daily backup amount of 40 GB (=1240 GB a month), that isn't true anymore if it grows to ... let's say 50 GB a day (50GB*31days=1550 GB / month ). So, in this case, I think it would be better to tell bacula First fill up all the volumes you can, and only if there's no new Volume available anymore, go on recycling the outdated ones.. Espacially when doing incremental or differential backups ist's quite difficult to determine how much backup space will be needed and how long backups may last until they will have to become recycled because the volumes are needed for new backups. I hope I could explain what I mean detailed enough ... so it would be great to have an option to controll this behavior. For example, on an per storage based option to choose between First use ALL the volumes before recycling old ones or recycle the old ones prior to label new ones . Wouldn't that be a better way than the actual one? No, this is definitely not intended behavior. Bacula is supposed to protect media for how ever long you specify in your volume retention period. Sorry, I am wrong. I was thinking of a different thread where the user had volumes being recycled way before the retention period expired. John - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Marketing Factory Consulting GmbH * mailto:[EMAIL PROTECTED] Stephanienstrasse 36 * Tel.: +49 211-361176-44 D-40211 Duesseldorf, Germany * Fax : +49 211-361176-45 Amtsgericht Duesseldorf HRB 53971 * http://www.marketing-factory.de/ Geschaeftsfuehrer: Peter Faisst | Katja Faisst Karoline Steinfatt | Christoph Allefeld | Markus M. Kimmel - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Deleting from disk based pool
Hi, I'm backing to disk based storage, every volume has maximum count set to one job, so every pool has one file per job. Each pool is configured with recycle period and volume count so it can hold just enough volumes/jobs. For example for 7 daily full backups I have pool with maximum 7 volumes and 6 days retention period. However I need sometimes to delete some older backups by hand, because of low disk space, or because we sometimes manually run the backup and it breaks the schema (the last backup is not old enough to be recycled). I would like to ask whether there is a possibility to manually recycle volume from console and/or if there is a way how to tell Bacula that I've deleted some particular volume and that it should remove it from catalog? Radek - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Catalog backup retention
Hi, I would like to ask how should I recycle catalog backups. I am using disk based storage and catalog pool is by default set to half-year or so long retention period. I would think, that week would be more than sufficient. What is old catalog backup good for? I mean if I have catalog backup older that data backup I would need to run bscan from scratch. Otherwise more recent data would not be recognized by Bacula and on the other hand there may be data in catalog which are not in data backups any more... Radek - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Command on media change request from SD
The storage daemon has some possibilities to run external commands such as 'Mount Command', 'Alert Command', etc. Is there an option that allows to run an external command when the storage daemon requires change of media? Example: I get the following message from the storage daemon asking to change the media. 13-Oct 14:08 lexington-dir JobId 109: Start Backup JobId 109, Job=Lexington_Dayly.2008-10-13_14.08.03 13-Oct 14:08 lexington-dir JobId 109: Using Device IOMEGA-REV-DISK 13-Oct 14:08 lexington-sd JobId 109: Please mount Volume TAG-4 or label a new one for: Job: Lexington_Dayly.2008-10-13_14.08.03 Storage: IOMEGA-REV-DISK (/media/iomega-rev-disk) Pool: Day Pool Media type: REV-120GB When this message appears I would like to run an external command. Did I miss something in the documentation or is this not possible with bacula version 2.4.2? Many thanks, Felix - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] automatically pruning the loaded volume
I'm still wrestling with my problem of Bacula requesting a different volume although the one already loaded is eligible to be recycled. [1] As I cannot find a solution to the root problem I am now thinking about workarounds. One idea I'm currently pursuing is to preventively prune every volume after mounting it. What I'd need for that is a way to issue from a script a prune command for the volume which is currently loaded in a specific standalone tape drive. Unfortunately the prune command of bconsole requires the volume name to be specified. Any ideas how to specify currently mounted volume there? Note that the AutoPrune configuration directive does not help, because it doesn't work in the presence of appendable but inaccessible volumes in the pool. Thanks in advance, Tilman [1] For details, see my postings: Date: Fri, 16 May 2008 12:20:59 +0200 Subject: Repost: mounted tape not accepted if another one has already been recycled Date: Fri, 08 Aug 2008 18:26:51 +0200 Subject: Prune command does nothing unless the pool is requested? -- Tilman Schmidt Phoenix Software GmbH Bonn, Germany signature.asc Description: OpenPGP digital signature - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Command on media change request from SD
Hi 13-Oct 14:08 lexington-dir JobId 109: Start Backup JobId 109, Job=Lexington_Dayly.2008-10-13_14.08.03 13-Oct 14:08 lexington-dir JobId 109: Using Device IOMEGA-REV-DISK 13-Oct 14:08 lexington-sd JobId 109: Please mount Volume TAG-4 or label a new one for: Job: Lexington_Dayly.2008-10-13_14.08.03 Storage: IOMEGA-REV-DISK (/media/iomega-rev-disk) Pool: Day Pool Media type: REV-120GB When this message appears I would like to run an external command. Did I miss something in the documentation or is this not possible with bacula version 2.4.2? I've also been looking for this. I would like to do things like unmount and eject of my media when it asks for this -- Adrian Moisey Systems Administrator | CareerJunction | Your Future Starts Here. Web: www.careerjunction.co.za | Email: [EMAIL PROTECTED] Phone: +27 21 818 8621 | Mobile: +27 82 858 7830 | Fax: +27 21 818 8855 - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] aximum size for LTO4
Richerland Medeiros wrote: Hi everyone ! How do I use the default compression hardware native of LTO4? I believe this down to your drive, not bacula, so you should check the documentation for the drive. I have 1.4 TB of data and the tape is full when it comes to 900GB. As the uncompressed capacity of the drive is 800GB, if you are getting 900GB on, it sounds like you are already using compression. The 1600GB quoted figure figure assumes a compression ratio of 2:1, which is rather can be rather optimistic depending on the data that you are trying to back up. -- Chris Howells [EMAIL PROTECTED] Senior SysAdmin - Transitive Ltd. http://www.transitive.com - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] aximum size for LTO4
Richerland Medeiros wrote: Hi everyone ! How do I use the default compression hardware native of LTO4? I have 1.4 TB of data and the tape is full when it comes to 900GB. LTO4 tapes are 800gb. If you're already getting 900gb out of a tape, you may find that you're already using compression - if the data is already compressed, it won't compress much more. You should consider use a tape changer or perhaps archiving your data? HTH SG - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] aximum size for LTO4
On Mon, 13 Oct 2008, Richerland Medeiros wrote: How do I use the default compression hardware native of LTO4? I have 1.4 TB of data and the tape is full when it comes to 900GB. You are using the default compression already, else it would be full at ~795Gb Compression only works on compressable data. Whatever you are putting on the tape has already been compressed. 2:1 compression claims are very optimistic and must be dismissed as marketing puffery. Most of us find that the real average is 1.2:1 on a full backup and higher on incrementals (logfiles are _very_ compressable) The only safe way to estimate how many tapes are needed for any given backup is to use the native capacity of the tape. Compression is a bonus which means you may use fewer, but don't count on it. AB - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] aximum size for LTO4
Hi everyone ! How do I use the default compression hardware native of LTO4? I have 1.4 TB of data and the tape is full when it comes to 900GB. Sorry for my bad English. Thank you. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] filesystem for disk backups
Hi, 13.10.2008 11:01, Lucio Crusca wrote: Hello *, I'm about to configure Bacula 2.4.2 on a Debian Lenny server. It will backup on external usb disks (500GB each, the full backup is 60GB more or less). What's the best choice for the filesystem? A question you can discuss forever :-) or just ignore... Personally, I typically use ext2 or FAT32, depending on needs. Journaling is - often - not very useful here, as it slows down throughput even more, and as long as you don't journal the actual data doesn't help you much in case of failure - I don't only need filesystem integrity for backups, I need to be sure of the actual file data. Thus, IMO, un-journaled file systems are ok for backup purposes. Is there one that maximizes available space? Can I just give bacula the whole partition /dev/sdg1 unformatted? Bacula needs a file system to work on. You could save partitioning, though (use /dev/sdg as a whole) but Iw ouldn't recommend that as it confuses others who need to access that disk. You can tweak the ext2/3 filesystems to create a minimal number of inodes, which is ok if you expect to store only large files. That saves a bit of the capacity. You can also set the reserved blocks to 0. If you need to be able to use the backups on windows machines, FAT32 is the most reasonable FS, unless you trust the linux NTFS drivers. None of these FSes can be tweaked for maximum net capacity as far as I know. Short answer: Use whatever you're comfortable with, and keep in mind that journaling can negatively affect performance and might not gain you any data security. Arno Thanks in advance, Lucio. -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] label header problem.
Hi all, I have to recover some files from a tape but, after loading the tape, bacula cannot mount it. Opening the device with hexer I find in beginning of tape a session/jobs headers but no volume header this is the output of strings command with device in position 0: BB02 4Bacula 1.0 immortal w2k3-ap-nas1.porto.laspezia.it-data-pool Backup BACKUP w2k3-ap-nas1.porto.laspezia.it-data w2k3-ap-nas1.porto.laspezia.it-fd BACKUP_w2k3-ap-nas1.porto.laspezia.it-data.2008-05-23_23.05.15 w2k3-ap-nas1.porto.laspezia.it-data-fileset BTW, looking in logs backup w2k3-ap-nas1.porto.laspezia.it-data.2008-05-23_23.05.15 is not the 1st backup on the volume... It should be the 9th! The tape library is HP Ultrium-3 400/800Gb Build OS: Linux Cross-compile Win32 JobId: 9 Job: BACKUP_w2k3-ap-nas1.porto.laspezia.it-data.2008-05-23_23.05.15 Backup Level: Incremental, since=2008-05-22 23:05:02 Client: w2k3-ap-nas1.porto.laspezia.it-fd 2.2.9-b6 (06Apr08) Linux,Cross-compile,Win32 FileSet:w2k3-ap-nas1.porto.laspezia.it-data-fileset 2008-05-20 09:59:27 Pool: w2k3-ap-nas1.porto.laspezia.it-data-pool (From Job resource) Storage:TapeDrive (From Job resource) Scheduled time: 23-May-2008 23:05:00 Start time: 23-May-2008 23:05:02 End time: 23-May-2008 23:56:31 Elapsed time: 51 mins 29 secs Priority: 10 FD Files Written: 9,186 SD Files Written: 9,186 FD Bytes Written: 45,804,354,704 (45.80 GB) SD Bytes Written: 45,806,468,610 (45.80 GB) Rate: 14828.2 KB/s Software Compression: None VSS:yes Storage Encryption: no Volume name(s): w2k3-ap-nas1.porto.laspezia.it-data-0001 Volume Session Id: 9 Volume Session Time:1211270345 Last Volume Bytes: 551,417,416,704 (551.4 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination:Backup OK I've really no idea about I got this But it was my 1st backup with bacula on tape, so my-human errror is the really probable! I need to recover a file in Jobid 14 [It should be in this volume] but with bacula console, bls or bextract I can't get any good result, because they are looking for a valid volume header. Is there any utility to low-level recover file from a volume regardless volume or jobs? I want try to relabel the tape with w2k3-ap-nas1.porto.laspezia.it-data-0001? Do you think it could work? Remember that the important job is not the 1st on the tape (JobId: 9) but the Job Id: 14. Tnz 4 bacula. Regards Marco - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog backup retention
On Mon, Oct 13, 2008 at 7:33 AM, Radek Hladik [EMAIL PROTECTED] wrote: Hi, I would like to ask how should I recycle catalog backups. I am using disk based storage and catalog pool is by default set to half-year or so long retention period. I would think, that week would be more than sufficient. What is old catalog backup good for? I mean if I have catalog backup older that data backup I would need to run bscan from scratch. Otherwise more recent data would not be recognized by Bacula and on the other hand there may be data in catalog which are not in data backups any more... I do not keep more than a month or so. However the server I have them on is not were my regular backups go so I have tons of space there. John - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deleting from disk based pool
On Mon, Oct 13, 2008 at 7:26 AM, Radek Hladik [EMAIL PROTECTED] wrote: Hi, I'm backing to disk based storage, every volume has maximum count set to one job, so every pool has one file per job. Each pool is configured with recycle period and volume count so it can hold just enough volumes/jobs. For example for 7 daily full backups I have pool with maximum 7 volumes and 6 days retention period. However I need sometimes to delete some older backups by hand, because of low disk space, or because we sometimes manually run the backup and it breaks the schema (the last backup is not old enough to be recycled). I would like to ask whether there is a possibility to manually recycle volume from console and/or if there is a way how to tell Bacula that I've deleted some particular volume and that it should remove it from catalog? use the delete volume command in a bacula console then delete the volume manually on disk. John - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deleting from disk based pool
John Drescher napsal(a): On Mon, Oct 13, 2008 at 7:26 AM, Radek Hladik [EMAIL PROTECTED] wrote: Hi, I'm backing to disk based storage, every volume has maximum count set to one job, so every pool has one file per job. Each pool is configured with recycle period and volume count so it can hold just enough volumes/jobs. For example for 7 daily full backups I have pool with maximum 7 volumes and 6 days retention period. However I need sometimes to delete some older backups by hand, because of low disk space, or because we sometimes manually run the backup and it breaks the schema (the last backup is not old enough to be recycled). I would like to ask whether there is a possibility to manually recycle volume from console and/or if there is a way how to tell Bacula that I've deleted some particular volume and that it should remove it from catalog? use the delete volume command in a bacula console then delete the volume manually on disk. John Thanks for your advice. I tried this command once, it warned me with something like Deleting data is genraly bad idea and I think that there were some warnings in backup reports afterwards. But if this is the correct way how to do it, I will try it more thorough... Radek - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog backup retention
John Drescher napsal(a): On Mon, Oct 13, 2008 at 7:33 AM, Radek Hladik [EMAIL PROTECTED] wrote: Hi, I would like to ask how should I recycle catalog backups. I am using disk based storage and catalog pool is by default set to half-year or so long retention period. I would think, that week would be more than sufficient. What is old catalog backup good for? I mean if I have catalog backup older that data backup I would need to run bscan from scratch. Otherwise more recent data would not be recognized by Bacula and on the other hand there may be data in catalog which are not in data backups any more... I do not keep more than a month or so. However the server I have them on is not were my regular backups go so I have tons of space there. John I have no problem with backing up catalog on other server with less expensive storage space. But I do not see any use of old catalog backups at all. I would do bscan into new catalog in all cases except the one, where I have catalog backup newer than last data backed up and I need to recover it. I.e. database server crash or something like that. In all other cases I would not risk the possible complications... Radek - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] (no subject)
Hi everyone ! How do I use the default compression hardware native of LTO4? I have 1.4 TB of data and the tape is full when it comes to 900GB. Sorry for my bad English. Thank you. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog backup retention
John Drescher napsal(a):
I have no problem with backing up catalog on other server with less
expensive storage space. But I do not see any use of old catalog backups at
all. I would do bscan into new catalog in all cases except the one, where
I have catalog backup newer than last data backed up and I need to recover
it. I.e. database server crash or something like that. In all other cases I
would not risk the possible complications...
A couple of years ago I had a database corruption issue where the
database had become corrupt and I did not notice that for over 1 week.
The catalog backup and some other backups were running fine but others
were failing. If I did not have more than 1 week of catalogs it would
have been much harder to recover being that 200 volumes or so and
manually scanning to recover the catalog would have taken months. One
other thing I recommend. Always have a bootstrap file for your
catalogs. I have mine named so that each day I get a new bootstrap
file and that file has the jobid in its name.
Job {
Name = BackupCatalog
Type = Backup
Client = dev6-fd
FileSet = Catalog
Schedule = WeeklyCycleAfterBackup
Storage = File
Messages = Standard
Pool = BackupCatalogs
ClientRunBeforeJob = /usr/libexec/bacula/make_catalog_backup bacula
hbroker hbroker
ClientRunAfterJob = /usr/libexec/bacula/delete_catalog_backup
WriteBootstrap = /mnt/vg/backups/BootStrap/%n_%i.bsr
}
John
I keep the bootstrap file too, and I think that this is a good idea.
I am using only disk backups and all jobs are stored in separate files.
Therefore I thought that bscan should not take significantly more time
than reading all backup files once.
I tried this as I've tested Bacula. I used one machine's backup file,
empty machine, livecd with bacula binaries and nothing else. I scanned
the file into the new catalog and restored the machine. The scanning has
been reasonably fast.
We have a few hundreds gigs of backups and with cca 50MB/s it should
scan like 100GB in half an hour. Thats why I think scanning all backups
would be more reasonable than using old catalog...
Radek
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] filesystem for disk backups
Hello *, I'm about to configure Bacula 2.4.2 on a Debian Lenny server. It will backup on external usb disks (500GB each, the full backup is 60GB more or less). What's the best choice for the filesystem? Is there one that maximizes available space? Can I just give bacula the whole partition /dev/sdg1 unformatted? Thanks in advance, Lucio. -- Virtual Bit di Lucio Crusca http://www.virtual-bit.com - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deleting from disk based pool
However I need sometimes to delete some older backups by hand, because of low disk space, or because we sometimes manually run the backup and it breaks the schema (the last backup is not old enough to be recycled). I would like to ask whether there is a possibility to manually recycle volume from console and/or if there is a way how to tell Bacula that I've deleted some particular volume and that it should remove it from catalog? use the delete volume command in a bacula console then delete the volume manually on disk. John Thanks for your advice. I tried this command once, it warned me with something like Deleting data is genraly bad idea and I think that there were some warnings in backup reports afterwards. But if this is the correct way how to do it, I will try it more thorough... After rereading this I believe you do not really want to delete the volumes just make them available for a new job before the retention period as elapsed. For this just use the purge command from bconsole and follow the prompts. Do not delete the catalog file from disk. Bacula will then reuse this volume in the next backup from that pool when it needs a new volume. John - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog backup retention
I have no problem with backing up catalog on other server with less
expensive storage space. But I do not see any use of old catalog backups at
all. I would do bscan into new catalog in all cases except the one, where
I have catalog backup newer than last data backed up and I need to recover
it. I.e. database server crash or something like that. In all other cases I
would not risk the possible complications...
A couple of years ago I had a database corruption issue where the
database had become corrupt and I did not notice that for over 1 week.
The catalog backup and some other backups were running fine but others
were failing. If I did not have more than 1 week of catalogs it would
have been much harder to recover being that 200 volumes or so and
manually scanning to recover the catalog would have taken months. One
other thing I recommend. Always have a bootstrap file for your
catalogs. I have mine named so that each day I get a new bootstrap
file and that file has the jobid in its name.
Job {
Name = BackupCatalog
Type = Backup
Client = dev6-fd
FileSet = Catalog
Schedule = WeeklyCycleAfterBackup
Storage = File
Messages = Standard
Pool = BackupCatalogs
ClientRunBeforeJob = /usr/libexec/bacula/make_catalog_backup bacula
hbroker hbroker
ClientRunAfterJob = /usr/libexec/bacula/delete_catalog_backup
WriteBootstrap = /mnt/vg/backups/BootStrap/%n_%i.bsr
}
John
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] automatically pruning the loaded volume
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I would strongly recommend not pursuing workarounds. This part of the software works just fine. I believe if your retention settings are correct, the pruning will happen by itself after a mount, and if they aren't no amount of manual pruning will save you. Tilman Schmidt wrote: I'm still wrestling with my problem of Bacula requesting a different volume although the one already loaded is eligible to be recycled. [1] As I cannot find a solution to the root problem I am now thinking about workarounds. One idea I'm currently pursuing is to preventively prune every volume after mounting it. What I'd need for that is a way to issue from a script a prune command for the volume which is currently loaded in a specific standalone tape drive. Unfortunately the prune command of bconsole requires the volume name to be specified. Any ideas how to specify currently mounted volume there? Note that the AutoPrune configuration directive does not help, because it doesn't work in the presence of appendable but inaccessible volumes in the pool. Thanks in advance, Tilman [1] For details, see my postings: Date: Fri, 16 May 2008 12:20:59 +0200 Subject: Repost: mounted tape not accepted if another one has already been recycled Date: Fri, 08 Aug 2008 18:26:51 +0200 Subject: Prune command does nothing unless the pool is requested? - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer II |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFI83/rmb+gadEcsb4RAvtlAJwNLrCVjejsdI0XaMGfDXSLug0f8QCeIA68 8Reo47fs7itgqigz5r/zHxI= =0FfE -END PGP SIGNATURE- - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Device is BLOCKED waiting to create a volume for..
When i try to connect bconsole to storage data i have this replay: Device FileStorage (/media/sdb1/bacula) is not open. Device is BLOCKED waiting to create a volume for: Pool:Default Media type: File What does it means?? - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device is BLOCKED waiting to create a volume for..
Hi, 13.10.2008 22:38, subbustrato wrote: When i try to connect bconsole to storage data i have this replay: Device FileStorage (/media/sdb1/bacula) is not open. Device is BLOCKED waiting to create a volume for: Pool:Default Media type: File What does it means?? It means that there is no usable volume available, and so Bacula asks you to create a new one. Arno -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device is BLOCKED waiting to create a vo lume for..
Arno Lehmann al at its-lehmann.de writes:
Hi,
13.10.2008 22:38, subbustrato wrote:
When i try to connect bconsole to storage data i have this replay:
Device FileStorage (/media/sdb1/bacula) is not open.
Device is BLOCKED waiting to create a volume for:
Pool:Default
Media type: File
What does it means??
It means that there is no usable volume available, and so Bacula asks
you to create a new one.
Arno
thanks for your answer,
How i can create a new volume available?
now the storage definition in bacula-dir.conf is:
Storage {
Name = File
Address = localhost
SDPort = 9103
Password = bacula
Device = FileStorage
Media Type = File
}
and in bacula-sd.conf i have this device definition:
Device {
Name = FileStorage
Media Type = File
Archive Device = /media/sdb1/bacula
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes;
RemovableMedia = no;
AlwaysOpen = yes;
}
There is somethings wrong?
Could you show me the manual's page where i can find the solution of my problem?
bye ;)
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device is BLOCKED waiting to create a volume for..
Hi,
13.10.2008 23:32, subbustrato wrote:
Arno Lehmann al at its-lehmann.de writes:
Hi,
13.10.2008 22:38, subbustrato wrote:
When i try to connect bconsole to storage data i have this replay:
Device FileStorage (/media/sdb1/bacula) is not open.
Device is BLOCKED waiting to create a volume for:
Pool:Default
Media type: File
What does it means??
It means that there is no usable volume available, and so Bacula asks
you to create a new one.
Arno
thanks for your answer,
How i can create a new volume available?
Use the 'label' command in bconsole.
now the storage definition in bacula-dir.conf is:
Storage {
Name = File
Address = localhost
SDPort = 9103
Password = bacula
Device = FileStorage
Media Type = File
}
and in bacula-sd.conf i have this device definition:
Device {
Name = FileStorage
Media Type = File
Archive Device = /media/sdb1/bacula
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes;
RemovableMedia = no;
AlwaysOpen = yes;
}
There is somethings wrong?
No, nothing obvious to me.
Could you show me the manual's page where i can find the solution of my
problem?
Well, there are several locations...
http://www.bacula.org/manuals/en/console/console/Bacula_Console.html
(search for label)
http://www.bacula.org/manuals/en/install/install/Getting_Started_with_Bacula.html#SECTION0042
gives information what a pool and a volume are.
http://www.bacula.org/manuals/en/install/install/Configuring_Director.htm
(again, search for label) Also read the descriptions regarding
retention, recycling, and so on.
In fact, you should read most of the manual :-)
Arno
bye ;)
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück
www.its-lehmann.de
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] waiting on max storage jobs
Brand spankin new to Bacula... I like what I see so far.
I googled and looked through the archives and couldn't find anything
helpful. Anyway, I have a autochanger with 4 AIT-3 drives but it seems if I
start multiple jobs it will only run one job on the first drive and any job
after will sit with a status of waiting on max storage jobs. I guess I
expected the behavior to start any subsiquent jobs on the other three
drives. Am I wrong in my thinking? I suspected that perhaps Maximum
Concurrent Jobs would have something to do with it, but that is set to
four... So I'm stumped and looking for some help... Any suggestions?
Bacula version 2.0.3 on Centos 5.2, the RPM is from the EPEL Repository.
bacula-dir.conf
Director {# define myself
Name = bacula-dir
DIRport = 9101# where we listen for UA connections
QueryFile = /etc/bacula/query.sql
WorkingDirectory = /var/spool/bacula
PidDirectory = /var/run
Maximum Concurrent Jobs = 4
Password = # Console password
Messages = Daemon
}
bacula-sd.conf
Storage { # definition of myself
Name = bacula-sd
SDPort = 9103 # Director's port
WorkingDirectory = /var/spool/bacula
Pid Directory = /var/run
Maximum Concurrent Jobs = 20
Heartbeat Interval = 30 sec;
}
Thanks for any help,
Dave
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] waiting on max storage jobs
Dave Poirier wrote:
Brand spankin new to Bacula... I like what I see so far.
I googled and looked through the archives and couldn't find anything
helpful. Anyway, I have a autochanger with 4 AIT-3 drives but it seems
if I start multiple jobs it will only run one job on the first drive and
any job after will sit with a status of waiting on max storage jobs.
I guess I expected the behavior to start any subsiquent jobs on the
other three drives. Am I wrong in my thinking? I suspected that perhaps
Maximum Concurrent Jobs would have something to do with it, but that
is set to four... So I'm stumped and looking for some help... Any
suggestions?
Read the section on concurrent jobs (I'm sure there is one, but I
haven't checked recently). Then realize that the SD and the FD also
have similar settings for the number of concurrent jobs they can run. I
suggest you need to set a value on the SD, at least.
Bacula version 2.0.3 on Centos 5.2, the RPM is from the EPEL Repository.
bacula-dir.conf
Director {# define myself
Name = bacula-dir
DIRport = 9101# where we listen for UA connections
QueryFile = /etc/bacula/query.sql
WorkingDirectory = /var/spool/bacula
PidDirectory = /var/run
Maximum Concurrent Jobs = 4
Password = # Console password
Messages = Daemon
}
bacula-sd.conf
Storage { # definition of myself
Name = bacula-sd
SDPort = 9103 # Director's port
WorkingDirectory = /var/spool/bacula
Pid Directory = /var/run
Maximum Concurrent Jobs = 20
Heartbeat Interval = 30 sec;
}
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Alert: TapeAlert[25]:Undefined.
Hi Arno: As you actually get TapeAlterts regarding the SCSI interfaces, I would recommend trying a different cable and terminator anyway. Firstly, sorry for late replies. I was busy with other stuffs. I've asked for an exchange of the cable and terminator, the problem still doesn't seem to go away still. scsi 3:0:4:1: Medium ChangerHP 1x8 G2 AUTOLDR 1.70 PQ: 0 ANSI: 5 From lspci: 03:02.0 SCSI storage controller: LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI (rev 07) That is an HBA I don't have access to. But the LSI controllers and drivers have a reputation of reliability and very good linux support. One thing to consider is that using a RAID HBA for tape drives often doesn't work very well. As I don't know if your HBA does include internal RAID functions, you should verify that first. If you find you're using a RAID-enabled HBA, it might be worthwile trying a different, simpler HBA. Alternatively, you could try to explicitly disable the RAID functionality - I *believe* this is possible with the LSI FusionMPT compatible HBAs. I don't think my HBA have RAID. Its exactly the one listed at: http://h18004.www1.hp.com/products/servers/proliantstorage/adapters/133mhz-dual/ 64-bit/133 MHz U320 SCSI HBA (PCI-X) My OS is: Debian Sarge Kernel 2.6.22-3-686 The SCSI card is from Hewlett Packard, but the chipset is LSI. I think i did not install any drivers for it as the OS auto detects the card. Could it be the problem?? I don't think so. Arno The OS that i'm using is Debian, but at the HBA support site: http://h2.www2.hp.com/bizsupport/TechSupport/DriverDownload.jsp?lang=encc=usprodNameId=332403prodSeriesId=332401prodTypeId=329290taskId=135swLang=8 There are only drivers for Redhat, Suse but not Debian. By default, my Debian auto detect the HBA. Should i install the drivers using the RPM package from Redhat? I'm out of ideas here :( - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
