Re: [Bacula-users] Archive function ?
Op 20110527 om 20:44 schreef Radosław Korzeniewski: 2011/5/27 John Drescher dresche...@gmail.com 2011/5/27 Robert Kromoser robert.kromo...@kinamu.com: [ delete files after backup ] Does exist any configuration option for that? No. Not yet... :) IMNSHO it allready exists, it is named 'RunAfterJob' Stappers -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
On Mon, 30 May 2011 09:05:21 +0200, Geert Stappers geert.stapp...@vanadgroup.com wrote: Op 20110527 om 20:44 schreef Radosław Korzeniewski: 2011/5/27 John Drescher dresche...@gmail.com 2011/5/27 Robert Kromoser robert.kromo...@kinamu.com: [ delete files after backup ] Does exist any configuration option for that? No. Not yet... :) IMNSHO it allready exists, it is named 'RunAfterJob' Stappers Hello, That's not true. An archive function would only delete files which have been archived successfully. Performing an simple rm will not provide the same feature. As it will delete any file. HTH. Jérôme Blion. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
Il 27/05/2011 16:32, Robert Kromoser ha scritto: Hi folks. Does exist any archive function in bacula. What do I mean? On a Backup the backed up data from a Fileset will stay on the filesystem after the backup. With an archive function the backed up data from the Fileset will be removed from the filesystem. Does exist any configuration option for that? br Robert -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users I think you should look into file and job retention periods. -- Marcello Romani -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
On Mon, 30 May 2011 09:24:06 +0200 Jérôme Blion jerome.bl...@free.fr wrote: [ delete files after backup ] Does exist any configuration option for that? No. Not yet... :) IMNSHO it allready exists, it is named 'RunAfterJob' That's not true. An archive function would only delete files which have been archived successfully. Performing an simple rm will not provide the same feature. As it will delete any file. I don't see a real problem statement here: a job backs up a set of files defined by a specific fileset, and if the said job completes without errors, you're safe to `rm' every file referred to by that fileset. P.S. I'm not against the imaginary archive function, just trying to clear things up. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
On Mon, 30 May 2011 12:41:14 +0400, Konstantin Khomoutov flatw...@users.sourceforge.net wrote: On Mon, 30 May 2011 09:24:06 +0200 Jérôme Blion jerome.bl...@free.fr wrote: [ delete files after backup ] Does exist any configuration option for that? No. Not yet... :) IMNSHO it allready exists, it is named 'RunAfterJob' That's not true. An archive function would only delete files which have been archived successfully. Performing an simple rm will not provide the same feature. As it will delete any file. I don't see a real problem statement here: a job backs up a set of files defined by a specific fileset, and if the said job completes without errors, you're safe to `rm' every file referred to by that fileset. P.S. I'm not against the imaginary archive function, just trying to clear things up. Hello, If a file to archive has been created after the files list creation, you will remove it without archiving it. HTH. Jerome Blion. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
On Mon, 30 May 2011 11:41:38 +0200 Jérôme Blion jerome.bl...@free.fr wrote: [ delete files after backup ] Does exist any configuration option for that? No. Not yet... :) IMNSHO it allready exists, it is named 'RunAfterJob' That's not true. An archive function would only delete files which have been archived successfully. Performing an simple rm will not provide the same feature. As it will delete any file. I don't see a real problem statement here: a job backs up a set of files defined by a specific fileset, and if the said job completes without errors, you're safe to `rm' every file referred to by that fileset. [...] If a file to archive has been created after the files list creation, you will remove it without archiving it. Well, isn't it just about not using `rm *' or whatever? To present a real example: among other things, I'm using Bacula to back up an ever-growing set of voice conversation records created by the call-center software we're using. The job of archiving freshly created records is performed once a day and it goes like this: 1) A run before job script uses `find' to create a list of files to archive--the list is just a plain text file with one filename per line. 2) The fileset resource for the job uses the notation to include the filelist created on step (1). The name of the filelist is fixed so this works just OK. 3) A run after job uses the filelist to move the files just archived to another location on a filesystem. Note that I could as well run something like `cat $filelist | xargs -n 100 rm -f` on the filelist instead of rsync'ing the files using it. Then in my case the filelist is renamed to include the job's unique ID and moved to a special directory, but in a simpler case I could just remove it. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Moving a volume to a pool doens't inherit the correct Volume Use Duration
How do you move the tapes from Scratch to the Daily Pool? You're supposed to have a Scratch Pool = Scratch entry on your Daily Pool so Bacula gets the tape automatically from the Scratch Pool when running the Jobs... 2011/5/27 Mauro Colorio mauro.colo...@gmail.com I've a scratch pool defined as Pool { Name = Scratch Pool Type = Backup } and daily one Pool { Name = Daily Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 5 days Maximum Volume Bytes = 800G Volume Use Duration = 23h Maximum Volumes = 5 } so noticed that there is not a Volume Use Duration in the Scratch pool, when I label new volumes with the command label barcode pool=Scratch i put volumes in the Scratch, they have value 0 for Volume Use Duration, pool then I move some of them in the Daily pool they keeps 0 for Volume Use Duration, I was expecting that they takes the correct value, of course I can run update volume, but I think it's a bug, isn't? ciao Mauro -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Moving a volume to a pool doens't inherit the correct Volume Use Duration
Please, do not forget to reply to the list also, not only directly to me... I actually don't think it's a BUG, when you put your tapes on the Scratch Pool using label barcodes, the volumes will inherit any configuration on that pool, and only if that volume gets cycled to the Daily Pool automatically by Bacula using the Scratch Pool = Scratch parameter I told you about before is when these parameters from the Daily Pool are set on the Volume... Try doing that, I really recommended it... 2011/5/30 Mauro Colorio mauro.colo...@gmail.com How do you move the tapes from Scratch to the Daily Pool? You're supposed to have a Scratch Pool = Scratch entry on your Daily Pool so Bacula gets the tape automatically from the Scratch Pool when running the Jobs... with the update command, or for example with webacula, I've defined the scratch volume but I don't use really it, I'm using something like a GFS schedule and I put 5 volumes in the Daily pool 2 volumes in the weekly and so on.. but when I add a new volume I use the label barcode command putting it into the Scratch pool, I discovered that when I move the volume, it keeps the Volume Use Duration value of the original pool, I think this is a bug ciao Mauro -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] IBM TS2240 Tape Drive
Hello Everyone, I would like to know if somebody here have used Bacula with the IBM TS2240 Tape Drive. I will buy this Tape Drive and I intend to use Bacula in it. The TD didn't arrive yet then I couldn't test it with Bacula. K R Thanks. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Network timeouts while running enormous backup
On Thu, May 26, 2011 at 4:58 PM, S H shdashb...@gmail.com wrote: Hello, I've got a very large backup set (55M files, 1TB of data) that's simply not backing up. This is always the failure message: 26-May 16:35 buny1-dir JobId 5223: Fatal error: Network error with FD during Backup: ERR=Connection timed out 26-May 16:35 buny1-dir JobId 5223: Fatal error: No Job status returned from FD. I've set Heartbeat Interval = 1 minute on the FD, the SD, and the Director to no avail. This was happening at random times during the backup job until I enabled spooling -- then the job ran for 27 hours, spooled up all of its data to the SD and failed with the above message when it started to despool. It was heartbreaking to watch a terabyte of data and 20+GB of attribute spool just disappear. The Director and SD both run on the same server: OpenBSD 4.6 (32-bit) with Bacula 2.4.4. The client is FreeBSD 8.1 (64-bit) with Bacula 2..4.4. I know these are outdated versions; I just inherited the environment and they're working for everything else so I haven't wanted to go through the pain of upgrading until I have some spare cycles to dedicate to it. Compression and FD encryption are off but network traffic runs over TLS everywhere. Is there anything I can possibly check that might help? -SH I added a network interface to the backup server on the same segment as the client and the timeout disappeared, so it seems my firewall was expiring a TCP session somewhere along the line. Unsure whether it's a configuration problem on the Bacula or firewall side -- I expected the heartbeat to prevent this. Anyhow, I'm not sure Bacula is the right solution for this type of backup: the attribute despool has been running for nearly three days straight now. Does anybody else have experience backing up tons of files? Any recommendations on making it not suck? -SH -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula Verification
Hi, I'm reading about the verification File Set options so, how I could understand, there are three modes: basejob (for Full Backups), accurate (for Incr/Diff) and verify (for Catalog). Is that right? If it is, what options are the best for a reliable verification and don't overhead the backup time. Is it enough check only the md5 hash? Thanks in advance. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] scripts for holding configuration in database
2011/5/28 Silver Salonen sil...@ultrasoft.ee I have named the Ruby classes beginning with 'BaculaConf' and they are: ... - BaculaConfFileParser - backend for parsing configuration from files (eg. for importing configuration into MySQL) I already wrote here in 2010: During development the prototype of the my new system (Webacula 5.5), I tried to parse the bacula-dir.conf. However, this is probably not possible with simple regexp's. It turned out that some applications, for example, Webmin does this with a regexp. But they're doing it wrong! For example, here is test configuration (which is written according to Bacula Main Reference: Customizing the Configuration Files) contains no errors in terms of Bacula (I checked it) but it would be wrong parsed (I have not tested it, but I'm sure of it) by 3rd parties parsers (not native) : - # comment1 # comment2 c o n s o l e { Name=name1; Password = p; \\\a s s w o rd; J o b A C L = *all\* }Con sole { N a m e = name 2; Pass word = password; JobACL = job/\1, job2, job3 } - I.e. in other words to parse with regexp any Bacula configuration will be very difficult. Stefan Muenkner suggested: a better solution still would be to enable bacula to dump its configuration as a (e.g.) XML or JSON file, probably in a rather generic way so that future changes to the structure/content of the config files would not need additional work on behalf of the bacula developers. XML or JSON - as examples - could be easily picked up by php, ruby, perl, python, java you name it whatever. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO5 not filling
Hi guys, First my apologize for such a newbbie thing. I had my pool configured for 50GB which was the size bacula used in the tapes. Thanks Ralf for your appreciation, you where right!! :-). Thanks to everyone. Regards, -- Toda la información contenida en este correo electrónico es confidencial y para conocimiento exclusivo de su destinatario. Agradeceremos que Ud. nos comunique inmediatamente si ha recibido este correo por error. En tal caso, evite hacer uso del mismo en forma alguna y elimÃnelo inmediatamente de su sistema. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula slow transfer
Hello, im new with Bacula scene, i have used the HP Dataprotector with a HP Library fiber channel backup. With the Dataprotector i got 1gbps interfaces and switch and all jobs get done very fast, with transfer like 50-80MB/s. Now im using Bacula with a DELL TL2000 iSCSI, and with my first experience i got only 6MB/s transfer with 1gbps interfaces and switch. So what im missing Used to tes: Bacula Director runing on Slackware64 13.1 Bacula Cliente Windows 2003 Server +-- |This was sent by thiagomel...@hotmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO5 not filling
First my apologize for such a newbbie thing. I had my pool configured for 50GB which was the size bacula used in the tapes. Thanks Ralf for your appreciation, you where right!! :-). I am glad he thought of that. I would have had to ask you for your complete configs before figuring that out... John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula slow transfer
On Mon, May 30, 2011 at 3:11 PM, reiserfs bacula-fo...@backupcentral.com wrote: Hello, im new with Bacula scene, i have used the HP Dataprotector with a HP Library fiber channel backup. With the Dataprotector i got 1gbps interfaces and switch and all jobs get done very fast, with transfer like 50-80MB/s. Now im using Bacula with a DELL TL2000 iSCSI, and with my first experience i got only 6MB/s transfer with 1gbps interfaces and switch. So what im missing Do you have software compression turned on? If so remove that for a tape drive. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] IBM TS2240 Tape Drive
Sorry, no experience on that specific Tape Drive, but if your OS support that hardware (i.e the devices for bacula-sd to read/write on are created), than Bacula will work without problems with it... 2011/5/30 Rickifer Barros rickiferbar...@gmail.com Hello Everyone, I would like to know if somebody here have used Bacula with the IBM TS2240 Tape Drive. I will buy this Tape Drive and I intend to use Bacula in it. The TD didn't arrive yet then I couldn't test it with Bacula. K R Thanks. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Network timeouts while running enormous backup
I added a network interface to the backup server on the same segment as the client and the timeout disappeared, so it seems my firewall was expiring a TCP session somewhere along the line. Unsure whether it's a configuration problem on the Bacula or firewall side -- I expected the heartbeat to prevent this. Anyhow, I'm not sure Bacula is the right solution for this type of backup: the attribute despool has been running for nearly three days straight now. That is not normal. I have seen 30 minutes for 5 or so TB backup with a few million files but never days. Do you have your database on a server with at least 8GB of ram? Is your database on a raid 10 or SSD? Does anybody else have experience backing up tons of files? There are users that backup 30 TB containing millions of files in one job on this list. Any recommendations on making it not suck? Not without any system information. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] SHA1 digest warning on Copy Jobs
Just to give a feedback, I believe it was a physical error on the tape, i bought brand new ones and ran again the same Copy Job and now the job terminated without errors! 2011/5/16 John Drescher dresche...@gmail.com Any thoughts on this? It is still happening and I have no idea why... Do a test restore if possible from the original source and see if it complains about SHA1 mismatches. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users