Re: [Bacula-users] Bacula Status report
Hello Kern, On 07/23/2010 05:54 PM, Kern Sibbald wrote: Hello, This is a sort of mini-Bacula status report on the following: 1. Next release 2. New release cycle 3. New bugs tracking database 4. New Bacula server (www.bacula.org) 5. New Bacula source distribution server 1. Next release: Before the end of August, we will be releasing the next version of Bacula -- version 5.0.3 which is a bug fix update to 5.0.2. This release is almost ready and the most recent code is in the SF bacula git repository under Branch-5.0 Thanks for that, and all the good works done, as usually. 2. New release cycle: The little code we currently have for the next major release is in the SF bacula git repository under Branch-5.1. We are considering to moving to a regular 6 month release cycle. The advantage of such a cycle is that it gets features out to you faster. The disadvantage is that it doesn't work so well in small projects like Bacula if there are not sufficient contributions. Such a release would consist of the following points: - A release every 6 months - The deadline is not absolute and could be extended to 9 months if there were insufficient new submissions. - There will be far fewer or no bug fix updates as they are not really needed if we can maintain a 6 month cycle. - Two months before the projected release we will decide if there are sufficient new features to release - The release count down will consist of 3 phases 1. We will add all new approved features The first 4 months after a release this phase will go into effect for the next release - 2. Only very small new features (a few lines) will be added Two months before the final release this phase will go into effect. Note, this phase can be delayed 3 months if insufficient new features are submitted 3. Only bug fixes This phase will go into effect one month before the release Under this scheme, we are currently in Phase 3 for the 5.0.3 release, and the next major release (5.2.0) would be made before mid-January 2011, and is currently under development in Branch-5.1 on Source Forge. I would appreciate comments on this proposed new deadline release cycle. If generally the 6 month schedule is used in FOSS project, I'm seeing more more exhausted users admin to always update. There's sometimes good reasons, sometimes not. following the adage : if it's not breaked, don't change it. I've no idea for Bacula is this would work. Bacula the backup stuff are long time cycles. So if a 6 months release cycle take place, a special attention is needed to permit easy migration/update from the 2 previous release ( 5.0.0 5.0.2 - 5.0.3 for example). Perhaps giving more importance (helping those who want to do that) to the regressing test installation. I also be interested in the cycle release you will have with Bacula-System's enterprise edition ? For example, I've one customers which doesn't want to change anything before a new server come. And it run the 1.38.11 version (1.38 do what it has to do : reliable backup and restore) I don't know how fragmented (in term of version running outside) is the bacula installed base is. And this quick release can raise this. But seeing new feature bug fixes coming out regularly, can also prove to outside how in wellness the project is and make some FOSS marketing about that. My last suggestion, is trying to find a way ( that's not so easy but who knows ) to have a maximum release made one or two month before the launch of big block distribution : giving time to packagers to include them inside their next release 3. New bugs tracking database Sometime in early August (possibly slightly before) we will be moving the current Mantis based bug tracking system to a new RT based system hosted by Bacula Systems. The upside is that the RT system is far more powerful, flexible and adaptible, and most important of all, it allows email responses to bugs. The downside is that it is a bit more complicated (as are most things that have more features) and that it will require everyone to re-register for the new system. In addition, if you don't want to rely on just the community to furnish bug fixes, you will be able to subscribe to a bug fix service that is more professional and has a guaranteed response time (not to be mistaken for a guaranteed fix time). More on this when the service is ready for production. joke What ? We need to recreate the account, this is a real pain :-) /joke 4. New Bacula server The current Bacula Community server is as you probably know generously offered by UKFast. However, the hardware is starting to age, so they have gratiously provided us with a new machine that we will be putting in place in the next few weeks. We don't expect that you will notice any differences, but the hardware running
Re: [Bacula-users] Migrating jobs - Is this correct, my bacula fails to load?
On 02/08/10 00:02, Dan Langille wrote: On 8/1/2010 6:47 PM, Mister IT Guru wrote: On 01/08/10 13:13, Dan Langille wrote: On 7/31/2010 1:36 PM, Mister IT Guru wrote: Job { Name = migrate Type = Migrate Level = Full Client = clientname FileSet=Full Set Messages = Standard Pool = Default Maximum Concurrent Jobs = 4 Selection Type = OldestVolume Selection Pattern = ignored } Will this pattern only migrate completed jobs? Or will it migrate all jobs, including failed ones? If so, can I use a SQL query so that I can migrate only completed jobs, starting from the oldest one? You say Bacula fails to load. What version of Bacula? What errors are you seeing? Also, is it possible to change the filename of the volumes once the jobs they contain have been migrated off? This is because I'm attempting to reclaim disk space, and I'll need to rename the volumes once they become empty so that I don't lose any viable data. It is best to ask just one question per email. Your premise makes no sense. Once the Volume is *empty*, it contains no data. Sorry for my bad English! *I should be ashamed, London, England born and bred!* My migration jobs seem to all fail saying no files found to migrate, even though I know 100% that the files are there. Basically, I put together my bacula in a bit of a rush, and i now have thousands of volumes populating my nas. I have configured a second storage daemon, NOTE: Migration is only implemented for a single Storage daemon. You cannot read on one Storage daemon and write on another. The same may apply to Job Copy as well. You may have to mount the other NAS on the first SD. At the following URL, read Important Migration Considerations slowly and carefully. http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html and i now wish to migrate the jobs of clients into seperate pools. For example, I want to migrate all the completed jobs of client1.domain.com to a new temporary pool for client1. This way, I now have the whole backup history of client1 in one pool, which I can now add proper retention times on, so that I have a manageable amount of files. At the end of this exercise, i should end up with all the jobs of particular clients in separate pools. I'm still trying to learn how bacula works properly, so please forgive me if I don't fully understand everything. That sounds reasonable. I feel so stupid! Migration jobs cannot cross storage daemons? If I had only known last week! Thank you for input, i'll retry with the disk space on the same storage daemon and then try the migration jobs. -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Backup windows client with accented characters in folder
Hello, any more advice ? I'm really stuck here and i don't know where to look. Just for test, i've tried onto another windows server (to be sure that the problem doesn't occur with my current server) and the same problem exists :( So, as long as i don't have any accentuated character on my windows server, it works but i really need to make it work with these accent :( :( Any help appreciated !! Thanks. +-- |This was sent by pierre.chevall...@option-service.fr via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with backup
All these test are good on all the port both in IN than in OUT 2010/7/30 Sebastián Moreno smoreno...@gmail.com You can telnet tru the ports?? Telnet bacula-ip 9101 Try this!! -- Sebastián Moreno Montevideo - Uruguay +59895356960 Correo enviado desde el servicio BlackBerry de Movistar -Original Message- From: Carlo Filippetto carlo.filippe...@gmail.com Date: Fri, 30 Jul 2010 13:42:26 To: jerry lowryjlo...@edt.com Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Problem with backup -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula Tape replacement
Hello, We are using Bacula 2.2.7. The problem is, a tape in one of the working pools gets I/O errors whenever tape library tried to access it. I could see that tape has some data on it. Now I wish to replace this tape with a new tape with new name. (As I feel, using new name would not make much difference or would it?). Please correct the proposed steps : Add new tape in the library. Move the tape and move it into one of the empty slots. Label the tape to the respective Volume Pool. Now please state the steps to purge the susepcted tape. I would like to transfer the data on this tape onto the new tape. As I do not wish to break the data consistency within the volume pool. Correct me if I am wrong here. Regards, Sachin -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Some questions about migrating jobs to clone...
Im a realtive new user to bacula and want to setup following configuration: A primary FileStorage where all my backup jobs are stored too full incrementals.. Full backups are made once a week saturday night, then incs are runned on defferent plans depending of what data there is.. A secondary CloneStorage which is my LTO-2 tape. This job should run at the begin of last sun of month at noon, a year ago i had something like this configuration for a job where i had to use an SQL query to get jobid's to migrate: Job { Name = Clone - Latest FULL jobs Type = migrate Pool = Clone Storage = FileStorage Level = Full Schedule = LastDayOfMonth Messages = Standard Client = Mac-mini-fd FileSet = Home Directories Selection Type = SQLQuery Selection Pattern= SELECT MAX(jobid) FROM Job WHERE level='F' AND Type='B' AND JobStatus='T' GROUP BY name ORDER BY RealEndTime; } Is this the way to go ?? or is there a newer functionality added for this kind of operation ? /Henrik -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Tape replacement
We are using Bacula 2.2.7. Please upgrade. That is over two years old and will not be supported for bug fixes ... anymore. The problem is, a tape in one of the working pools gets I/O errors whenever tape library tried to access it. I could see that tape has some data on it. Now I wish to replace this tape with a new tape with new name. (As I feel, using new name would not make much difference or would it?). Please correct the proposed steps : Add new tape in the library. Move the tape and move it into one of the empty slots. Label the tape to the respective Volume Pool. The last step. A label barcodes will do. Ignore that bacula will ask about every tape in the library. Bacula will only label tapes that are not labeled. I generally at this step put the tapes in the Scratch pool. Now please state the steps to purge the susepcted tape. I would like to transfer the data on this tape onto the new tape. As I do not wish to break the data consistency within the volume pool. Correct me if I am wrong here. If you are totally getting rid of that tape never to use it again. delete volume if you want to try to use it again purge volume Both commands find all backup jobs on that volume and purge the jobs even if the job started on a different tape. John -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger question for configuration with multiple devices
i am fresh on the list and maybe there is an archive entry for my question or somebody has a link to an how tobut in the internet i found nothing what helps me my config is: i have bacula 5.0.1 on ubuntu an a Tandberg Storage T24 with two devies. i get to manage that bacula is using an device for backup, but the second which is also configured in the autochanger section isn't used for now. I configured one tape set und 4 Jobs which should write on the same tape set. How can i seduce bacula to use two devices in on autochanger at the same time? Use different pools. Or PreferMountedVolumes=no google for that. The manual is down right now. For the overview and some information i use BAT but not one nor two devices will be shown in the storage viewthe device list is empty!? I used the configuration for bacula which comes with the standard set, i actived the autochanger section with two devices. How do i have to configure bacula to use two devices? it would be awesome if you can help me out with that thanks carlo -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- John M. Drescher -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Tape replacement
Hello, Thanks for your reply. Yes upgrade is a MUST and is in a planning stage. Yes I will not use the faulty tape anymore but as you said , if I use delete option to delete the volume tape totally, even though Bacula finds all the jobs on that tape , deletion will remove all the data contents on it. So data loss without any inconsistencies. Am I correct? Thanks, Sachin Holikar -Original Message- From: John Drescher [mailto:dresche...@gmail.com] Sent: Montag, 2. August 2010 14:43 To: Holikar, Sachin (ext) Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Bacula Tape replacement We are using Bacula 2.2.7. Please upgrade. That is over two years old and will not be supported for bug fixes ... anymore. The problem is, a tape in one of the working pools gets I/O errors whenever tape library tried to access it. I could see that tape has some data on it. Now I wish to replace this tape with a new tape with new name. (As I feel, using new name would not make much difference or would it?). Please correct the proposed steps : Add new tape in the library. Move the tape and move it into one of the empty slots. Label the tape to the respective Volume Pool. The last step. A label barcodes will do. Ignore that bacula will ask about every tape in the library. Bacula will only label tapes that are not labeled. I generally at this step put the tapes in the Scratch pool. Now please state the steps to purge the susepcted tape. I would like to transfer the data on this tape onto the new tape. As I do not wish to break the data consistency within the volume pool. Correct me if I am wrong here. If you are totally getting rid of that tape never to use it again. delete volume if you want to try to use it again purge volume Both commands find all backup jobs on that volume and purge the jobs even if the job started on a different tape. John -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Tape replacement
Thanks for your reply. Yes upgrade is a MUST and is in a planning stage. Yes I will not use the faulty tape anymore but as you said , if I use delete option to delete the volume tape totally, even though Bacula finds all the jobs on that tape , deletion will remove all the data contents on it. So data loss without any inconsistencies. Am I correct? It removes every job on that volume. Even ones started or continued on other tapes. Everything will be consistent. John -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Tape replacement
You need to use the erase command to remove the data off of the tape. example: load the tape mtx -f /dev/sg3 load slotnum [drive number] tell the drive to erase the tape mt -f /dev/nst0 erase Make sure you are using the right devices by running the mtx inquiry. [r...@baculaserver ~]# mtx -f /dev/sg3 inquiry Product Type: Medium Changer Vendor ID: 'DELL' Product ID: 'PV-124T ' Revision: '0075' Attached Changer: No The correct devices should be listed in your bacula-sd.conf file. On Mon, 2010-08-02 at 16:20 +0200, Holikar, Sachin (ext) wrote: Hello, Thanks for your reply. Yes upgrade is a MUST and is in a planning stage. Yes I will not use the faulty tape anymore but as you said , if I use delete option to delete the volume tape totally, even though Bacula finds all the jobs on that tape , deletion will remove all the data contents on it. So data loss without any inconsistencies. Am I correct? Thanks, Sachin Holikar -Original Message- From: John Drescher [mailto:dresche...@gmail.com] Sent: Montag, 2. August 2010 14:43 To: Holikar, Sachin (ext) Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Bacula Tape replacement We are using Bacula 2.2.7. Please upgrade. That is over two years old and will not be supported for bug fixes ... anymore. The problem is, a tape in one of the working pools gets I/O errors whenever tape library tried to access it. I could see that tape has some data on it. Now I wish to replace this tape with a new tape with new name. (As I feel, using new name would not make much difference or would it?). Please correct the proposed steps : Add new tape in the library. Move the tape and move it into one of the empty slots. Label the tape to the respective Volume Pool. The last step. A label barcodes will do. Ignore that bacula will ask about every tape in the library. Bacula will only label tapes that are not labeled. I generally at this step put the tapes in the Scratch pool. Now please state the steps to purge the susepcted tape. I would like to transfer the data on this tape onto the new tape. As I do not wish to break the data consistency within the volume pool. Correct me if I am wrong here. If you are totally getting rid of that tape never to use it again. delete volume if you want to try to use it again purge volume Both commands find all backup jobs on that volume and purge the jobs even if the job started on a different tape. John -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
On 30/07/10, Dan Langille (d...@langille.org) wrote: On 7/30/2010 3:53 AM, Rory Campbell-Lange wrote: Fatal error: sql_create.c:843 Batch end postgresql.c:748 error ending batch mode: ERROR: could not extend relation 1663/17472/17828: wrote only 4096 of 8192 bytes at block 98374 HINT: Check free disk space. ... The database itself is only just over 500MB. I think you're suggesting Bacula used up 3.4GB in a query.. How many files are you backing up? 7,643,966 files taking up 7.265 T of space on tape. ... Umm, or it could be a problem with the way you have your computer system configured. :) It's a matter of perspective. In a 6.5TB backup, I'm going to guess there are a large number of files, given that var filled up. Can you extend var? Or create a symlink to another filesystem to give PostgreSQL the space it needs. I'm intrigued about this batch file. Where is it and how big is it? I can increase the size of /var, or move the postgresql database mount point, but it is difficult to know how much size it may require. Is it not possible to change this arrangement to use sequential inserts instead? Look at the Spool Attributes directive. Set it to know. This way, the details of each file will be added to the database right after that file is backed up. I turned off spooling and set the Spool Attributes directive to no and reran the backup. The backup job completes but the database insert bails out. clwbackup-dir JobId 8: Fatal error: sql_create.c:894 Fill File table Query failed: INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5)SELECT batch.FileIndex, bat ch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5 FROM batch JOIN Path ON (batc h.Path = Path.Path) JOIN Filename ON (batch.Name = Filename.Name): ERR=ERROR: could not write to hash-join temporary file: No space left on device I don't understand why bacula isn't writing to the database continuously. Why is a batch file needed? -- Rory Campbell-Lange r...@campbell-lange.net -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Variables in bacula
Hi to all. I have a dsl connection with a dynamic ip and actually i'm resolving it with a subdomain from no-ip but sometimes i get this error gethostbyname() for host mydomain.zapto.org failed: ERR=Non-authoritative for host not found, or ServerFail. So i'm trying to change the way i get the ip for the Storage daemon by getting my public ip with a shell script (ran before the job) and putting it in a variable. IP=`wget -q -O - checkip.dyndns.org|sed -e 's/.*Current IP Address://' -e 's/.*$//'` The problem i have is how can bacula-dir.conf get the $IP variable? i tried just this way but it doesn work Storage { Name = sxxx Address = $IP SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } and then tried using brackets this way Storage { Name = sxxx Address = {$IP} SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } but looks like bacula thinks there finish the storage resource Thanks in advance Daniel Beas Enriquez -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Variables in bacula
On 08/02/10 13:17, Daniel beas wrote: Hi to all. I have a dsl connection with a dynamic ip and actually i'm resolving it with a subdomain from no-ip but sometimes i get this error gethostbyname() for host mydomain.zapto.org failed: ERR=Non-authoritative for host not found, or ServerFail. So i'm trying to change the way i get the ip for the Storage daemon by getting my public ip with a shell script (ran before the job) and putting it in a variable. IP=`wget -q -O - checkip.dyndns.org|sed -e 's/.*Current IP Address://' -e 's/.*$//'` The problem i have is how can bacula-dir.conf get the $IP variable? i tried just this way but it doesn work Storage { Name = sxxx Address = $IP SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } and then tried using brackets this way Storage { Name = sxxx Address = {$IP} SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } but looks like bacula thinks there finish the storage resource Well, that latter syntax would be wrong for shell expansion; it would be ${IP}, not {$IP}. But correct shell expansion is moot in the first place because Bacula does not perform shell expansion when loading its config files. About the only practical way you can do this is to maintain a template config, generate a live config by processing the template and replacing the IP, then starting Bacula on the live config. So you'd do something like this: # bacula-dir.template Storage { Name = sxxx Address = MYADDRESS SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } # prepscript #!/bin/bash IP=$(whatever means to get IP here) cat bacula-dir.template | sed -e s/MYADDRESS/${IP}/ bacula-dir.conf /etc/init.d/bacula start This step could probably actually be incorporated into your Bacula startup script. You're also going to have to make your Director and your storage daemon listen on both your internal address and your public IP, unless your router is taking care of this via NAT. All this said, I can't help but think there has to be an easier way to do this, but it's hard to tell without knowing what your actual infrastructure situation is. Do I understand correctly that you are trying to make backups, over DSL, to a remote storage host on a dynamic-IP connection somewhere off in the outside world? Or are you trying to back up remote clients to a local storage daemon over a dynamic-IP DSL connection? Either way seems likely to be both extremely unreliable and, more likely than not, infeasibly slow. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, Free Stater It's not the years, it's the mileage. -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Variables in bacula
i'm doing backups of local and remote clients (the remote clients doesn't have too much information so there is not a big problem doing that). I have remember thah i had used the domain name for the storage because i had used the same storage for all the clients (remote and local) but now i have a storage for every client so i don't have this problem anymore and i can use the local ip address for local backups which are the most important. Thank you so much Daniel Beas Enriquez Date: Mon, 2 Aug 2010 13:54:25 -0400 From: ala...@metrocast.net To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Variables in bacula On 08/02/10 13:17, Daniel beas wrote: Hi to all. I have a dsl connection with a dynamic ip and actually i'm resolving it with a subdomain from no-ip but sometimes i get this error gethostbyname() for host mydomain.zapto.org failed: ERR=Non-authoritative for host not found, or ServerFail. So i'm trying to change the way i get the ip for the Storage daemon by getting my public ip with a shell script (ran before the job) and putting it in a variable. IP=`wget -q -O - checkip.dyndns.org|sed -e 's/.*Current IP Address://' -e 's/.*$//'` The problem i have is how can bacula-dir.conf get the $IP variable? i tried just this way but it doesn work Storage { Name = sxxx Address = $IP SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } and then tried using brackets this way Storage { Name = sxxx Address = {$IP} SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } but looks like bacula thinks there finish the storage resource Well, that latter syntax would be wrong for shell expansion; it would be ${IP}, not {$IP}. But correct shell expansion is moot in the first place because Bacula does not perform shell expansion when loading its config files. About the only practical way you can do this is to maintain a template config, generate a live config by processing the template and replacing the IP, then starting Bacula on the live config. So you'd do something like this: # bacula-dir.template Storage { Name = sxxx Address = MYADDRESS SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } # prepscript #!/bin/bash IP=$(whatever means to get IP here) cat bacula-dir.template | sed -e s/MYADDRESS/${IP}/ bacula-dir.conf /etc/init.d/bacula start This step could probably actually be incorporated into your Bacula startup script. You're also going to have to make your Director and your storage daemon listen on both your internal address and your public IP, unless your router is taking care of this via NAT. All this said, I can't help but think there has to be an easier way to do this, but it's hard to tell without knowing what your actual infrastructure situation is. Do I understand correctly that you are trying to make backups, over DSL, to a remote storage host on a dynamic-IP connection somewhere off in the outside world? Or are you trying to back up remote clients to a local storage daemon over a dynamic-IP DSL connection? Either way seems likely to be both extremely unreliable and, more likely than not, infeasibly slow. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, Free Stater It's not the years, it's the mileage. -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spooling
Dan Langille wrote: On 7/30/2010 8:16 AM, Alan Brown wrote: Has anyone else seen the despooling threshold decrease after a few days/weeks of operation in 5.0.2? I have 300Gb free and job despool threshold set to 100gb, but it's now insisting on despooling when it hits 8Gb Hey Alan... How's the disk space in that filesystem? df gives upwards of 90% free (~295Gb) What's the output of ls -l in the spooling directory? A few files, but nowhere near the 100Gb total, let alone the 100Gb per job limit. If it was lack of disk space or a congested directory I'd understand why it's playing up. This just seems to happen periocically and the only cure is to restart bacula-sd -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spooling
On 8/2/2010 3:29 PM, Alan Brown wrote: Dan Langille wrote: On 7/30/2010 8:16 AM, Alan Brown wrote: Has anyone else seen the despooling threshold decrease after a few days/weeks of operation in 5.0.2? I have 300Gb free and job despool threshold set to 100gb, but it's now insisting on despooling when it hits 8Gb Hey Alan... How's the disk space in that filesystem? df gives upwards of 90% free (~295Gb) What's the output of ls -l in the spooling directory? A few files, but nowhere near the 100Gb total, let alone the 100Gb per job limit. If it was lack of disk space or a congested directory I'd understand why it's playing up. This just seems to happen periocically and the only cure is to restart bacula-sd Hmmm. I'm not doing any spooling at the moment; all my jobs are now to HDD, so spooling isn't logical. I wonder... does the despooling level reduce on a consistent basis all through the two week period? Or does it suddenly drop. This sounds like it calls for a pretty graph... ;) -- Dan Langille - http://langille.org/ -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Variables in bacula
On 8/2/2010 2:24 PM, Daniel beas wrote: Date: Mon, 2 Aug 2010 13:54:25 -0400 From: ala...@metrocast.net To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Variables in bacula On 08/02/10 13:17, Daniel beas wrote: Hi to all. I have a dsl connection with a dynamic ip and actually i'm resolving it with a subdomain from no-ip but sometimes i get this error gethostbyname() for host mydomain.zapto.org failed: ERR=Non-authoritative for host not found, or ServerFail. So i'm trying to change the way i get the ip for the Storage daemon by getting my public ip with a shell script (ran before the job) and putting it in a variable. IP=`wget -q -O - checkip.dyndns.org|sed -e 's/.*Current IP Address://' -e 's/.*$//'` The problem i have is how can bacula-dir.conf get the $IP variable? i tried just this way but it doesn work Storage { Name = sxxx Address = $IP SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } and then tried using brackets this way Storage { Name = sxxx Address = {$IP} SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } but looks like bacula thinks there finish the storage resource Well, that latter syntax would be wrong for shell expansion; it would be ${IP}, not {$IP}. But correct shell expansion is moot in the first place because Bacula does not perform shell expansion when loading its config files. About the only practical way you can do this is to maintain a template config, generate a live config by processing the template and replacing the IP, then starting Bacula on the live config. So you'd do something like this: # bacula-dir.template Storage { Name = sxxx Address = MYADDRESS SDPort = 9103 Password = SHexZ8mwXW4YkbJgu2HpJloZfkuT5Pj5yyWLiPxBhoZy device = dxxx Media type = File } # prepscript #!/bin/bash IP=$(whatever means to get IP here) cat bacula-dir.template | sed -e s/MYADDRESS/${IP}/ bacula-dir.conf /etc/init.d/bacula start This step could probably actually be incorporated into your Bacula startup script. You're also going to have to make your Director and your storage daemon listen on both your internal address and your public IP, unless your router is taking care of this via NAT. All this said, I can't help but think there has to be an easier way to do this, but it's hard to tell without knowing what your actual infrastructure situation is. Do I understand correctly that you are trying to make backups, over DSL, to a remote storage host on a dynamic-IP connection somewhere off in the outside world? Or are you trying to back up remote clients to a local storage daemon over a dynamic-IP DSL connection? Either way seems likely to be both extremely unreliable and, more likely than not, infeasibly slow. i'm doing backups of local and remote clients (the remote clients doesn't have too much information so there is not a big problem doing that). I have remember thah i had used the domain name for the storage because i had used the same storage for all the clients (remote and local) but now i have a storage for every client so i don't have this problem anymore and i can use the local ip address for local backups which are the most important. Would OpenVPN help here? That way, each remote client could have the same IP address on the VPN. FYI, this is how I backup remote clients even when they have static IP addresses. -- Dan Langille - http://langille.org/ -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] recycling media for failed jobs
I have quite a few jobs that have failed for various reasons. Since these are incomplete jobs, I would like to take the media and recycle them back into the pool as we are running low on tapes. I am able to identify the volumes related to the specific failed job. However, I do want to check to see if these volumes are associated with any other jobs so I don't accidently wipe out other jobs. Does anyone know how I might identify all jobs on a specific volume? Thanks, JJ *list media jobid=121 Jobid 121 used 7 Volume(s): KL0440|KL0443|KL0406|KL0393|KL0429|KL0456|000112 +---++-+--+---+--+---+---+ | JobId | Name | StartTime | Type | Level | JobFiles | JobBytes | JobStatus | +---++-+--+---+--+---+---+ | 121 | magnum-offsite | 2010-06-22 19:53:54 | B| F | 363,951 | 2,738,261,407,337 | f | +---++-+--+---+--+---+---+ -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Copy job question
I want to setup bacula so that when a job finishes (one that writes to disk) it then spawns a job that copies itself to tape. I know about PoolUncopiedJobs and I don't want to do that, as it can cause the same job to be queued multiple times and will pull all of my old backup jobs, which I really don't want. -- Jon Schewe | http://mtu.net/~jpschewe If you see an attachment named signature.asc, this is my digital signature. See http://www.gnupg.org for more information. -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] recycling media for failed jobs
On Mon, Aug 2, 2010 at 5:00 PM, Jeremiah D. Jester jj...@u.washington.edu wrote: I have quite a few jobs that have failed for various reasons. Since these are incomplete jobs, I would like to take the media and recycle them back into the pool as we are running low on tapes. I am able to identify the volumes related to the specific failed job. However, I do want to check to see if these volumes are associated with any other jobs so I don't accidently wipe out other jobs. Does anyone know how I might identify all jobs on a specific volume? query 14 *query Available queries: 1: List up to 20 places where a File is saved regardless of the directory 2: List where the most recent copies of a file are saved 3: List last 20 Full Backups for a Client 4: List all backups for a Client after a specified time 5: List all backups for a Client 6: List Volume Attributes for a selected Volume 7: List Volumes used by selected JobId 8: List Volumes to Restore All Files 9: List Pool Attributes for a selected Pool 10: List total files/bytes by Job 11: List total files/bytes by Volume 12: List Files for a selected JobId 13: List Jobs stored on a selected MediaId 14: List Jobs stored for a given Volume name 15: List Volumes Bacula thinks are in changer 16: List Volumes likely to need replacement from age or errors 17: List Volumes Bacula thinks are full and in changer 18: Get all the Jobids for a job 19: List Volumes by status 20: List where the most recent copies of folder Choose a query (1-20): 14 Enter Volume name: A00052 ++-+-+--+---+-+-++ | jobid | name| starttime | type | level | files | bytes | status | ++-+-+--+---+-+-++ | 21,780 | BreastConeBeamCTArchive-Job | 2010-07-06 15:20:36 | B| I | 359,799 | 382,912,010,067 | T | | 21,797 | SCCORArchive-Job| 2010-07-08 09:03:37 | B| I | 21,011 | 11,035,952,565 | T | | 21,898 | PLuSSArchive-Job| 2010-07-19 05:46:27 | B| I | 5,729 | 2,999,968,152 | T | | 21,899 | PRO09070131-Archive-Job | 2010-07-19 13:30:45 | B| F | 375 | 6,728,175,230 | T | | 21,900 | IRB0601002-Archive-Job | 2010-07-19 13:41:45 | B| F | 200 | 98,143,038 | T | | 21,901 | PRO09070131-Archive-Job | 2010-07-19 13:46:30 | B| I | 29 | 0 | T | | 21,922 | IRB0601002-Archive-Job | 2010-07-21 08:39:24 | B| I | 1 | 0 | T | | 21,923 | IRB0601002-Archive-Job | 2010-07-21 11:40:20 | B| F | 2,199 | 28,709,501,042 | T | | 21,944 | SARP-Archive-Job| 2010-07-23 08:11:24 | B| I | 8,287 | 4,360,314,222 | T | | 21,975 | SARP-Archive-Job| 2010-07-26 08:11:36 | B| I | 1,884 | 991,829,792 | T | | 21,986 | SARP-Archive-Job| 2010-07-27 13:25:21 | B| I | 1,610 | 846,989,718 | T | | 21,998 | BreastConeBeamCTArchive-Job | 2010-07-28 14:58:54 | B| I | 56,296 | 57,601,152,105 | T | | 22,029 | PLuSSArchive-Job| 2010-07-30 13:06:30 | B| I | 0 | 0 | T | ++-+-+--+---+-+-++ * -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] recycling media for failed jobs
Any idea why mine doesn't return? *query Available queries: Selection list for is empty! *query 14 Available queries: Selection list for is empty! Thanks. JJ From: John Drescher [dresche...@gmail.com] Sent: Monday, August 02, 2010 2:22 PM To: Jeremiah D. Jester Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] recycling media for failed jobs On Mon, Aug 2, 2010 at 5:00 PM, Jeremiah D. Jester jj...@u.washington.edu wrote: I have quite a few jobs that have failed for various reasons. Since these are incomplete jobs, I would like to take the media and recycle them back into the pool as we are running low on tapes. I am able to identify the volumes related to the specific failed job. However, I do want to check to see if these volumes are associated with any other jobs so I don't accidently wipe out other jobs. Does anyone know how I might identify all jobs on a specific volume? query 14 *query Available queries: 1: List up to 20 places where a File is saved regardless of the directory 2: List where the most recent copies of a file are saved 3: List last 20 Full Backups for a Client 4: List all backups for a Client after a specified time 5: List all backups for a Client 6: List Volume Attributes for a selected Volume 7: List Volumes used by selected JobId 8: List Volumes to Restore All Files 9: List Pool Attributes for a selected Pool 10: List total files/bytes by Job 11: List total files/bytes by Volume 12: List Files for a selected JobId 13: List Jobs stored on a selected MediaId 14: List Jobs stored for a given Volume name 15: List Volumes Bacula thinks are in changer 16: List Volumes likely to need replacement from age or errors 17: List Volumes Bacula thinks are full and in changer 18: Get all the Jobids for a job 19: List Volumes by status 20: List where the most recent copies of folder Choose a query (1-20): 14 Enter Volume name: A00052 ++-+-+--+---+-+-++ | jobid | name| starttime | type | level | files | bytes | status | ++-+-+--+---+-+-++ | 21,780 | BreastConeBeamCTArchive-Job | 2010-07-06 15:20:36 | B| I | 359,799 | 382,912,010,067 | T | | 21,797 | SCCORArchive-Job| 2010-07-08 09:03:37 | B| I | 21,011 | 11,035,952,565 | T | | 21,898 | PLuSSArchive-Job| 2010-07-19 05:46:27 | B| I | 5,729 | 2,999,968,152 | T | | 21,899 | PRO09070131-Archive-Job | 2010-07-19 13:30:45 | B| F | 375 | 6,728,175,230 | T | | 21,900 | IRB0601002-Archive-Job | 2010-07-19 13:41:45 | B| F | 200 | 98,143,038 | T | | 21,901 | PRO09070131-Archive-Job | 2010-07-19 13:46:30 | B| I | 29 | 0 | T | | 21,922 | IRB0601002-Archive-Job | 2010-07-21 08:39:24 | B| I | 1 | 0 | T | | 21,923 | IRB0601002-Archive-Job | 2010-07-21 11:40:20 | B| F | 2,199 | 28,709,501,042 | T | | 21,944 | SARP-Archive-Job| 2010-07-23 08:11:24 | B| I | 8,287 | 4,360,314,222 | T | | 21,975 | SARP-Archive-Job| 2010-07-26 08:11:36 | B| I | 1,884 | 991,829,792 | T | | 21,986 | SARP-Archive-Job| 2010-07-27 13:25:21 | B| I | 1,610 | 846,989,718 | T | | 21,998 | BreastConeBeamCTArchive-Job | 2010-07-28 14:58:54 | B| I | 56,296 | 57,601,152,105 | T | | 22,029 | PLuSSArchive-Job| 2010-07-30 13:06:30 | B| I | 0 | 0 | T | ++-+-+--+---+-+-++ * -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] recycling media for failed jobs
On Mon, Aug 2, 2010 at 5:33 PM, Jeremiah D. Jester jj...@u.washington.edu wrote: Any idea why mine doesn't return? *query Available queries: Selection list for is empty! *query 14 Available queries: Selection list for is empty! You probably have an empty query.sql. I believe in version 5.0.X they moved from replacing your query.sql with putting one with the documentation and examples. I will try to find a link to one you can download. John -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] recycling media for failed jobs
On Mon, Aug 2, 2010 at 5:41 PM, John Drescher dresche...@gmail.com wrote: On Mon, Aug 2, 2010 at 5:33 PM, Jeremiah D. Jester jj...@u.washington.edu wrote: Any idea why mine doesn't return? *query Available queries: Selection list for is empty! *query 14 Available queries: Selection list for is empty! You probably have an empty query.sql. I believe in version 5.0.X they moved from replacing your query.sql with putting one with the documentation and examples. I will try to find a link to one you can download. I found the release notes for 5.0.1 and that told me where the file went. Here is a link: http://bacula.git.sourceforge.net/git/gitweb.cgi?p=bacula/bacula;a=blob_plain;f=bacula/examples/sample-query.sql;hb=HEAD John -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users