[Bacula-users] disk full, need to reset and upgrade
Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : - a lot of data is backed up on remote host uselessly (as log file ...) - I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula - My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : - upgrade to v3 and backup only what is needed (with the exclude feature) - delete all existing backup in /backup (150GB) - start backing up on /mnt/backup my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk full, need to reset and upgrade
One other thing : I've set to 40 volumes. When all volume were filled up, I was expecting bacula to recycle the first volume... but it didn't, I had to increase the number of volume... Thomas. On Tue, Aug 4, 2009 at 09:58, Thomas Manson dev.mansontho...@gmail.comwrote: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : - a lot of data is backed up on remote host uselessly (as log file ...) - I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula - My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : - upgrade to v3 and backup only what is needed (with the exclude feature) - delete all existing backup in /backup (150GB) - start backing up on /mnt/backup my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk full, need to reset and upgrade
Hi Thomas, there is an exclude feature in previous bacula versions as well. And if you are talking about the new Exclude Dir Containing feature: You can achieve the same behavior in 2.x versions of bacula with an Exclude setting like this: FileSet { Name = MyFileSet Include { Options { ... } File = ... } Exclude { File = \\|sh -c 'for D in / /var /home; do find $D -xdev -name .BACULA_NO_BACKUP -type f -printf \%h\\n\; done | tee /root/bacula_excluded_dirs.log' } } You have to put the relevant filesystems into the list of the for-loop. In this case all dirs containing a file .BACULA_NO_BACKUP within the /, /var or /home filesystem will not be backed up. And you will find a list of directories that have been excluded this way in /root/bacula_excluded_dirs.log I am using this mechanism since years and it works very well. -Marc * Thomas Manson schrieb am 04.08.09 um 09:58 Uhr: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : - a lot of data is backed up on remote host uselessly (as log file ...) - I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula - My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : - upgrade to v3 and backup only what is needed (with the exclude feature) - delete all existing backup in /backup (150GB) - start backing up on /mnt/backup my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- 8AAC 5F46 83B4 DB70 8317 3723 296C 6CCA 35A6 4134 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk full, need to reset and upgrade
Hi Thomas, It isn't clear from your message what you are asking for help with. That said I have made some comments inline below. Thomas Manson wrote: One other thing : I've set to 40 volumes. When all volume were filled up, I was expecting bacula to recycle the first volume... but it didn't, I had to increase the number of volume... Thomas. On Tue, Aug 4, 2009 at 09:58, Thomas Manson dev.mansontho...@gmail.com mailto:dev.mansontho...@gmail.com wrote: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : * a lot of data is backed up on remote host uselessly (as log file ...) * I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula * My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : * upgrade to v3 and backup only what is needed (with the exclude feature) It isn't clear if Exclude is the only reason why you want to upgrade to v3 but the Exclude directive in FileSet has been there for a long time and it certainly exists in the 2.x series. There is no need to upgrade to get that functionality. * delete all existing backup in /backup (150GB) * start backing up on /mnt/backup Why not just copy/move the data from /backup into /mnt/backup and then change your -sd configuration to point to /mnt/backup. That way you can keep all of your existing backups and get your setup correctly configured without too much disruption. Before you copy the data you should ensure that no backups are currently running and stop the -sd before moving the files. Once you have moved the files edit you bacula-sd.conf to point to the new location and restart the sd daemon. Regards Richard my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] reversing order of contact?
Hi, I've wondered about why my clients won't back up, but think that I found the problem after reviewing this page: http://www.bacula.org/en/dev-manual/What_is_Bacula.html#SECTION0022 The picture specifies that the client accesses the server to ship its data. This collides with my settings quite a bit because the director and storage server are behind a firewall, and cannot directly be accessed by the clients. What would work, however, is to tell the director/storage daemon(s) to contact the client, but offhand, I don't seem to figure out how to configure this. For me, the problem would be removed if I could have this SD - FD instead of FD - SD (as described on this page: http://www.bacula.org/en/rel-manual/Dealing_with_Firewalls.html). I'd like to know why the original desin decision was taken, as the client (FD) doesn't have any knowledge about where the storage server is, anyway, the director could imho equally well tell the storage daemon to talk to a certain client, than it could tell the client to talk to a certain storage server. Maybe I'm missing something... Kind regards, --Toni++ -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] yet another volume recycling issue
Hi, I'm having the hardest time getting volumes to be recycled, under version 2.4.4-1 (Debian 5.0). I feel like I have double-checked every item mentionned in chapters 22 and 23 (Automatic Volume Recycling / Basic Volume Management), have forced what seems like all the relevant values with 'update media', and have changed many relevant pool options. I've restarted the daemons, and the jobs after each change. Even following the manual purging/recycling procedure did not change the software's behaviour. Every time, the storage daemon prints the message Cannot find any appendable volumes. Please use the label command to create a new Volume. I've been using Bacula for a couple of years, and I realize that I've never gotten through a full yearly cycle before, because of having blanked all my catalogs and volumes a few times before because I wasn't satisfied with my setup. So I've never seen the volume recycling in action before. Things are apparently not as simple as stated in the manual and in numerous messages on the list. What might I be overlooking ? Here are excerpts of my setup for the relevant pool : Pool: LBC Software Archive Tapes +-+-+---+-+-+--+--+-+--+---+--+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes| VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType| LastWritten | +-+-+---+-+-+--+--+-+--+---+--+-+ | 1 | Fujifilm_01 | Purged| 1 | 178,965,709,824 | 179 | 7,776,000 | 1 |0 | 0 | LTO2 Ultrium | 2009-03-10 08:19:21 | | 2 | Fujifilm_02 | Full | 1 | 40,301,968,384 | 41 | 7,862,400 | 1 |0 | 0 | LTO2 Ultrium | 2009-03-10 10:39:00 | | 3 | Fujifilm_03 | Full | 1 | 187,139,884,032 | 188 | 15,724,800 | 1 |0 | 0 | LTO2 Ultrium | 2009-05-20 10:52:30 | | 4 | Fujifilm_04 | Used | 1 | 75,389,556,736 | 77 | 15,724,800 | 1 |0 | 0 | LTO2 Ultrium | 2009-05-21 08:23:47 | +-+-+---+-+-+--+--+-+--+---+--+-+ Pool { Name = LBC Software Archive Tapes Pool Type = Backup Maximum Volumes = 4# was disabled, changed to 4 with no success Recycle = yes #RecyclePool = Scratch Recycle Oldest Volume = yes #Recyle Current Volume = no Purge Oldest Volume = yes AutoPrune = yes Volume Retention = 14 weeks Storage = Tandberg Data LTO2 Ultrium Half-Height Tape Drive #Use Volume Once = no # deprecated Maximum Volume Jobs = 0 Maximum Volume Files = 0 Maximum Volume Bytes = 0 Volume Use Duration = 13 weeks Catalog Files = yes #Cleaning Prefix = CLN #Label Format# deprecated since v1.31, see Python script } Lucas Cohen -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula, LTO1 not using entire tape
Hi I have a problem with tapes not being fully written Bacula reports them as FULL with less then 100GB written It then loads the next tape and contines the backup only to Fill the tape with out using 100GB, sometimes it uses over 100GB The amount of data written is random and starts from a few GB Any ideas? -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, LTO1 not using entire tape
On Fri, 31 Jul 2009, Chris wrote: Hi I have a problem with tapes not being fully written Bacula reports them as FULL with less then 100GB written How much less than 100Gb? -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, LTO1 not using entire tape
-Original Message- From: Chris chrisneilbr...@gmail.com Sent: Tuesday, 4 August 2009 8:49 PM To: bacula-users@lists.sourceforge.net bacula-users@lists.sourceforge.net Subject: [Bacula-users] Bacula, LTO1 not using entire tape Hi I have a problem with tapes not being fully written Bacula reports them as FULL with less then 100GB written It then loads the next tape and contines the backup only to Fill the tape with out using 100GB, sometimes it uses over 100GB The amount of data written is random and starts from a few GB Any ideas? --- Are you getting any SCSI errors in /var/log/messages? Any errors in the Bacula job log? Matthias -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] canceled job still in running job section
Same problem. François Mehault wrote: Hi All I contact you because I don't succeed to cancel my job. This morning I have numerous Job in running job section in bconsole. I have some problem that I will fix but for the moment I want to stop properly all running jobs. So I use the cancel command, then my job is marked canceled : JobId 28415, Job X-Job.2009-06-29_03.20.00.20 marked to be canceled. But the job stay in running section. What can I do ? If I don't stop the job properly with restarting the dameon, I know that I will have wrong information in my Catalog and I will have to modify the Catalog with query. If someone has an idea, I will arreciate. Thanks Regards François -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users __ Scanned by Google Message Security - Leaving Seaman Paper -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Frozen canceled jobs
This is a chronic problem in every version of bacula since 1.38 and has, as far as this list is concerned, never been addressed. Marek Simon wrote: Hi, I have jobs, which have frozen. The reason of frozing is not subject of this message, I will deal with it next time. But now I have canceled the job. The job has been marked canceled, but still hangs in the queue and block other jobs to proceed (they are waiting for releasing storage media). The only way I found is to restart the bacula-dir completely but it removes all the jobs. I want to remove just only those canceled jobs. Marek -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users __ Scanned by Google Message Security - Leaving Seaman Paper -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Empty log files and no messages on console
Hi, I am having a really anonying bug with bacula. The log files are empty, the email notifications only have the subjet filled in, and running jobs on the console don't display anything. I don't believe having changed anything to the configuration when the logs disappeared (1st of august). At first I thought it was logrotate that rotated the log and left bacula writing to another file. I don't think that is the case anymore since I've restarted bacula, changed the log file, even stupidly rebooted the machine. The modification time on the log file changes but no content in it. The backups still work (I get a bunch of OKs). I've fiddled with setdebug and autodisplay with no success. Thanks for any tips investigating this annoying bug (bacula 2.4 on a bunch of debian machines). Otherwise thanks for a great product. Arthur -- Arthur LUTZLOGILAB, Paris (France) http://www.logilab.com http://www.logilab.fr http://www.logilab.org Développement logiciel avancé - Intelligence Artificielle - Formations CubicWeb, the semantic web framework: http://www.cubicweb.org -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Running nightly regression scripts
Hello, If you are currently running nightly regression scripts for Bacula, I thank you very much because your test results help us find subtle OS dependent bugs. Due to the change from SVN to git, you will need to make some minor modifications to get the regression scripts running again. (Thanks to Frank Sweetser for making the svn to git regress patch). First ensure that git is installed on your machine. If you currently have the following directory structure for running the regression scripts: /bacula /regress Then please copy /regress/config to some temporary location, e.g. cp /regress/config /tmp/config then do the following, which will delete and replace your directory by the git version. rm -rf git clone git://bacula.git.sourceforge.net/gitroot/bacula cp /tmp/config /regress/config where in each case, replace by the full path to directory containing bacula and regress. Once you have done the above, the regression scripts can be run exactly as they were before. In fact, if you have a cron job that does it, it should continue to work as before. Thanks for testing and sorry for the inconvenience. Best regards, Kern -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Empty log files and no messages on console
Hi Arthur, It seems like it all has to do with the Messages sectionhttp://www.bacula.org/en/rel-manual/Messages_Resource.html#MessagesChapterin the director configuration. Maybe that's a pointer? Cheers, Maarten Hoogveld 2009/8/4 Arthur Lutz arthur.l...@logilab.fr Hi, I am having a really anonying bug with bacula. The log files are empty, the email notifications only have the subjet filled in, and running jobs on the console don't display anything. I don't believe having changed anything to the configuration when the logs disappeared (1st of august). At first I thought it was logrotate that rotated the log and left bacula writing to another file. I don't think that is the case anymore since I've restarted bacula, changed the log file, even stupidly rebooted the machine. The modification time on the log file changes but no content in it. The backups still work (I get a bunch of OKs). I've fiddled with setdebug and autodisplay with no success. Thanks for any tips investigating this annoying bug (bacula 2.4 on a bunch of debian machines). Otherwise thanks for a great product. Arthur -- Arthur LUTZLOGILAB, Paris (France) http://www.logilab.com http://www.logilab.fr http://www.logilab.org Développement logiciel avancé - Intelligence Artificielle - Formations CubicWeb, the semantic web framework: http://www.cubicweb.org -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] reversing order of contact?
Toni Mueller supp...@oeko.net kirjoitti viestissä news:20090804093746.32479.qm...@oak.oeko.net... Hi, I've wondered about why my clients won't back up, but think that I found the problem after reviewing this page: http://www.bacula.org/en/dev-manual/What_is_Bacula.html#SECTION0022 The picture specifies that the client accesses the server to ship its data. This collides with my settings quite a bit because the director and storage server are behind a firewall, and cannot directly be accessed by the clients. What would work, however, is to tell the director/storage daemon(s) to contact the client, but offhand, I don't seem to figure out how to configure this. There is a manual chapter about how to deal with firewalls bacula. Basically, you need to open your firewall a little bit: allow spesific clients to open connection to spesific ports of the server. -- TiN -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] rejected Hello command
On Fri, 2009-07-31 at 20:55 +0100, Martin Simmons wrote: On Tue, 30 Jun 2009 10:58:26 -0400, Shawn said: The problem is the following: 30-Jun 10:31 skydro-dir JobId 0: Fatal error: File daemon at 10.6.4.230:9102 rejected Hello command This happens on Microsoft Windows Vista x64, Windows 2008 Server x64, and Windows 2003 x64. Version I am using on the client ends are win64bacula-3.0.1.exe The file server itself is an Ubuntu 64-bit, jaunty, server edition, with latest bacula-director package, using mysql locally for a DB. The error sounds like a version mismatch to me. What is the exact version of your bacula-director package? I think it must be 3.x to work with a 3.x file daemon. If you are running a 3.x director, then try setting debug level 200 and see what output that generates. In particular, the filed debug message should show what the file daemon returns when it rejects the hello. __Martin You are correct, Mr. Simmons, This also was found happening on Fedora 6 i386 as well as Mac OS X both Intel and PowerPC, the Hello command wasn't even introduced until 3.x from information I've gathered out there. I found out during investigation, though, that the director (on fresh Ubuntu Jaunty amd64) was actually behind (not sure why, but Ubuntu repository hasn't updated past 2.4.4 - could it be because Mac OS X packages aren't being maintained?). I've switched all clients to 2.4.4 and most seem fine now. Thanks again, - Shawn Q. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Empty log files and no messages on console
Arthur Lutz wrote: Hi, I am having a really anonying bug with bacula. The log files are empty, the email notifications only have the subjet filled in, and running jobs on the console don't display anything. I don't believe having changed anything to the configuration when the logs disappeared (1st of august). At first I thought it was logrotate that rotated the log and left bacula writing to another file. I don't think that is the case anymore since I've restarted bacula, changed the log file, even stupidly rebooted the machine. The modification time on the log file changes but no content in it. The backups still work (I get a bunch of OKs). I've fiddled with setdebug and autodisplay with no success. Thanks for any tips investigating this annoying bug (bacula 2.4 on a bunch of debian machines). Otherwise thanks for a great product. Arthur Hi Arthur, are you sure the rotate log doesn't create the new file with wrong permission check owner and right to the /var/lib/bacula and log file. If your config doesn't have change, it's certainly a simple question of rights. -- Bruno Friedmann -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] VSS on Vista/Win2008 x64
Hello folk, We're primarily a 95% linux desktop and server environment, with some Macs, but we have a couple of pain in the necks we need to back up and I'm concerned about VSS. One is a Windows Server 2008 64-bit, and another is Vista 64-bit. Some things back up fine, but, I get the following VSS error on both jobs: Warning: VSS was not initialized properly. VSS support is disabled. ERR=An attempt was made to reference a token that does not exist. This using version 2.4.4 across the entire network, using Ubuntu Jaunty amd64 server for director - which is also 2.4.4. I've found bits and pieces out there about Oh blah blah x64 VSS support doesn't work with 32-bit whine whine - but, no resolutions - was this fixed already in later versions? Sorry if this is redundant. It doesn't seem to matter if I put Enable VSS = yes, or no - in this FileSet after the Name = field. The following is my fileset for the Win2k8 x64 server, and version browser shows it works fine by all appearances: FileSet { Name = solarset Ignore FileSet Changes = yes Include { Options {# exclude exclude = yes Ignore Case = yes WildFile = *.tmp Wild = [A-Z]:/pagefile.sys wilddir = [A-Z]:/Boot wilddir = [A-Z]:/Temp wilddir = [A-Z]:/Windows/Temp* wilddir = *Temporary Internet Files* WildDir = [A-Z]:/Users/*/AppData/*/Mozilla/Firefox/Profiles/*/Cache WildDir = [A-Z]:/Users/*/AppData/*/Mozilla/Firefox/Profiles/*/*/Cache.Trash WildDir = [A-Z]:/$Recycle.Bin WildDir = [A-Z]:/Documents and Settings WildDir = [A-Z]:/CPQSYSTEM WildDir = [A-Z]:/compaq WildDir = [A-Z]:/Brother-MFC-7820N WildDir = [A-Z]:/HP WildDir = [A-Z]:/HP PCL5 Universal Print Driver WildDir = [A-Z]:/drivers WildDir = [A-Z]:/p21_updates WildDir = [A-Z]:/Windows Wild = [A-Z]:/Users/*/AppData/Local/Mozilla/Firefox/* Wild = [A-Z]:/Users/*/AppData/*/Microsoft/* Wild = [A-Z]:/Users/*/AppData/* WildDir = [A-Z]:/Users/*/Documents/My Music WildDir = [A-Z]:/Users/*/Documents/My Videos WildDir = [A-Z]:/Users/*/Documents/My Pictures Wild = [A-Z]:/Users/*/Documents/My Music/* Wild = [A-Z]:/Users/*/Documents/My Videos/* Wild = [A-Z]:/Users/*/Documents/My Pictures/* WildDir = [A-Z]:/ProgramData/Application Data WildDir = [A-Z]:/ProgramData/Desktop WildDir = [A-Z]:/ProgramData/Documents WildDir = [A-Z]:/ProgramData/Favorites WildDir = [A-Z]:/ProgramData/Start Menu WildDir = [A-Z]:/ProgramData/Templates WildDir = [A-Z]:/Users/*/Application Data WildDir = [A-Z]:/Users/*/Cookies WildDir = [A-Z]:/Users/*/Local Settings WildDir = [A-Z]:/Users/*/My Documents WildDir = [A-Z]:/Users/*/NetHood WildDir = [A-Z]:/Users/*/PrintHood WildDir = [A-Z]:/Users/*/Recent WildDir = [A-Z]:/Users/*/SendTo WildDir = [A-Z]:/Users/*/Start Menu WildDir = [A-Z]:/Users/*/Templates WildDir = [A-Z]:/Users/Default User Wild = [A-Z]:/Users/*/NTUSER.DAT* WildDir = [A-Z]:/Users/All Users } Options { # include Ignore Case = yes signature = SHA1 compression = GZIP # noatime = yes # onefs = yes ignore case = yes WildDir = [A-Z]:/Users/*/AppData/*/Mozilla/Firefox/Profiles/ Wild = [A-Z]:/Users/*/AppData/*/Mozilla/Firefox/Profiles/* WildDir = [A-Z]:/Users/*/AppData/*/Identities WildDir = [A-Z]:/Users/*/AppData/*/Mozilla WildDir = [A-Z]:/Users/*/AppData/*/Thunderbird WildDir = [A-Z]:/Users/*/AppData/*/Microsoft WildDir = [A-Z]:/Users/*/AppData/*/Application Data WildDir = [A-Z]:/Users/*/Documents WildDir = [A-Z]:/Users/*/Desktop WildDir = [A-Z]:/Users/*/Favorites Wild = [A-Z]:/Users/*/AppData/*/Identities/* Wild = [A-Z]:/Users/*/AppData/*/Mozilla/* Wild = [A-Z]:/Users/*/AppData/*/Thunderbird/* WildDir = [A-Z]:/Users Wild = [A-Z]:/Users/* WildDir = [A-Z]:/Users/*/Documents WildDir = [A-Z]:/Users WildDir = [A-Z]:/Users/* Wild = [A-Z]:/Users/*/Documents/* Wild = [A-Z]:/Users/* Wild = [A-Z]:/Users/*/* } File = c:/ } } -- Shawn Q Artemide, Inc. IT Specialist -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TLS negotiation failed with FD
Siyoucef Arslan wrote: hi I have this problem when I want to connect a external client. but I can connect with and without TLS probelem with the local client. error: Fatal Error: TLS negotiation failed with FD at xxx.xxx.xxx.xxx: 9102. 03-Aug 16:17 WN-ASI-01-dir JobID 0: Fatal Error: bnet.c: 307 host TLS certificate verification failed. Host name xxx.xxx.xxx.xxx did not match certificate presented What is the solution? This is almost certainly happening because the CN in your certificate for the FD did not match what you listed in the Address field for the client stanza. In other words, if you had this stanza in the director's config file: Client { Name = client.example.com-fd Address = client.example.com ... } then the CN in the certificate used by the FD would need to be client.example.com. I haven't tried it with an IP address in the Address field or CN, so I don't know how that would affect things. Hope that helps, Hugh -- Hugh Brown, Systems Manager The Centre for High-Throughput Biology hbr...@chibi.ubc.ca -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk full, need to reset and upgrade
Hi Marc, I've already tried something similar. As the backup filesystem is remote (through ssh), before the execution of the backup, I execute a remote script that list all directory to exclude, then scp to the Director machine and do the job. (tech detail may be inaccurate as it's off the top of my head) but after a check it didn't work (all data were backup, excluded directory too), and I didn't have time to work on it... I'll try again tonight as it become urgent... ;o) But I really need to reset bacula storage, set the save path to the NAS and enable the recycling feature on the volume. Thomas. On Tue, Aug 4, 2009 at 11:02, Marc Schiffbauer m...@schiffbauer.net wrote: Hi Thomas, there is an exclude feature in previous bacula versions as well. And if you are talking about the new Exclude Dir Containing feature: You can achieve the same behavior in 2.x versions of bacula with an Exclude setting like this: FileSet { Name = MyFileSet Include { Options { ... } File = ... } Exclude { File = \\|sh -c 'for D in / /var /home; do find $D -xdev -name .BACULA_NO_BACKUP -type f -printf \%h\\n\; done | tee /root/bacula_excluded_dirs.log' } } You have to put the relevant filesystems into the list of the for-loop. In this case all dirs containing a file .BACULA_NO_BACKUP within the /, /var or /home filesystem will not be backed up. And you will find a list of directories that have been excluded this way in /root/bacula_excluded_dirs.log I am using this mechanism since years and it works very well. -Marc * Thomas Manson schrieb am 04.08.09 um 09:58 Uhr: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : - a lot of data is backed up on remote host uselessly (as log file ...) - I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula - My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : - upgrade to v3 and backup only what is needed (with the exclude feature) - delete all existing backup in /backup (150GB) - start backing up on /mnt/backup my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- 8AAC 5F46 83B4 DB70 8317 3723 296C 6CCA 35A6 4134 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tapes not fully written
Well... the problem is discovered... I don't even dare to say what it was... :( With kind regards, Tony -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Catalog too big / not pruning?
Lately, I've been going though our file server looking for disk space to reclaim, and I've come across 14GB worth of data in the Postgres DB, used only by Bacula. Reading through the Bacula manual, I see that each file record is supposed to take up 154 bytes in the DB, so I have gone through the logs to see how many records should be saved, keying on FD Files Written. Our rotation: Level=Full Pool=Weekly sun at 2:00 Level=Differential Pool=Daily FullPool=Weekly mon-fri at 2:00 File and Job Retention is set to 5 weeks in the Client directives, Volume Retention is set to 5 weeks in the Pool directives. AutoPrune is set to Yes in both places. The exception is the Monthly pool, used by 2 clients (small): Level=Full Pool=Monthly 1st sun at 1:00 Level=Full Pool=Weekly 2nd-4th sun at 1:00 Level=Differential Pool=Daily FullPool=Weekly mon-fri at 2:00 For the Monthly pool, File Retention is set to 90d, and Job Retention is set to 1y in the Client directives, and Volume Retention is set to 1y in the pool. AutoPrune is set to Yes in the Client Directives, but had been set to No in the Pool, which was a red flag. I changed it to Yes, and restarted Bacula. The numbers: In the last 5 weeks, the sum of the backed up files to the Weekly and Daily pools is 3,588,224, and of the other two, 1 client backs up 2 files to the Monthly pool a month, and the other, consistently just under 6,640 files. So, if my catalog should have a total of 3,667,928 files in it (3,588,224 + (2*12) + (6,640 * 12)) * 154 bytes per file, the DB should be 564,860,912 bytes or 538MB? Made me either wonder where my math went wrong, or why my DB is so big. So, after running a full vacuum on the Postgres DB and only reclaiming 1GB of disk space, I started poking around in the DB itself (just looking). The most interesting thing I have found so far is a table named 'job', which seems to hold all the job records. And they go back to 2006 Example: bacula=# select * from job where starttime like '2006%'; jobid | job | name | type | level | clientid | jobstatus | schedtime | starttime | endtime | jobtdate | volsessionid | volsessiontime | jobfiles | jobbytes | joberrors | jobmissingfiles | poo lid | filesetid | purgedfiles | hasbase ---+-+-+--+---+--+ ---+-+-+-+ +--++--+---+---+-+ +---+-+- 272 | Mail_Data.2006-01-26_02.00.06 | Mail Data | B| D | | f | 2006-01-26 02:00:05 | 2006-01-26 02:08:49 | 2006-01-26 02:37:33 | 1138261053 |0 | 0 |0 | 0 | 0 | 0 | | | 0 | 0 I thought I would then be clever, and in Bacula use the prune command for the old MailData job, one of the ones set to 5 weeks, but it didn't show up in the list because it was no longer a defined job resource; we don't run that particular job anymore, and haven't for months: thus there should be no jobs for 'MailData' in the catalog at all. Luckily, it was just commented out in bacula-dir.conf, so I uncommented it and restarted bacula. It then showed MailData, and said: Pruned 15 Jobs for client MailData from catalog.. Encouraged, I exited Bacula and checked the DB. They are all still there. Rinse and repeat. This time, Bacula says: No Jobs found to prune., so maybe it did get rid of a few of them after all. But the rest are sitting there derelict, just hogging space. So, why isn't my DB pruning itself? --Jeremy -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog too big / not pruning?
2009/8/4 Jeremy Koppel jkop...@bluecanopy.com: Lately, I’ve been going though our file server looking for disk space to reclaim, and I’ve come across 14GB worth of data in the Postgres DB, used only by Bacula. Reading through the Bacula manual, I see that each file record is supposed to take up 154 bytes in the DB, so I have gone through the logs to see how many records should be saved, keying on “FD Files Written”. Our rotation: Level=Full Pool=Weekly sun at 2:00 Level=Differential Pool=Daily FullPool=Weekly mon-fri at 2:00 File and Job Retention is set to 5 weeks in the Client directives, Volume Retention is set to 5 weeks in the Pool directives. AutoPrune is set to Yes in both places. The exception is the Monthly pool, used by 2 clients (small): Level=Full Pool=Monthly 1st sun at 1:00 Level=Full Pool=Weekly 2nd-4th sun at 1:00 Level=Differential Pool=Daily FullPool=Weekly mon-fri at 2:00 For the Monthly pool, File Retention is set to 90d, and Job Retention is set to 1y in the Client directives, and Volume Retention is set to 1y in the pool. AutoPrune is set to Yes in the Client Directives, but had been set to No in the Pool, which was a red flag. I changed it to Yes, and restarted Bacula. The numbers: In the last 5 weeks, the sum of the backed up files to the Weekly and Daily pools is 3,588,224, and of the other two, 1 client backs up 2 files to the Monthly pool a month, and the other, consistently just under 6,640 files. So, if my catalog should have a total of 3,667,928 files in it (3,588,224 + (2*12) + (6,640 * 12)) * 154 bytes per file, the DB should be 564,860,912 bytes or 538MB? Made me either wonder where my math went wrong, or why my DB is so big. So, after running a full vacuum on the Postgres DB and only reclaiming 1GB of disk space, I started poking around in the DB itself (just looking). The most interesting thing I have found so far is a table named ‘job’, which seems to hold all the job records. And they go back to 2006…. Example: bacula=# select * from job where starttime like '2006%'; jobid | job | name | type | level | clientid | jobstatus | schedtime | starttime | endtime | jobtdate | volsessionid | volsessiontime | jobfiles | jobbytes | joberrors | jobmissingfiles | poo lid | filesetid | purgedfiles | hasbase ---+-+-+--+---+--+ ---+-+-+-+ +--++--+---+---+-+ +---+-+- 272 | Mail_Data.2006-01-26_02.00.06 | Mail Data | B | D | | f | 2006-01-26 02:00:05 | 2006-01-26 02:08:49 | 2006-01-26 02:37:33 | 1138261053 | 0 | 0 | 0 | 0 | 0 | 0 | | | 0 | 0 I thought I would then be clever, and in Bacula use the prune command for the old MailData job, one of the ones set to 5 weeks, but it didn’t show up in the list because it was no longer a defined job resource; we don’t run that particular job anymore, and haven’t for months: thus there should be no jobs for ‘MailData’ in the catalog at all. Luckily, it was just commented out in bacula-dir.conf, so I uncommented it and restarted bacula. It then showed MailData, and said: “Pruned 15 Jobs for client MailData from catalog.”. Encouraged, I exited Bacula and checked the DB. They are all still there. Rinse and repeat. This time, Bacula says: “No Jobs found to prune.”, so maybe it did get rid of a few of them after all. But the rest are sitting there derelict, just hogging space. So, why isn’t my DB pruning itself? I am not sure of that answer but dbcheck can fix this. Make sure you use the -f option otherwise it only checks. John -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] VSS on Vista/Win2008 x64
Hello folk, We're primarily a 95% linux desktop and server environment, with some Macs, but we have a couple of pain in the necks we need to back up and I'm concerned about VSS. One is a Windows Server 2008 64-bit, and another is Vista 64-bit. Some things back up fine, but, I get the following VSS error on both jobs: Warning: VSS was not initialized properly. VSS support is disabled. ERR=An attempt was made to reference a token that does not exist. This using version 2.4.4 across the entire network, using Ubuntu Jaunty amd64 server for director - which is also 2.4.4. I've found bits and pieces out there about Oh blah blah x64 VSS support doesn't work with 32-bit whine whine - but, no resolutions - was this fixed already in later versions? Sorry if this is redundant. It doesn't seem to matter if I put Enable VSS = yes, or no - in this FileSet after the Name = field. Not sure about 2.4.x but 3.0.[012] has a 64 bit windows binary available which works fine for me with VSS on a Windows 2008 x64 server (two of them). The 64 bit windows binary is only the fd and it is a royal pain to install alongside the 32 bit sd and director on the same machine, but you just want to install the fd so you shouldn't have any problems at all. Uninstall the 32 bit version first though as it will get upset about the installation directories. I don't think it's recommended but I don't think you'll have any problems installing a 3.0.2 fd and using it with a 2.4.4 dir+sd. James -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users