Re: [Bacula-users] 1.38.7 - Restoration gives errors, /sys backupped, exclusion fails?
On Saturday 15 April 2006 14:40, Diederik de Vries wrote: Hi there! I'm currently testdriving Bacula 1.38.7. Three machines are backupping eachother: il1 (Windows) - il2 il2 (Linux) - il3 il3 (Linux) - il2 This setup works. Today, I've tried to restore the il3 machine to /tmp/restoretest. The restoration seems to have worked, but I got 2 errors: - 15-Apr 14:22 il2-dir: message.c:454 Mail prog: bsmtp: bsmtp.c:85 Fatal malformed reply from localhost: 552 Error: message too large (Whatever, this isn't really important, to do later) - CMD=/sbin/bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula: Restore Error of il3-fd Full [EMAIL PROTECTED] The last message was created because of /sys, which seems to be backupped. Because of the size being different, Bacula gives an error. However: /sys should not have been backupped! You have /sys explicitly in your include list, so I imagine Bacula is going to back it up. my backup: =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- cwd is: / $ dir drwxr-xr-x 23 root root 4096 2006-02-23 22:37:05 / drwxr-xr-x 2 root root 4096 2006-03-08 14:43:49 /bin/ drwxr-xr-x 3 root root 4096 2006-01-16 22:37:40 /boot/ lrwxrwxrwx 1 root root11 2005-12-07 18:50:55 /cdrom drwxr-xr-x 11 root root 24576 2006-01-18 12:16:02 /dev/ drwxr-xr-x 78 root root 4096 2006-04-07 13:20:05 /etc/ drwxrwsr-x 17 root staff 4096 2006-04-07 13:19:50 /home/ drwxr-xr-x 2 root root 4096 2005-12-07 18:51:30 /initrd/ drwxr-xr-x 9 root root 4096 2006-01-16 22:45:13 /lib/ drwxr-xr-x 2 root root 49152 2005-12-07 18:50:06 /lost+found/ drwxr-xr-x 4 root root 4096 2005-12-07 18:50:55 /media/ drwxr-xr-x 2 root root 4096 2005-12-07 18:51:25 /mnt/ drwxr-xr-x 3 root root 4096 2006-02-19 17:08:03 /opt/ drwxr-xr-x 7 root root 4096 2006-04-09 16:55:12 /root/ drwxr-xr-x 2 root root 4096 2006-03-08 14:43:49 /sbin/ drwxr-xr-x 2 root root 20480 2006-02-25 21:56:35 /spamlearn/ drwxr-xr-x 2 root root 4096 2005-12-07 18:51:30 /srv/ drwxr-xr-x 10 root root 0 2006-01-18 12:15:40 /sys/ drwxr-xr-x 13 root root 4096 2006-02-01 17:04:52 /usr/ drwxr-xr-x 16 root root 4096 2006-02-22 16:02:13 /var/ $ cd sys cwd is: /sys/ $ dir drwxr-xr-x 20 root root 0 2006-01-18 12:15:51 /sys/block/ drwxr-xr-x 11 root root 0 2006-01-18 12:15:57 /sys/bus/ drwxr-xr-x 17 root root 0 2006-01-18 12:15:57 /sys/class/ drwxr-xr-x 6 root root 0 2006-01-18 12:15:50 /sys/devices/ drwxr-xr-x 3 root root 0 2006-01-18 12:15:40 /sys/firmware/ drwxr-xr-x 3 root root 0 2006-04-12 23:12:27 /sys/kernel/ drwxr-xr-x 29 root root 0 2006-02-22 13:33:51 /sys/module/ drwxr-xr-x 2 root root 0 2006-04-12 23:12:27 /sys/power/ $ =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- My FileSet: # List of files to be backed up FileSet { Name = Full Set Include { Options { signature = SHA1 compression=GZIP9 exclude=yes } # # Put your list of files here, preceded by 'File =', one per line #or include an external list with: # #File = file-name # # Note: / backs up everything on the root partition. #if you have other partitons such as /usr or /home #you will probably want to add them too. # # By default this is defined to point to the Bacula build #directory to give a reasonable FileSet to backup to #disk storage during initial testing. # # File = /var/tmp/bacula-1.38.5 File = / File = /sys File = /var File = /usr File = /home } # # If you backup the root directory, the following two excluded # files can be useful # Exclude { File = /proc File = /tmp File = /.journal File = /.fsck File = /backup File = /sys } } =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= -=-=-=-=-=-=- My job: Job { Name = Imagelibrary 3 Type = Backup # Level = Incremental Client = il3-fd FileSet = Full Set Storage = il2-sd Write Bootstrap = /var/bacula/working/il3.bsr Schedule = WeeklyCycle Pool = Full-Pool Full Backup Pool = Full-Pool Incremental Backup Pool = Inc-Pool Differential Backup Pool = Diff-Pool Messages = Standard } =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= -=-=-=-=-=-=- Excluded /backup because of the setup: This contains the files for the Storage Daemon. My
Re: [Bacula-users] Scratch Pool Question
On Friday 14 April 2006 22:04, Bennett, Silas (GE Indust, Security) wrote: Hi Kern, I did not intend for my emails to be read as complaints. I don't really mind complains, and in fact, my response was a complaint :-) Bacula works _Very_ well for me, and I am very grateful for the work that you do. My intent was to essentially submit bug reports against the docs. Is it the case that the Scratch Pool just doesn't work in 1.36? I don't believe the Scratch Pool was implemented in 1.36. There were a few minor bugs in the first releases of 1.38, but nothing that I remember being a total show stopper. If that is the case, simply modifing the docs as such would clear things up a bit: There *should* be no mention of the Scratch Pool in the 1.36 document, so this issue should not come up. I suppose someone could have created a Scratch pool in 1.36, but other than the fact that things would work a bit differently in 1.38.x, I don't see any major problem with having a pool with the name Scratch prior to 1.38, and I don't understand why it would hinder an upgrade. ORIGINAL: H3A NAME=SECTION0001410100 The Scratch Pool/A /H3 A NAME=6959/A A NAME=6960/A In general, you can give your Pools any name you wish, but there is one important restriction: the Pool named BScratch/B, if it exists behaves like a scratch pool of Volumes in that when Bacula needs a new Volume for writing and it cannot find one, it will look in the Scratch pool, and if it finds an available Volume, it will move it out of the Scratch pool into the Pool currently being used by the job. P MODIFIED: H3A NAME=SECTION0001410100 The Scratch Pool/A /H3 A NAME=6959/A A NAME=6960/A In general, you can give your Pools any name you wish, but there is one important restriction: the Pool named BScratch/B, if it exists behaves like a scratch pool of Volumes in that when Bacula needs a new Volume for writing and it cannot find one, it will look in the Scratch pool, and if it finds an available Volume, it will move it out of the Scratch pool into the Pool currently being used by the job. Note that the Scratch pool does not work properly for versions prior to {INSERT VERSION IN WHICH IT IS KNOW TO WORK HERE}, but it is still recommended that you not use the Scratch pool in prior versions for anything else as it will hinder your upgrade path. P Regaurding my previous email, on the migration from SQLite to MySQL, I don't have enough knowledge of the intricacies of SQLite or MySQL to propose a proper migration solution. But I will attempt to put together a documentation change that will point the reader in the right direction. I will send this in a seperate email. I've modified the document in that area simplifying the text letting the user know that the process is not so simple. The new document should be up tomorrow. Regards, Kern -Original Message- From: Kern Sibbald [mailto:[EMAIL PROTECTED] Sent: Friday, April 14, 2006 12:06 AM To: bacula-users@lists.sourceforge.net Cc: Bennett, Silas (GE Indust, Security) Subject: Re: [Bacula-users] Scratch Pool Question On Friday 14 April 2006 04:08, Bennett, Silas (GE Indust, Security) wrote: Hi All, This is a follow up to my SQLite - MySQL migration Email. The Scratch Pool has _NEVER_ worked for me, and during the database migration, I noticed something. In the Pool Table there is a field called ScratchPoolId, and all of the records in the table have ScratchPoolId set to 0. What is the purpose of ScratchPoolId, can I set that to the PoolId value of the Scratch Pool and make stuff work? Is there any configuration file directives to put into the Pool resource definitions to tell it which scratch pool to use? The Docs are again a bit thin here. The ScratchPoolId is not used, so don't worry about it (at least not yet). I don't have time to document all the technical details, so the docs are going to remain very thin in that regard for a long time. However, in the case where someone has specific knowledge of the deficiencies of the manual, it would be more useful to complain and at the same time send me suggested new text rather than throw the work back on me as is the case 95% of the time. -- --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 1.38.7 - Restoration gives errors, /sys backupped, exclusion fails?
Kern and list, Needless to say: this was my own mistake. I adjusted the FileSet, and got an email: Bacula: Restore OK of il3-fd Full :) Thanks, and have a GREAT easter! Diederik Rotterdam, NL --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] New user questions
Recently the place I work for hired a consultant to help us setup Bacula. He has been most helpfull and we have a basic setup working, but I wanted to start learning it since long term I will have to manage it. Pending boss approval I may still go and pester him some more in the near future. Just a matter of getting approval for the extra $$ :-) So far I have not found the following on the docs: * Difference between Full, Differential, Incremental in Bacula. I know the concepts, what I am interested is how these work in bacula. In particular I did a job/mod and changed a full to differental and then did an estimate. The estimate showed a number very close to what the full backup was. Does the estimate only works for full? Out of nearly 3 million files it's hard to imagine that they all changed since a full backup 2 days ago. :) How does bacula determines what has changed? By date/time/md5? Running bacula in FreeBSD (client/server) * If I made a change to bacula-dir.conf is there a command to check the syntax is correct? The consultant mentioned that if the syntax is wrong that it may kill the bacula-dir (is that usually referred as the server?) And if the bacula-dir did die, will running backups stop? * Does Bacula summits one transaction for each file to PostgreSQL? Any way to pool several files as to have them in a single transaction? --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New user questions
On Sat, Apr 15, 2006 at 12:09:18PM -0400, Francisco Reyes wrote: So far I have not found the following on the docs: I'm far from the expert that several other list members are, but I'll take a shot at these. * Difference between Full, Differential, Incremental in Bacula. I know the concepts, what I am interested is how these work in bacula. In particular I did a job/mod and changed a full to differental and then did an estimate. The estimate showed a number very close to what the full backup was. Does the estimate only works for full? Out of nearly 3 million files it's hard to imagine that they all changed since a full backup 2 days ago. :) I'd guess that either you've changed something in your filesystem -- touched most of the files, or changed where a large filesystem is mounted -- or that Bacula overrode your request. Even if you specify an incremental, Bacula will perform a full backup if there's no suitable full backup found. This can happen if you change the fileset, if the last full backup didn't complete or was deleted, or under a few other circumstances. How does bacula determines what has changed? By date/time/md5? Running bacula in FreeBSD (client/server) By timestamp -- mtime, if I recall correctly. It's the same for Linux, the BSDs, and any other Unix-like platforms. * If I made a change to bacula-dir.conf is there a command to check the syntax is correct? The consultant mentioned that if the syntax is wrong that it may kill the bacula-dir (is that usually referred as the server?) I've always thought of the server as everything that's not the console or one of the clients: the director, the storage server, and the database. That is, all the stuff needed to service a client. As for testing your configuration, this is taken directly from the Testing your Configuration Files section of the online documentation: You can test if your configuration file is syntactically correct by running the appropriate daemon with the -t option. The daemon will process the configuration file and print any error messages then terminate. For example, assuming you have installed your binaries and configuration files in the same directory. cd installation-directory ./bacula-dir -t -c bacula-dir.conf And if the bacula-dir did die, will running backups stop? Yup. Even if you're sure that your configuration files are correct, I'd be surprised if the Bacula director could survive the type of mid-job restart the you seem to be contemplating. * Does Bacula summits one transaction for each file to PostgreSQL? Any way to pool several files as to have them in a single transaction? I have no idea, nor any reason to care as the database stuff has always just worked. Are you just curious, or is there some other issue that you're chasing? -- John Kodis. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Encryption?
Reading Bacula's current state I see under heading: Current Implementation Restrictions + Data encryption of the Volume contents. What does that mean? Encryption of volumens are not supported yet? --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Francisco Reyes wrote: Reading Bacula's current state I see under heading: Current Implementation Restrictions + Data encryption of the Volume contents. What does that mean? Encryption of volumens are not supported yet? Correct: There's encryption of the communication between the File Daemon and the Storage Daemon but no encryption of the data as it is written to tape/HDD/CD/DVD. That's still on the todo list. Greetings, Michel -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.2 (MingW32) - GPGrelay v0.959 iD8DBQFEQTD/2Vs+MkscAyURAsdqAKDaTACLUUZ+KUZmL8h78br7U4Q71QCglLVE JGCrYNfaEIhEm1sC89WwKvI= =5nNV -END PGP SIGNATURE- --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption?
Michel Meyers wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Francisco Reyes wrote: Reading Bacula's current state I see under heading: Current Implementation Restrictions + Data encryption of the Volume contents. What does that mean? Encryption of volumens are not supported yet? Correct: There's encryption of the communication between the File Daemon and the Storage Daemon but no encryption of the data as it is written to tape/HDD/CD/DVD. That's still on the todo list. Francisco, I noticed in your other E-Mail you are using FreeBSD. You can place your Bacula volumes on a encrypted device using the built in capabilities of GEOM. If you already have the system in place and don't have the ability to put the disc devices themselves under GBDE/GELI you can create file backed discs on top of your existing file systems. For example: 1. Create a 100GB sparse file. (Seek is specified in sectors of 512 bytes). dd if=/dev/zero of=/vol/encrypted.disc seek=209715200 count=1 2. Create a key dd if=/dev/random of=/home/bob/encrypted.key bs=64 count=1 3. Attach the file to your system. mdconfig -a -t vnode -f /vol/encrypted.disc 4. Initialise the geli encryption layer. geli init -s 8192 -K /home/bob/encrypted.key /dev/md0 5. Attach the encrypted device. geli attach -k /home/bob/encrypted.key /dev/md0 6. Place a filesystem on the encrypted device newfs /dev/md0.eli 7. mount this mount /dev/md0.eli /mnt/encrypted The key file can be placed on a usb stick. Cheers, Dominic Greetings, Michel -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.2 (MingW32) - GPGrelay v0.959 iD8DBQFEQTD/2Vs+MkscAyURAsdqAKDaTACLUUZ+KUZmL8h78br7U4Q71QCglLVE JGCrYNfaEIhEm1sC89WwKvI= =5nNV -END PGP SIGNATURE- --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: [Bacula-devel] ERR=Connection refused SOLVED
On 15 Apr 2006 at 12:36, RYAN M. vAN GINNEKEN wrote: On 13 Apr 2006 at 15:52, RYAN M. vAN GINNEKEN wrote: Hello all i have a fresh install of bacula using mysql database on fedora core 3. I have the following error message paroused though the FAQ's were i found an answer that suggests i should possiably submit a bug report. I have tried this with the default *.conf files and also some i modified to try and make things work. Please help. 13-Apr 15:51 bconsole: Fatal error: bnet.c:859 Unable to connect to Director daemon on shoemasters.com:9101. ERR=Connection refused Is this when starting up bconsole? Yes, I think i may have messed up my bconsole file are the first couple of lines sopposed to look like this. Think i got a little crazy with vi and ended up commenting out the second line cause of errors starting bconsole. #!/bin/sh # which dirname /dev/null # does dirname exit? if [ $? = 0 ] ; then cwd=`dirname $0` if [ x$cwd = x. ]; then bconsole is a binary. not mine it is a scipt looks like this /usr/sbin/bconsole is your binary. [EMAIL PROTECTED] bacula]# vi bconsole #!/bin/sh # which dirname /dev/null # does dirname exit? if [ $? = 0 ] ; then cwd=`dirname $0` if [ x$cwd = x. ]; then cwd=`pwd` fi if [ x$cwd = x/usr/sbin ] ; then echo bconsole not properly installed. exit 1 fi fi if [ x/usr/sbin = x/etc/bacula ]; then echo bconsole not properly installed. exit 1 fi if [ $# = 1 ] ; then echo doing bconsole $1.conf /usr/sbin/bconsole -c $1.conf else /usr/sbin/bconsole -c /etc/bacula/bconsole.conf fi ~ What do you get for: telent shoemasters.com 9101 [EMAIL PROTECTED] bacula]# telnet shoemasters.com 9101 Trying 68.144.188.169... telnet: connect to address 68.144.188.169: Connection refused telnet: Unable to connect to remote host: Connection refused This sonds like the director is not running. Please confirm. you are correct director is not running how do i make this right? [EMAIL PROTECTED] bacula]# ./bacula restart Stopping the Bacula File daemon Stopping the Bacula Storage daemon Stopping the Bacula Director daemon Starting the Bacula Storage daemon Starting the Bacula File daemon Starting the Bacula Director daemon [EMAIL PROTECTED] bacula]# ps -aux | grep bacula Warning: bad syntax, perhaps a bogus '-'? See /usr/share/doc/procps-3.2.3/FAQ root 32207 0.0 0.3 17112 1736 ?Ssl 12:06 0:00 /usr/sbin/bacula-fd -u root -g bacula -v -c /etc/bacula/bacula-fd.conf root 32322 0.0 0.1 3728 644 pts/3R+ 12:07 0:00 grep bacula [EMAIL PROTECTED] bacula]# vi bconsole Looks like some kind of big error going on. Try starting it manually: /usr/sbin/bacula-dir -u bacula -g bacula -v -c /etc/bacula/bacula- dir.conf If necessary, add a -f (I think) to make it stay in the foreground. [EMAIL PROTECTED] bacula]# /usr/sbin/bacula-dir -f -u bacula -g bacula -v -c /etc/bacula/bacula-dir.conf 14-Apr 13:10 shoemasters-dir: ERROR TERMINATION at bsys.c:627 Could not find specified userid: bacula So i added the user bacula to the already existing group bacula now have permission problems [EMAIL PROTECTED] bacula]# /usr/sbin/bacula-dir -f -u bacula -g bacula -v -c /etc/bacula/bacula-dir.conf 14-Apr 13:14 shoemasters-dir: ERROR TERMINATION at message.c:254 Could not open console message file /var/bacula/shoemasters-dir.conmsg: ERR=Permission denied 14-Apr 13:14 shoemasters-dir: Error: message.c:668 fopen /var/bacula/shoemasters-dir.shoemasters-dir.145171056.mail failed: ERR=Permission denied 14-Apr 13:14 shoemasters-dir: Error: message.c:706 fopen /var/bacula/log failed: ERR=Permission denied 14-Apr 13:14 shoemasters-dir: Error: message.c:706 fopen /var/bacula/log failed: ERR=Permission denied 14-Apr 13:14 shoemasters-dir: Error: message.c:668 fopen /var/bacula/shoemasters-dir.shoemasters-dir.145171056.mail failed: ERR=Permission denied 14-Apr 13:14 shoemasters-dir: Error: message.c:668 fopen /var/bacula/shoemasters-dir.shoemasters-dir.145171056.mail failed: ERR=Permission denied 14-Apr 13:14 shoemasters-dir: Error: message.c:706 fopen /var/bacula/log failed: ERR=Permission denied Changed the perms on the log file to 660 now i just get the one error about shoemasters-dir.conmsg see below.
Re: [Bacula-users] Bacula FD on Macintosh
Bill Moran wrote: On Sat, 8 Apr 2006 21:22:26 -0500 Erich Prinz [EMAIL PROTECTED] wrote: Let me know if you want the pre compiled FD. Would you mind putting this up on ftp or something for me to grab. So far I've been unable to build from source or Darwin Ports. Thanks. What version of Mac OS X are you running? Can you provide the DarwinPorts build error output, too? Thanks, -landonf --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] RE: [Bacula-devel] Surprise bug + Scratch pool algorithm
Couldn't you handle both cases transparently. If the pattern has a / in it then pass the full name, otherwise just pass the basename to fnmatch(). That way you get both behaviours without breaking existing examples and configs. Ironically the Windows example FileSet in the manual expects the above behaviour since it has both WildFile = [A-Z]:/WINNT/system32/dhcp/tmp.edb And WildFile = *.tmp -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Monday, April 10, 2006 5:09 AM To: Martin Simmons Cc: [EMAIL PROTECTED]; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-devel] Surprise bug + Scratch pool algorithm On Monday 10 April 2006 13:15, Martin Simmons wrote: On Mon, 10 Apr 2006 12:22:59 +0200, Kern Sibbald [EMAIL PROTECTED] said: Hello, It seems that it is becoming more frequent (probably because of the increasing number of Bacula users) that users submit support questions to the bugs database. This morning a user submitted a bug stating that the WildFile option was broken. Normally, I would have dismissed this as a support problem because most of us realize that wild-cards and regexes are awfully tricky. However, this user presented a *really* simple case with debug output, so I took a look at it, and surprise both WildFile and RegexFile are broken because they match against the full path and filename rather than just the filename. I wonder how many users have torn out their hair trying to figure out why WildFile or RegexFile didn't work :-( Are you really sure that is a bug? I think the word filename in the documentation is ambiguous, but when it says No directories will be matched by this directive it does not mean that the matching is performed only on the basename part. The examples in A Windows Example FileSet are also written to assume that WildFile compares the whole name. The current behaviour is very useful because it allows files in selected directories to be matched, without accidentally matching subdirectories (as Wild will do). After a little more thought about this, I'm not so sure I should change the behavior. It is not what I had originally intended (I didn't program it), but to change it now, given all the examples in the doc would create a number of problems. I think the best solution is to ensure that the documentation is extremely clear, then if there is really a demand, implement a new option such as WildFilename that matches against only the filename (basename). -- Best regards, Kern ( /\ V_V --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-devel mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-devel --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption?
Michel Meyers writes: Correct: There's encryption of the communication between the File Daemon and the Storage Daemon but no encryption of the data as it is written to tape/HDD/CD/DVD. That's still on the todo list. Ok. Thanks for explanation. Perhaps the doc could be updated to read something along thelines of Encryption of volumes not supported yet. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption?
Dominic Marks writes: Bacula volumes on a encrypted device using the built in capabilities of GEOM. For the setup at work this is not much of an option. Specially that there will be jobs running throughout the night. The encrypted partition will be up at all times most likely so if the machine was compromised the data will be visible anyway. For my home setup this may be great. Thanks much for the instructions. I am famliar with GEOM encryption. I use it on my laptop. Have a /data which holds non secure data and /secure where I put all sensitive data. If you already have the system in place and don't have the ability to put the disc devices themselves under GBDE/GELI you can create file backed discs on top of your existing file systems. Was not familiar with that whole procedure. Will keep instructions handy for the future. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New user questions
John Kodis writes: I'd guess that either you've changed something in your filesystem -- touched most of the files, or changed where a large filesystem is mounted -- or that Bacula overrode your request. Can't really imagine any of the above. Anyone could confirm that this sequence works for them: + Create full job + Change job to incremental + Do estimate on job (and estimate will show only changed files) Even if you specify an incremental, Bacula will perform a full backup if there's no suitable full backup found. Full backup finished without problems. Got email with status and I don't recall seeing any problems. And if the bacula-dir did die, will running backups stop? Yup. Even if you're sure that your configuration files are correct, I'd be surprised if the Bacula director could survive the type of mid-job restart the you seem to be contemplating. I really should have written if bacula-dir will die after doing a reload if there are any syntax errors I have no idea, nor any reason to care as the database stuff has always just worked. Are you just curious, or is there some other issue that you're chasing? It is actually a possible PostgreSQL performance issue. If each new record is inserted independantly, the inserts will be slower than if you have many inserts/updates within a single transaction. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New user questions
Estimates are full. It's in the manual, IIRC. Francisco Reyes wrote: John Kodis writes: I'd guess that either you've changed something in your filesystem -- touched most of the files, or changed where a large filesystem is mounted -- or that Bacula overrode your request. Can't really imagine any of the above. Anyone could confirm that this sequence works for them: + Create full job + Change job to incremental + Do estimate on job (and estimate will show only changed files) Even if you specify an incremental, Bacula will perform a full backup if there's no suitable full backup found. Full backup finished without problems. Got email with status and I don't recall seeing any problems. And if the bacula-dir did die, will running backups stop? Yup. Even if you're sure that your configuration files are correct, I'd be surprised if the Bacula director could survive the type of mid-job restart the you seem to be contemplating. I really should have written if bacula-dir will die after doing a reload if there are any syntax errors I have no idea, nor any reason to care as the database stuff has always just worked. Are you just curious, or is there some other issue that you're chasing? It is actually a possible PostgreSQL performance issue. If each new record is inserted independantly, the inserts will be slower than if you have many inserts/updates within a single transaction. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
RE: [Bacula-users] New user questions
Use estimate level=Incremental Or estimate level=Differential From the manual: Using this command, you can get an idea how many files will be backed up, or if you are unsure about your Include statements in your FileSet, you can test them without doing an actual backup. The default is to assume a Full backup. However, you can override this by specifying a level=Incremental or level=Differential on the command line. A Job name must be specified or you will be prompted for one, and optionally a Client and FileSet may be specified on the command line. It then contacts the client which computes the number of files and bytes that would be backed up. Please note that this is an estimate calculated from the number of blocks in the file rather than by reading the actual bytes. As such, the estimated backup size will generally be larger than an actual backup. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Ryan Novosielski Sent: Saturday, April 15, 2006 4:05 PM To: Francisco Reyes Cc: John Kodis; Bacula List Subject: Re: [Bacula-users] New user questions Estimates are full. It's in the manual, IIRC. Francisco Reyes wrote: John Kodis writes: I'd guess that either you've changed something in your filesystem -- touched most of the files, or changed where a large filesystem is mounted -- or that Bacula overrode your request. Can't really imagine any of the above. Anyone could confirm that this sequence works for them: + Create full job + Change job to incremental + Do estimate on job (and estimate will show only changed files) Even if you specify an incremental, Bacula will perform a full backup if there's no suitable full backup found. Full backup finished without problems. Got email with status and I don't recall seeing any problems. And if the bacula-dir did die, will running backups stop? Yup. Even if you're sure that your configuration files are correct, I'd be surprised if the Bacula director could survive the type of mid-job restart the you seem to be contemplating. I really should have written if bacula-dir will die after doing a reload if there are any syntax errors I have no idea, nor any reason to care as the database stuff has always just worked. Are you just curious, or is there some other issue that you're chasing? It is actually a possible PostgreSQL performance issue. If each new record is inserted independantly, the inserts will be slower than if you have many inserts/updates within a single transaction. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=1216 42 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New user questions
Neat! I think this is new for 1.38, as I'm pretty certain you weren't able to do that in the past. Robert Nelson wrote: Use estimate level=Incremental Or estimate level=Differential From the manual: Using this command, you can get an idea how many files will be backed up, or if you are unsure about your Include statements in your FileSet, you can test them without doing an actual backup. The default is to assume a Full backup. However, you can override this by specifying a level=Incremental or level=Differential on the command line. A Job name must be specified or you will be prompted for one, and optionally a Client and FileSet may be specified on the command line. It then contacts the client which computes the number of files and bytes that would be backed up. Please note that this is an estimate calculated from the number of blocks in the file rather than by reading the actual bytes. As such, the estimated backup size will generally be larger than an actual backup. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Ryan Novosielski Sent: Saturday, April 15, 2006 4:05 PM To: Francisco Reyes Cc: John Kodis; Bacula List Subject: Re: [Bacula-users] New user questions Estimates are full. It's in the manual, IIRC. Francisco Reyes wrote: John Kodis writes: I'd guess that either you've changed something in your filesystem -- touched most of the files, or changed where a large filesystem is mounted -- or that Bacula overrode your request. Can't really imagine any of the above. Anyone could confirm that this sequence works for them: + Create full job + Change job to incremental + Do estimate on job (and estimate will show only changed files) Even if you specify an incremental, Bacula will perform a full backup if there's no suitable full backup found. Full backup finished without problems. Got email with status and I don't recall seeing any problems. And if the bacula-dir did die, will running backups stop? Yup. Even if you're sure that your configuration files are correct, I'd be surprised if the Bacula director could survive the type of mid-job restart the you seem to be contemplating. I really should have written if bacula-dir will die after doing a reload if there are any syntax errors I have no idea, nor any reason to care as the database stuff has always just worked. Are you just curious, or is there some other issue that you're chasing? It is actually a possible PostgreSQL performance issue. If each new record is inserted independantly, the inserts will be slower than if you have many inserts/updates within a single transaction. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=1216 42 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
RE: [Bacula-users] New user questions
I don't know for sure, I've only been using Bacula for a couple of weeks. But looking at the CVS logs it looks like it was added in June, 2004. -Original Message- From: Ryan Novosielski [mailto:[EMAIL PROTECTED] Sent: Saturday, April 15, 2006 4:17 PM To: Robert Nelson Cc: 'Francisco Reyes'; 'John Kodis'; 'Bacula List' Subject: Re: [Bacula-users] New user questions Neat! I think this is new for 1.38, as I'm pretty certain you weren't able to do that in the past. Robert Nelson wrote: Use estimate level=Incremental Or estimate level=Differential From the manual: Using this command, you can get an idea how many files will be backed up, or if you are unsure about your Include statements in your FileSet, you can test them without doing an actual backup. The default is to assume a Full backup. However, you can override this by specifying a level=Incremental or level=Differential on the command line. A Job name must be specified or you will be prompted for one, and optionally a Client and FileSet may be specified on the command line. It then contacts the client which computes the number of files and bytes that would be backed up. Please note that this is an estimate calculated from the number of blocks in the file rather than by reading the actual bytes. As such, the estimated backup size will generally be larger than an actual backup. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Ryan Novosielski Sent: Saturday, April 15, 2006 4:05 PM To: Francisco Reyes Cc: John Kodis; Bacula List Subject: Re: [Bacula-users] New user questions Estimates are full. It's in the manual, IIRC. Francisco Reyes wrote: John Kodis writes: I'd guess that either you've changed something in your filesystem -- touched most of the files, or changed where a large filesystem is mounted -- or that Bacula overrode your request. Can't really imagine any of the above. Anyone could confirm that this sequence works for them: + Create full job + Change job to incremental + Do estimate on job (and estimate will show only changed files) Even if you specify an incremental, Bacula will perform a full backup if there's no suitable full backup found. Full backup finished without problems. Got email with status and I don't recall seeing any problems. And if the bacula-dir did die, will running backups stop? Yup. Even if you're sure that your configuration files are correct, I'd be surprised if the Bacula director could survive the type of mid-job restart the you seem to be contemplating. I really should have written if bacula-dir will die after doing a reload if there are any syntax errors I have no idea, nor any reason to care as the database stuff has always just worked. Are you just curious, or is there some other issue that you're chasing? It is actually a possible PostgreSQL performance issue. If each new record is inserted independantly, the inserts will be slower than if you have many inserts/updates within a single transaction. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=1216 42 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=12164 2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula marking tapes Full with only a few GB written
On Wed, 12 Apr 2006, Wolfgang Denk wrote: As mentioned before, I see the same effect when changing the timing: running the SD on a low end system (400 MHz P II) makes the problem go away reliably - with h/w compression on. I am more and more convinced that this is a subtel timing issue in the SCSI tape driver layer. Or possibly a bad cable/terminator... AB --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users