Re: [Bacula-devel] Re: [Bacula-users] Surprise bug + Scratch pool algorithm
On Tuesday 11 April 2006 20:41, David Boyes wrote: Sorry, but I don't understand what a MOVE VOLUME -- or rather what an operator area is. I do understand the concept of an area that is accessible from the outside without opening the library case. Sorry -- terminology thing again. In the very large libraries (the big STK and IBM silos), the operator area is the port where you can load/unload volumes w/o opening the case. It's usually addressed as a range of special slot numbers (in my STK silos, it's slot 9900-9910, in the IBM ones it's slots 1 through 10010) By the way, I don't see any problem for InChanger to have multiple values. Kind of a misleading name, though. It's really a volume state indication -- eg, the volume is mountable or not. In its current usage, I find it to be the best name. It indicates if the volume is in the changer or not. Rough idea I was discussing with Arno on the volume management thing: There's three things we need to know for a classic full volume management lifecycle implementation: 1) the state of a volume (where it is in the volume management cycle) 2) the location of a volume (set of predefined locations) 3) a comment to indicate information that may not be determinable from the media itself (the case of a DR vendor needing a external ID # that is different from the volser of the media is an example where you would need that kind of ability to tag a comment onto a volume record) If we use the cycle that TSM uses (a pretty classic implementation), we get about 7 standard states, only one of which makes sense using InChanger as a variable name (MOUNTABLE, the implication of the current InChanger=1). You've already added the location field as an index to a location table. This is Good. A comment field in the volume record would be a simple text string (60-80 bytes). This shouldn't pose any problems. We redefine InChanger to be VolumeState (or add a VolumeState variable and transiton to it over time). I'm not sure I want to change InChanger. Every change to the database is extremely painful for me, particularly because of SQLite which does not have ALTER TABLE -- it requires hours of work involving minutia. What would the new values for InChanger (or VolumeState) be? -- Best regards, Kern ( /\ V_V --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: [Bacula-devel] Surprise bug + Scratch pool algorithm
Thanks, I corrected the ones I found ... On Monday 10 April 2006 15:07, Martin Simmons wrote: On Mon, 10 Apr 2006 14:09:03 +0200, Kern Sibbald [EMAIL PROTECTED] said: On Monday 10 April 2006 13:15, Martin Simmons wrote: On Mon, 10 Apr 2006 12:22:59 +0200, Kern Sibbald [EMAIL PROTECTED] said: Hello, It seems that it is becoming more frequent (probably because of the increasing number of Bacula users) that users submit support questions to the bugs database. This morning a user submitted a bug stating that the WildFile option was broken. Normally, I would have dismissed this as a support problem because most of us realize that wild-cards and regexes are awfully tricky. However, this user presented a *really* simple case with debug output, so I took a look at it, and surprise both WildFile and RegexFile are broken because they match against the full path and filename rather than just the filename. I wonder how many users have torn out their hair trying to figure out why WildFile or RegexFile didn't work :-( Are you really sure that is a bug? I think the word filename in the documentation is ambiguous, but when it says No directories will be matched by this directive it does not mean that the matching is performed only on the basename part. The examples in A Windows Example FileSet are also written to assume that WildFile compares the whole name. The current behaviour is very useful because it allows files in selected directories to be matched, without accidentally matching subdirectories (as Wild will do). After a little more thought about this, I'm not so sure I should change the behavior. It is not what I had originally intended (I didn't program it), but to change it now, given all the examples in the doc would create a number of problems. I think the best solution is to ensure that the documentation is extremely clear, then if there is really a demand, implement a new option such as WildFilename that matches against only the filename (basename). Yes, that's probably the best thing. There are a couple of unix examples using .journal and .autofsck in the doc that need fixing. __Martin --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-devel mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-devel -- Best regards, Kern ( /\ V_V --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] restoring windows client with wrong fileset and no compatibilty mode
Hello List, hopefully asking that someone of you had an idea, so that can get the data from the tape. My problem is, that i have the wrong fileset for this win2k3 host. I didn´t read the manual good enough to know that i should specify windows filesets with a / instead a \. Now we had the problem that our server business is lost because of a hard disk crash. And with these filesets and job record we are no unable to restore the data from within bconsole to a unix client because the unix client didn´t understand the win32 data stream and we are unable to restore the data to a windows client because of the \ instead of the /. Do you think rebuilding the bacula client for windows with the option to change \ to / is a way to get our data back? Here are the bacula config directives. Job { Name = DATA_business JobDefs = DefaultJob Level = Full Client = business-fd FileSet = business_data Pool = DATA_full Full Backup Pool = DATA_full Incremental Backup Pool = DATA_inc Differential Backup Pool = DATA_diff Schedule = DATA_cycle Priority = 8 write bootstrap = /data/backup/bacula-bootstraps/data_business.dtnet.de.bsr # Max Run Time = 240 minutes } FileSet { Name = business_data Enable VSS = yes Include { Options { signature = MD5 } File = d:\Backup } } Client { Name = business-fd Address = business FDPort = 9102 Catalog = MyCatalog Password = iWair9qu AutoPrune = yes File Retention = 30 days Job Retention = 60 days } Very much thanks for every helping hint! regards, Timo -- --- DT Netsolution GmbH - Talaeckerstr. 30 - D-70437 Stuttgart Tel: +49-711-849910-70 Fax: +49-711-849910-934 WEB: http://www.dtnet.de/ Email: [EMAIL PROTECTED] --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restoring windows client with wrong fileset and no compatibilty mode
On Thursday 13 April 2006 14:13, Timo Eissler wrote: Hello List, hopefully asking that someone of you had an idea, so that can get the data from the tape. My problem is, that i have the wrong fileset for this win2k3 host. I didn´t read the manual good enough to know that i should specify windows filesets with a / instead a \. Now we had the problem that our server business is lost because of a hard disk crash. And with these filesets and job record we are no unable to restore the data from within bconsole to a unix client because the unix client didn´t understand the win32 data stream and we are unable to restore the data to a windows client because of the \ instead of the /. Do you think rebuilding the bacula client for windows with the option to change \ to / is a way to get our data back? Unfortunately, fixing the problem is not so easy. Beginning with version 1.38.8, Bacula will no longer easily accept backslashes in File directives, which should help in the future to avoid this problem. One user reported success in restoring such broken backups by building the Linux version 1.39.x development code (there is no need to actually install it), then using bextract to extract the files to a Linux system. Note, this will not work on version 1.38, it requires version 1.39. I would additionally recommend that you create a .bsr file using the restore command in 1.38.x and then at the yes/mod/no prompt, copy that file to a safe place then answer the question with no. You can then use the .bsr file thus generated to efficiently restore only those files you actually need with the 1.39.x bextract (which knows how to extract Win32 files to Linux/Unix). You must also use your production bacula-sd.conf with bextract and ensure that the Storage daemon is not running ... Here are the bacula config directives. Job { Name = DATA_business JobDefs = DefaultJob Level = Full Client = business-fd FileSet = business_data Pool = DATA_full Full Backup Pool = DATA_full Incremental Backup Pool = DATA_inc Differential Backup Pool = DATA_diff Schedule = DATA_cycle Priority = 8 write bootstrap = /data/backup/bacula-bootstraps/data_business.dtnet.de.bsr # Max Run Time = 240 minutes } FileSet { Name = business_data Enable VSS = yes Include { Options { signature = MD5 } File = d:\Backup } } Client { Name = business-fd Address = business FDPort = 9102 Catalog = MyCatalog Password = iWair9qu AutoPrune = yes File Retention = 30 days Job Retention = 60 days } Very much thanks for every helping hint! regards, Timo -- Best regards, Kern ( /\ V_V --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restoring windows client with wrong fileset and no compatibilty mode
Kern Sibbald schrieb: On Thursday 13 April 2006 14:13, Timo Eissler wrote: Hello List, hopefully asking that someone of you had an idea, so that can get the data from the tape. My problem is, that i have the wrong fileset for this win2k3 host. I didn´t read the manual good enough to know that i should specify windows filesets with a / instead a \. Now we had the problem that our server business is lost because of a hard disk crash. And with these filesets and job record we are no unable to restore the data from within bconsole to a unix client because the unix client didn´t understand the win32 data stream and we are unable to restore the data to a windows client because of the \ instead of the /. Do you think rebuilding the bacula client for windows with the option to change \ to / is a way to get our data back? Unfortunately, fixing the problem is not so easy. Beginning with version 1.38.8, Bacula will no longer easily accept backslashes in File directives, which should help in the future to avoid this problem. One user reported success in restoring such broken backups by building the Linux version 1.39.x development code (there is no need to actually install it), then using bextract to extract the files to a Linux system. Note, this will not work on version 1.38, it requires version 1.39. I would additionally recommend that you create a .bsr file using the restore command in 1.38.x and then at the yes/mod/no prompt, copy that file to a safe place then answer the question with no. You can then use the .bsr file thus generated to efficiently restore only those files you actually need with the 1.39.x bextract (which knows how to extract Win32 files to Linux/Unix). You must also use your production bacula-sd.conf with bextract and ensure that the Storage daemon is not running ... Thanks! i will try that an report success... regards, Timo Here are the bacula config directives. Job { Name = DATA_business JobDefs = DefaultJob Level = Full Client = business-fd FileSet = business_data Pool = DATA_full Full Backup Pool = DATA_full Incremental Backup Pool = DATA_inc Differential Backup Pool = DATA_diff Schedule = DATA_cycle Priority = 8 write bootstrap = /data/backup/bacula-bootstraps/data_business.dtnet.de.bsr # Max Run Time = 240 minutes } FileSet { Name = business_data Enable VSS = yes Include { Options { signature = MD5 } File = d:\Backup } } Client { Name = business-fd Address = business FDPort = 9102 Catalog = MyCatalog Password = iWair9qu AutoPrune = yes File Retention = 30 days Job Retention = 60 days } Very much thanks for every helping hint! regards, Timo -- --- DT Netsolution GmbH - Talaeckerstr. 30 - D-70437 Stuttgart Tel: +49-711-849910-70 Fax: +49-711-849910-934 WEB: http://www.dtnet.de/ Email: [EMAIL PROTECTED] --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] clone only full backups
Title: clone only full backups L.S. We are looking for a solutions to the following problem backup scenario : Our daily backups will be differential and written to harddisk (a 1,5 TB storage device) Our weekly backups will be full and written to harddisk and tape for offsite storage. I know it is possible to clone jobs so I can clone the weekly job Can I define 2 schedules for one backup cycle so my backup looks like something like this : Schedule 1 : run on Monday till Friday and run differential backups to disk Schedule 2 : run on Saturday, Monthly and Yearly and run full backups to disk with a clone job to tape is this possible ? With kind regards, Jasper van der Marel System Administrator Dutch Council for Refugees
Re: [Bacula-users] Automatic volume recycling fails
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 My suspicion here is that your job retention is much longer than 2 days. As such the tape will not roll over. According to the manual, that is not the way things work and the shortest retention period is used. However, I have found reality in this instance to be at odds with the manual (putting aside whether or not keeping jobs longer than the tape is a good idea). _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - User Support Spec. III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 Thomas Sturm wrote: The recycling of used volumes fails. The retention is set to 2 days, but when the job starts (after 6 days without using the tape), I get the following information: Current Volume Do_2-s8 not acceptable because: 1000 OK VolName=Do_2-s8 VolJobs=11 VolFiles=29 VolBlocks=358018 VolBytes=23096161180 VolMounts=153 VolErrors=0 VolWrites=10878720 MaxVolBytes=0 VolCapacityBytes=0 VolStatus=Used Slot=8 MaxVolJobs=0 MaxVolFiles=0 InChanger=0 VolReadTime=0 VolWriteTime=0 EndFile=28 EndBlock=1128 VolParts=0 LabelType=0 13-Apr 08:43 bacula-sd: Please mount Volume Do_2-s8 on Storage Device VS160 (/dev/st0) for Job rechnungsdruck.2006-04-13_08.41.08 The tape Do_2-s8 is mounted and when I purge it manually and do a mount, the backup will start. This ist what list media shows: | mediaid | volumename | volstatus | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-++---++--+--+-+--+---+---+-+ | 67 | Do_2-s8| Used | 23,096,161,180 | 29 | 172,800 | 1 | 8 | 0 | DLT8000 | 2006-04-07 00:16:56 This is from bacula-dir.conf: Pool { Name = Mo-Do Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 2d # 2 Tage Volume Use Duration = 2d# noch 2 Tage nach dem Start des Accept Any Volume = yes # write on any volume in the } What goes wrong here? Thanks for help. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.2.2 (MingW32) iD8DBQFEPlzdmb+gadEcsb4RAsj+AJ9SlwLLRejP1op7x0wDmrkOxkHN4QCePS2f XFfezLR1d96h2HVRfxk8eSA= =DxL6 -END PGP SIGNATURE- --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Mtx-changer issue on Solaris 10 test -e should be test -f
Hi, I think there is a typo in the mtx-changer script debug function. The script fails on the test -e line. On solaris, according to the man page, test -e is not available in the sh shell. Here is the output after setting set= -vx in the script. debug Parms: $ctl $cmd $slot $device $drive + debug Parms: /dev/scsi/changer/c2t4d0 list + test -e /var/bacula/working/mtx.log ./mtx-changer: test: argument expected Changing mtx-changer debug function from debug() { if test -e $dbgfile; then echo `date +\%Y%m%d-%H:%M:%S\` $* $dbgfile fi } To if test -f $dbgfile; then Allows the script to work on my machine. I looked at the current cvs code - it has the test -e. Hope this helps. Regards, Jared Davis --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-web x postgresql
Hy again guys, somebody know tell me when bacula-web will support postgresql? tks Goldim --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Low backup throughput (High load average?)
On Apr 12, 2006, at 3:42 PM, Ian Levesque wrote: I've been trying to optimize the backup speed of my bacula installation. My full backups, no spooling, max out at around 12-13MB/s per client, where I think I should be seeing over 40MB/s. It doesn't appear to affect the speed of per-client backups when more than one client is running at a time. However, I've noticed that the server's load average while in operation is always above 1, and increases for each client it's backing up. So, if 3 clients are being backed-up, I see load averages of above 3 on the server (though CPU utilization is typically less than 50%). I'm not sure if this is normal, or is in any way affecting the speed I'm seeing... Regardless of figuring our the root cause, can anyone tell me if they're seeing the same loads on their servers? I'd like to rule this out as an issue, if possible. I thought I've seen on this list people reporting loads of less than 1 so I'm a little alarmed by this. Thanks, Ian --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restoring windows client with wrong fileset and no compatibilty mode
Timo Eissler schrieb: Kern Sibbald schrieb: On Thursday 13 April 2006 14:13, Timo Eissler wrote: Hello List, hopefully asking that someone of you had an idea, so that can get the data from the tape. My problem is, that i have the wrong fileset for this win2k3 host. I didn´t read the manual good enough to know that i should specify windows filesets with a / instead a \. Now we had the problem that our server business is lost because of a hard disk crash. And with these filesets and job record we are no unable to restore the data from within bconsole to a unix client because the unix client didn´t understand the win32 data stream and we are unable to restore the data to a windows client because of the \ instead of the /. Do you think rebuilding the bacula client for windows with the option to change \ to / is a way to get our data back? Unfortunately, fixing the problem is not so easy. Beginning with version 1.38.8, Bacula will no longer easily accept backslashes in File directives, which should help in the future to avoid this problem. One user reported success in restoring such broken backups by building the Linux version 1.39.x development code (there is no need to actually install it), then using bextract to extract the files to a Linux system. Note, this will not work on version 1.38, it requires version 1.39. I would additionally recommend that you create a .bsr file using the restore command in 1.38.x and then at the yes/mod/no prompt, copy that file to a safe place then answer the question with no. You can then use the .bsr file thus generated to efficiently restore only those files you actually need with the 1.39.x bextract (which knows how to extract Win32 files to Linux/Unix). You must also use your production bacula-sd.conf with bextract and ensure that the Storage daemon is not running ... Thanks! i will try that an report success... regards, Timo So now i have compiled bacula 1.39.6. Now when i restore this on a linux client i get the following: maintain:/data/restore# ~/bextract -b maintain.dtnet.de-dir.restore.\*Console\*.2006-04-13_14.19.03.bsr -c /etc/bacula/bac la-sd.conf SDX-500V . bextract: butil.c:269 Using device: SDX-500V for reading. 13-Apr 17:45 bextract: 3301 Issuing autochanger loaded drive 0 command. 13-Apr 17:45 bextract: 3302 Autochanger loaded drive 0, result is Slot 1. 13-Apr 17:45 bextract: Ready to read from volume DATA_full-0003 on device SDX-500V (/dev/nst0). 13-Apr 17:45 bextract: Forward spacing to file:block 13:0. bextract: -rwxrwxrwx 1 root root 327 2005-06-23 00:09:34 ./d:\Backup/CanaveralIQ/sicher.bat 13-Apr 17:46 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/CanaveralIQ/sicher.bat not corect. Original 327, restored 543. bextract: drwxrwxrwx 1 root root 0 2005-06-22 23:57:19 *none* bextract: -rwxrwxrwx 1 root root 256391680 2005-06-23 00:32:53 ./d:\Backup/db_rewe_db_20041226 13-Apr 17:46 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20041226 not corect. Original 256391680, restored 256391896. bextract: -rwxrwxrwx 1 root root 263338496 2005-06-23 00:33:23 ./d:\Backup/db_rewe_db_20050130 13-Apr 17:47 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050130 not corect. Original 263338496, restored 263338712. bextract: -rwxrwxrwx 1 root root 280312320 2005-06-23 00:33:53 ./d:\Backup/db_rewe_db_20050227 13-Apr 17:47 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050227 not corect. Original 280312320, restored 280312536. bextract: -rwxrwxrwx 1 root root 297941504 2005-06-23 00:34:30 ./d:\Backup/db_rewe_db_20050612 13-Apr 17:47 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050612 not corect. Original 297941504, restored 297941720. bextract: -rwxrwxrwx 1 root root 298072576 2005-06-22 23:56:15 ./d:\Backup/db_rewe_db_20050619 13-Apr 17:48 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050619 not corect. Original 298072576, restored 298072792. bextract: -rwxrwxrwx 1 root root 299121152 2005-06-26 00:00:02 ./d:\Backup/db_rewe_db_20050626 13-Apr 17:48 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050626 not corect. Original 299121152, restored 299121352. bextract: -rwxrwxrwx 1 root root 302135808 2005-07-31 00:00:04 ./d:\Backup/db_rewe_db_20050731 13-Apr 17:48 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050731 not corect. Original 302135808, restored 302136008. bextract: -rwxrwxrwx 1 root root 303774208 2005-08-28 00:00:03 ./d:\Backup/db_rewe_db_20050828 13-Apr 17:49 bextract:
Re: [Bacula-users] restoring windows client with wrong fileset and no compatibilty mode
Timo Eissler schrieb: Timo Eissler schrieb: Kern Sibbald schrieb: On Thursday 13 April 2006 14:13, Timo Eissler wrote: Hello List, hopefully asking that someone of you had an idea, so that can get the data from the tape. My problem is, that i have the wrong fileset for this win2k3 host. I didn´t read the manual good enough to know that i should specify windows filesets with a / instead a \. Now we had the problem that our server business is lost because of a hard disk crash. And with these filesets and job record we are no unable to restore the data from within bconsole to a unix client because the unix client didn´t understand the win32 data stream and we are unable to restore the data to a windows client because of the \ instead of the /. Do you think rebuilding the bacula client for windows with the option to change \ to / is a way to get our data back? Unfortunately, fixing the problem is not so easy. Beginning with version 1.38.8, Bacula will no longer easily accept backslashes in File directives, which should help in the future to avoid this problem. One user reported success in restoring such broken backups by building the Linux version 1.39.x development code (there is no need to actually install it), then using bextract to extract the files to a Linux system. Note, this will not work on version 1.38, it requires version 1.39. I would additionally recommend that you create a .bsr file using the restore command in 1.38.x and then at the yes/mod/no prompt, copy that file to a safe place then answer the question with no. You can then use the .bsr file thus generated to efficiently restore only those files you actually need with the 1.39.x bextract (which knows how to extract Win32 files to Linux/Unix). You must also use your production bacula-sd.conf with bextract and ensure that the Storage daemon is not running ... Thanks! i will try that an report success... regards, Timo So now i have compiled bacula 1.39.6. Now when i restore this on a linux client i get the following: maintain:/data/restore# ~/bextract -b maintain.dtnet.de-dir.restore.\*Console\*.2006-04-13_14.19.03.bsr -c /etc/bacula/bac la-sd.conf SDX-500V . bextract: butil.c:269 Using device: SDX-500V for reading. 13-Apr 17:45 bextract: 3301 Issuing autochanger loaded drive 0 command. 13-Apr 17:45 bextract: 3302 Autochanger loaded drive 0, result is Slot 1. 13-Apr 17:45 bextract: Ready to read from volume DATA_full-0003 on device SDX-500V (/dev/nst0). 13-Apr 17:45 bextract: Forward spacing to file:block 13:0. bextract: -rwxrwxrwx 1 root root 327 2005-06-23 00:09:34 ./d:\Backup/CanaveralIQ/sicher.bat 13-Apr 17:46 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/CanaveralIQ/sicher.bat not corect. Original 327, restored 543. bextract: drwxrwxrwx 1 root root 0 2005-06-22 23:57:19 *none* bextract: -rwxrwxrwx 1 root root 256391680 2005-06-23 00:32:53 ./d:\Backup/db_rewe_db_20041226 13-Apr 17:46 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20041226 not corect. Original 256391680, restored 256391896. bextract: -rwxrwxrwx 1 root root 263338496 2005-06-23 00:33:23 ./d:\Backup/db_rewe_db_20050130 13-Apr 17:47 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050130 not corect. Original 263338496, restored 263338712. bextract: -rwxrwxrwx 1 root root 280312320 2005-06-23 00:33:53 ./d:\Backup/db_rewe_db_20050227 13-Apr 17:47 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050227 not corect. Original 280312320, restored 280312536. bextract: -rwxrwxrwx 1 root root 297941504 2005-06-23 00:34:30 ./d:\Backup/db_rewe_db_20050612 13-Apr 17:47 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050612 not corect. Original 297941504, restored 297941720. bextract: -rwxrwxrwx 1 root root 298072576 2005-06-22 23:56:15 ./d:\Backup/db_rewe_db_20050619 13-Apr 17:48 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050619 not corect. Original 298072576, restored 298072792. bextract: -rwxrwxrwx 1 root root 299121152 2005-06-26 00:00:02 ./d:\Backup/db_rewe_db_20050626 13-Apr 17:48 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050626 not corect. Original 299121152, restored 299121352. bextract: -rwxrwxrwx 1 root root 302135808 2005-07-31 00:00:04 ./d:\Backup/db_rewe_db_20050731 13-Apr 17:48 bextract: bextract Error: attribs.c:394 File size of restored file ./d:\Backup/db_rewe_db_20050731 not corect. Original 302135808, restored 302136008. bextract: -rwxrwxrwx 1 root root 303774208 2005-08-28 00:00:03 ./d:\Backup/db_rewe_db_20050828
Re: [Bacula-users] bacula-web x postgresql
--- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: Hy again guys, somebody know tell me when bacula-web will support postgresql? tks Goldim What is your error? Are you using the version in cvs? John --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Low backup throughput (High load average?)
On Wed, 12 Apr 2006 19:18:33 -0400, Ian Levesque [EMAIL PROTECTED] said: Hi Martin, On Apr 12, 2006, at 6:11 PM, Martin Simmons wrote: Since you have a multi-CPU server, what kind of CPU utilization is 50% (the whole machine or one of the daemon processes)? I've only ever seen bacula take advantage of one CPU; typically I see 50% utilized on one CPU. What about the CPU utilization on the client? Around 10% or less, with backups running in the middle of the night. It is useful to check with /usr/bin/top. I have cacti running and it keeps excellent track of resources on the network during backups. But this is easily reproduced if you think I should procure more specific IO stats. OK, it sounds like CPU is not the problem here. Did you try using spooling? Yes, it puts an enormous load on the backup server; I'm not sure why. I do utilize spooling for incrementals, but I expect them to be slower (which they are). Spooling splits the backup into phases of collecting from the client, writing to the tape (repeated) and then writing to the database. It could be worthwhile investigating the spooling slowness to see if it occurs in one particular phase (look at the console output for spooling messages). Without spooling it might be difficult to detect which phase is slow because they are interleaved for each file sent by the client. __Martin --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: Anyone know where I can find bacula-client 1.36.3 src rpm?
On Wednesday 12 April 2006 20:00, Eric Peterson wrote: Hi Joshua, The spec file would be great. I'm not quite sure what you mean by The client code is in with the rest. I couldn't find any 1.36.3 rpm files on the bacula sourceforge site. The link to the older files seems to be broken. If I can't find a src rpm I'll just grab the source, but I was hoping I wouldn't have to go that far. Although, it sounds like it may be easier just to compile from source since you had spec file problems. Thanks, Eric I found the old sources and RPM's here: http://prdownloads.sourceforge.net/bacula/ But, alas, nothing for CentOS. I downloaded bacula-1.36.3.tar.gz and built against that. The odd thing about the Spec file is that it wants, as one of its sources, Release_Notes-1.36.1-1.tar.gz. I just tar/gzip'ed a release notes file and it seemed to be happy. I ran this specfile with: rpmbuild -bb --define build_centos4 1 --define build_mysql 1 bacula.spec and all seemed to go well. Like I said, I had to comment out all the references to building the docs, but when I did that, the RPMs built great. Hope that helps. j- k- On 4/12/06, Joshua Kugler [EMAIL PROTECTED] wrote: On Wednesday 12 April 2006 13:53, Eric Peterson wrote: Hello, I need to install bacula-fd on my CentOS 4.3 x86_64 clients so I was hoping I could find a src rpm for 1.36.3 so I could build it for my platform. The client code is in with the rest. I just built RPMs for CentOS 4.3, albeit, not x86_64. I can send you the spec file that worked (I had to comment out stuff dealing with docs due to latex errors. j- k- -- Joshua Kugler PGP Key: http://pgp.mit.edu/ CDE System Administrator ID 0xDB26D7CE http://distance.uaf.edu/ --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Joshua Kugler PGP Key: http://pgp.mit.edu/ CDE System Administrator ID 0xDB26D7CE http://distance.uaf.edu/ # Bacula RPM spec file # Copyright (C) 2004 Kern Sibbald # Platform Build Configuration # basic defines for every build %define depkgs ../depkgs %define depkgs_version 29Oct04 %define tomsrtbt tomsrtbt-2.0.103 %define sqlite_bindir /usr/lib/sqlite %define working_dir /var/bacula %define daemon_user root %define daemon_group bacula %define group_file /etc/group %define groupadd /usr/sbin/groupadd # platform defines - set one below or define the build_xxx on the command line # RedHat builds %define rh7 0 %{?build_rh7:%define rh7 1} %define rh8 0 %{?build_rh8:%define rh8 1} %define rh9 0 %{?build_rh9:%define rh9 1} # Fedora Core build %define fc1 0 %{?build_fc1:%define fc1 1} %define fc3 0 %{?build_fc3:%define fc3 1} # Whitebox Enterprise build %define wb3 0 %{?build_wb3:%define wb3 1} # RedHat Enterprise builds %define rhel3 0 %{?build_rhel3:%define rhel3 1} %{?build_rhel3:%define wb3 1} %define rhel4 0 %{?build_rhel4:%define rhel4 1} %{?build_rhel4:%define fc3 1} # CentOS build %define centos4 0 %{?build_centos4:%define centos4 1} %{?build_centos4:%define fc3 1} # SuSE build %define su9 0 %{?build_su9:%define su9 1} # Mandrake build %define mdk 0 %{?build_mdk:%define mdk 1} # test for a platform definition %if ! %{rh7} ! %{rh8} ! %{rh9} ! %{fc1} ! %{fc3} ! %{wb3} ! %{su9} ! %{mdk} %{error: You must specify a platform. Please examine the spec file.} exit 1 %endif # database defines # set for database support desired or define the build_xxx on the command line %define mysql 0 %{?build_mysql:%define mysql 1} # if using mysql 4.x define this and mysql above # currently: Mandrake 10.1, SuSE 9.2, RHEL4 %define mysql4 0 %{?build_mysql4:%define mysql4 1} %define sqlite 0 %{?build_sqlite:%define sqlite 1} %define postgresql 0 %{?build_postgresql:%define postgresql 1} # test for a database definition %if ! %{mysql} ! %{sqlite} ! %{postgresql} %{error: You must specify database support. Please examine the spec file.} exit 1 %endif # 64 bit support %define x86_64 0 %{?build_x86_64:%define x86_64 1} # check what distribution we are %if %{rh7} || %{rh8} || %{rh9} || %{rhel3} || %{rhel4} %define _dist %(grep Red /etc/redhat-release) %endif %if %{fc1} %define _dist %(grep Fedora /etc/redhat-release) %endif %if %{centos4} %define _dist %(grep CentOS /etc/redhat-release) %endif %if %{fc3} ! %{rhel4} ! %{centos4} %define _dist %(grep Fedora /etc/redhat-release) %endif %if %{wb3} ! %{rhel3} %define _dist %(grep White /etc/whitebox-release) %endif %if %{su9} %define _dist %(grep SuSE /etc/SuSE-release)
Re: [Bacula-users] Error - The number of files mismatch
You mean deleting volume from catalog? Check out delete command for console --http://www.bacula.org/rel-manual/Bacula_Console.html#SECTION000206000 JoeOn 4/10/06, Joe Park [EMAIL PROTECTED] wrote: Hello,http://www.bacula.org/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION000348000 mt -f /dev/st0 rewindmt -f /dev/st0 weofIt will reset the tape. mt -f /dev/st0 erase will actually erase them (writing 0s I think) but it will take longer that just writing weof at the beginning of the tape. As for file number mismatch, have you read -- http://www.bacula.org/rel-manual/Tips_Suggestions.html#SECTION000357000 JoeOn 4/10/06, Bradley Schatz [EMAIL PROTECTED] wrote: Hi,I am a newcomer to using bacula, and am being stung by what must be pretty obvious to veterans. I have read the manual cover to cover in search of answers, but cant seem to figure this out. I am consistently having tapes marked with an error as follows: 11-Apr 08:23 foundry-sd: Volume Daily01 previously written, moving to end of data.11-Apr 08:23 foundry-sd: NightlySaveFoundry.2006-04-11_03.05.00 Error: I canot write on Volume Daily01 because: The number of files mismatch! Volume=27 Catalog=2811-Apr 08:23 foundry-sd: Marking Volume Daily01 in Error in Catalog.11-Apr 08:25 foundry-dir: Recycled volume Daily03What causes this kind of off by one error? And how can I completely reset the state of a particular volume to empty to start again? Thanks,bradley
Re: [Bacula-users] bacula-web x postgresql
I'm using the bacula-web 1.1... - error_log: [client 10.0.0.151] PHP Notice: Use of undefined constant hostspec - assumed 'hostspec' in /var/www/html/bacula-web/classes.inc on line 44 [client 10.0.0.151] PHP Notice: Use of undefined constant username - assumed 'username' in /var/www/html/bacula-web/classes.inc on line 45 [client 10.0.0.151] PHP Notice: Use of undefined constant password - assumed 'password' in /var/www/html/bacula-web/classes.inc on line 46 [client 10.0.0.151] PHP Notice: Use of undefined constant database - assumed 'database' in /var/www/html/bacula-web/classes.inc on line 47 [client 10.0.0.151] PHP Notice: Use of undefined constant phptype - assumed 'phptype' in /var/www/html/bacula-web/classes.inc on line 48 [client 10.0.0.151] PHP Notice: Use of undefined constant lang - assumed 'lang' in /var/www/html/bacula-web/lang.php on line 25 [client 10.0.0.151] PHP Fatal error: Call to undefined function: fetchrow() in /var/www/html/bacula-web/index.php on line 50 Searching at google I found that bacula-web version 1.1 doesn't postgresql support, is true? [EMAIL PROTECTED] wrote: --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: Hy again guys, somebody know tell me when bacula-web will support postgresql? tks Goldim What is your error? Are you using the version in cvs? John --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HELP - where are my jobs?
Martin Simmons wrote: On Wed, 12 Apr 2006 10:30:07 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Fri, 07 Apr 2006 10:43:30 -0400, Emery Guevremont [EMAIL PROTECTED] said: I have a weird problem. I'm trying to restore some files from a tape backup taken a few months ago. The problem is that the files aren't on the tape. If I use the query command in bconsole to find out which tape has the files, it says the files are on tape GKN079. If I check the last date written field for tape GKN079 it says Dec. 23rd 2005. I can also confirm the files I'm trying to restored when backed up on dec. 18 and dec. 20. Now when I use the bls command to list the different jobs contained on the tape, it stops at a job done on dec. 15. This is the last entry from my bls command: JobId : 9417 VerNum: 11 PoolName : BDDump PoolType : Backup JobName : VMDBDmaitre-BDDump ClientName: vmdbdmaitre-fd Job (unique name) : VMDBDmaitre-BDDump.2005-12-14_20.05.11 FileSet : BDDump-fs JobType : B JobLevel : I JobFiles : 531 JobBytes : 5,129,941,915 StartBlock: 0 EndBlock : 4,463 StartFile : 55 EndFile : 54 JobErrors : 0 JobStatus : T Date written : 15-Dec-2005 08:15 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. End of physical tape. What I'm wondering is where are the jobs that were done between dec. 15, 2005 and dec. 23, 2005? I've also used the bls command to list the files on tape and the last file on tape dates back to dec. 15. Here's how bls end after listing my files: End Session Record: VolSessionId=153 VolSessionTime=1134158972 JobId=9417 DataLen=209 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. Unknown Record: VolSessionId=0 VolSessionTime=0 JobId=0 DataLen=0 4417 files found. What does unknown record mean? Whether I look at the logs or on bconsole, no errors ever happened with the backups between dec. 15 and dec. 23. Everything indicates my backups should be on tape GKN079, but I don't see it on the tape. Is the tape dying? BTW I also tried reading the tape on a different drive, and I got the same result. I suggest you post the output of running select * from jobmedia where mediaid=xx; from the bconsole sql command, where xx is the mediaid of GKN079. Also, what is the jobid of the job you are trying to restore? __Martin The jobid of the job in question is 9580. I've attached a file that contains the output from the sql query. The problem starts from jobid 9435. Every jobs after 8435 aren't available. One thing I noticed is that there's no start or end file number 61, it skips from 60 to 62. Could this be causing the problem? Yes, possibly. I can think of three reasons why 61 could be missing now: - There was an error during that job. - There is a bug in bacula that writes junk. - It has been pruned. It is interesting that to see other gaps too, e.g. 39. From the numbering, it looks like 39 might be from job 9410. Did that job run? Yes this job ran with the termination status OK, but there was nothing to backup so it's normal there was nothing on the tape for job 9410. Was the tape in the drive continuously for all of these jobs? If not, maybe the discontinuities occur at the point where the tape was reinserted? I'm using an Autoloader, and the tape is always in the drive. If so, how do I force bextract to skip fileid 61? Given the Unknown Record error, it might not be mpossible. It could be interesting to play with mt and dd to see what happens at various points on the tape. Each file should be readable using dd and the size should be slightly larger than reported in the job output. E.g. (parameters may need adjusting): mt rewind mt fsf 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 39 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 40 mt rewind mt fsf 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 61 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 62 __Martin Size of file 38 is 894523392 Size of file 39 is 64512 Size of file 40 is 105348096 Size of file 60 is 423005184 Size of file 61 is 0 Size of file 62 is 350106624 So what can I do now? I also checked to see file 208 to 213, since these are the files for the job I'm trying to restore. Here are their sizes: 208 - 922005504 209 - 36000 210 - 36000 211 - 36000 212 - 36000 213 - 213018624 begin:vcard fn;quoted-printable:Emery Gu=C3=A9vremont n;quoted-printable:Gu=C3=A9vremont;Emery org:Croesus Finansoft adr:;;2 Place laval, Suite
Re: [Bacula-users] bacula-web x postgresql
Where did you download this version? tks Goldim [EMAIL PROTECTED] wrote: --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: - I'm using the bacula-web 1.1... - error_log: [client 10.0.0.151] PHP Notice: Use of undefined constant hostspec -assumed 'hostspec' in /var/www/html/bacula-web/classes.inc on line 44 [client 10.0.0.151] PHP Notice: Use of undefined constant username -assumed 'username' in /var/www/html/bacula-web/classes.inc on line 45 [client 10.0.0.151] PHP Notice: Use of undefined constant password -assumed 'password' in /var/www/html/bacula-web/classes.inc on line 46 [client 10.0.0.151] PHP Notice: Use of undefined constant database -assumed 'database' in /var/www/html/bacula-web/classes.inc on line 47 [client 10.0.0.151] PHP Notice: Use of undefined constant phptype -assumed 'phptype' in /var/www/html/bacula-web/classes.inc on line 48 [client 10.0.0.151] PHP Notice: Use of undefined constant lang -assumed 'lang' in /var/www/html/bacula-web/lang.php on line 25 [client 10.0.0.151] PHP Fatal error: Call to undefined function: fetchrow() in /var/www/html/bacula-web/index.php on line 50 Searching at google I found that bacula-web version 1.1 doesn'tpostgresql support, is true? Possibly, I use the current version which is 1.2 and I have been using it successfully with postgresql for some time (6 months to a year). --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-web x postgresql
The latest cvs version is here http://sourceforge.net/cvs/?group_id=50727 It is in the gui part. Also there is an older version of 1.2 in bacula gui file ( bacula-gui-1.38.5.tar.gz) which can be downloaded here http://sourceforge.net/project/showfiles.php?group_id=50727#files John --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: Where did you download this version? tks Goldim [EMAIL PROTECTED] wrote: --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: - I'm using the bacula-web 1.1... - error_log: [client 10.0.0.151] PHP Notice: Use of undefined constant hostspec -assumed 'hostspec' in /var/www/html/bacula-web/classes.inc on line 44 [client 10.0.0.151] PHP Notice: Use of undefined constant username -assumed 'username' in /var/www/html/bacula-web/classes.inc on line 45 [client 10.0.0.151] PHP Notice: Use of undefined constant password -assumed 'password' in /var/www/html/bacula-web/classes.inc on line 46 [client 10.0.0.151] PHP Notice: Use of undefined constant database -assumed 'database' in /var/www/html/bacula-web/classes.inc on line 47 [client 10.0.0.151] PHP Notice: Use of undefined constant phptype -assumed 'phptype' in /var/www/html/bacula-web/classes.inc on line 48 [client 10.0.0.151] PHP Notice: Use of undefined constant lang -assumed 'lang' in /var/www/html/bacula-web/lang.php on line 25 [client 10.0.0.151] PHP Fatal error: Call to undefined function: fetchrow() in /var/www/html/bacula-web/index.php on line 50 Searching at google I found that bacula-web version 1.1 doesn'tpostgresql support, is true? Possibly, I use the current version which is 1.2 and I have been using it successfully with postgresql for some time (6 months to a year). --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Low backup throughput (High load average?)
Hi, On Apr 13, 2006, at 12:34 PM, Martin Simmons wrote: Did you try using spooling? Yes, it puts an enormous load on the backup server; I'm not sure why. I do utilize spooling for incrementals, but I expect them to be slower (which they are). Spooling splits the backup into phases of collecting from the client, writing to the tape (repeated) and then writing to the database. It could be worthwhile investigating the spooling slowness to see if it occurs in one particular phase (look at the console output for spooling messages). Without spooling it might be difficult to detect which phase is slow because they are interleaved for each file sent by the client. At the risk of veering this discussion off-topic, I've seen that during the spooling to disk phase, my server becomes very slow to respond, though the CPU usage is still relatively light. I've put some of the cacti graphs from the server online if anyone feels like checking them out: http://sbgrid.org/bacula/ Last night our daily incrementals ran as usual, and one can see in the graphs that CPU usage never exceeded 50%, whereas the load average peaked at around 5. The incrementals that ran last night: 13-Apr 00:00 sbgrid-dir: Start Backup JobId 84, Job=EML2.2006-04-13_00.00.00 12-Apr 23:51 eml2-fd: DIR and FD clocks differ by -630 seconds, FD automatically adjusting. 13-Apr 00:02 sbgrid-sd: Spooling data ... 13-Apr 00:08 sbgrid-sd: Committing spooled data to Volume 03L2. Despooling 27,165,575 bytes ... 13-Apr 00:08 sbgrid-sd: Sending spooled attrs to the Director. Despooling 389,684 bytes ... 13-Apr 01:00 sbgrid-dir: Start Backup JobId 85, Job=CRYSTAL_HOME. 2006-04-13_01.00.00 13-Apr 00:49 home-fd: DIR and FD clocks differ by -635 seconds, FD automatically adjusting. 13-Apr 01:00 sbgrid-sd: Spooling data ... 13-Apr 01:20 sbgrid-sd: Committing spooled data to Volume 05L2. Despooling 6,617,884,648 bytes ... 13-Apr 01:28 sbgrid-sd: Sending spooled attrs to the Director. Despooling 1,471,546 bytes ... 13-Apr 02:00 sbgrid-dir: Start Backup JobId 86, Job=FS4_XRAY. 2006-04-13_02.00.00 13-Apr 01:49 xray-fd: DIR and FD clocks differ by -634 seconds, FD automatically adjusting. 13-Apr 02:00 sbgrid-sd: Spooling data ... 13-Apr 02:42 sbgrid-sd: Committing spooled data to Volume 05L2. Despooling 10,782,446,112 bytes ... 13-Apr 02:53 sbgrid-sd: Sending spooled attrs to the Director. Despooling 572,734 bytes ... 13-Apr 03:00 sbgrid-dir: Start Backup JobId 87, Job=EML3.2006-04-13_03.00.00 13-Apr 02:49 eml3-fd: DIR and FD clocks differ by -637 seconds, FD automatically adjusting. 13-Apr 03:00 sbgrid-sd: Spooling data ... 13-Apr 03:09 sbgrid-sd: Committing spooled data to Volume 05L2. Despooling 152,612,206 bytes ... 13-Apr 03:09 sbgrid-sd: Sending spooled attrs to the Director. Despooling 97,522 bytes ... Finally, here's the output from sar for the relevant time period: CPU %user %nice %system %iowait %idle 00:10:01 all 0.68 0.00 1.94 3.09 94.29 00:20:01 all 0.02 0.00 18.71 43.13 38.14 00:30:02 all 0.02 0.00 17.55 42.84 39.60 00:40:01 all 0.02 0.00 18.56 45.91 35.51 00:50:01 all 0.02 0.00 8.88 29.91 61.20 01:00:01 all 0.02 0.00 13.44 33.62 52.93 01:10:07 all 0.70 0.00 6.72 14.49 78.08 01:20:02 all 0.48 0.00 4.58 9.90 85.05 01:30:01 all 2.62 0.00 4.84 7.45 85.10 01:40:01 all 0.02 0.00 0.06 0.03 99.89 01:50:01 all 0.02 0.00 0.06 0.02 99.90 02:00:02 all 0.02 0.00 0.06 0.03 99.89 02:10:01 all 0.90 0.00 12.14 15.18 71.78 02:20:01 all 0.09 0.00 0.81 1.61 97.48 02:30:01 all 0.32 0.00 3.02 7.42 89.23 02:40:11 all 0.53 0.00 6.08 21.40 71.98 02:50:02 all 3.00 0.00 6.47 11.03 79.49 03:00:02 all 1.23 0.00 2.20 2.07 94.50 03:10:01 all 0.12 0.00 0.42 0.74 98.73 03:20:01 all 0.03 0.00 0.05 0.02 99.90 03:30:01 all 0.02 0.00 0.06 0.03 99.90 03:40:01 all 0.03 0.00 0.06 0.08 99.83 03:50:01 all 0.03 0.00 0.05 0.02 99.90 04:00:01 all 0.02 0.00 0.06 0.02 99.90 04:10:01 all 0.70 0.16 1.34 37.95 59.86 04:20:01 all 0.04 0.38 3.46 26.72 69.41 04:30:01 all 0.89 0.00 0.13 0.57 98.41 04:40:01 all
Re: [Bacula-users] bacula-web x postgresql
I try to use this version (bacula-gui-1.38.5.tar.gz), but I had the same problem. I will try use the cvs version. tks Goldim [EMAIL PROTECTED] wrote: The latest cvs version is here http://sourceforge.net/cvs/?group_id=50727 It is in the gui part. Also there is an older version of 1.2 in bacula gui file ( bacula-gui-1.38.5.tar.gz) which can be downloaded here http://sourceforge.net/project/showfiles.php?group_id=50727#files John --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: Where did you download this version? tks Goldim [EMAIL PROTECTED] wrote: --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: - I'm using the bacula-web 1.1... - error_log: [client 10.0.0.151] PHP Notice: Use of undefined constant hostspec -assumed 'hostspec' in /var/www/html/bacula-web/classes.inc on line 44 [client 10.0.0.151] PHP Notice: Use of undefined constant username -assumed 'username' in /var/www/html/bacula-web/classes.inc on line 45 [client 10.0.0.151] PHP Notice: Use of undefined constant password -assumed 'password' in /var/www/html/bacula-web/classes.inc on line 46 [client 10.0.0.151] PHP Notice: Use of undefined constant database -assumed 'database' in /var/www/html/bacula-web/classes.inc on line 47 [client 10.0.0.151] PHP Notice: Use of undefined constant phptype -assumed 'phptype' in /var/www/html/bacula-web/classes.inc on line 48 [client 10.0.0.151] PHP Notice: Use of undefined constant lang -assumed 'lang' in /var/www/html/bacula-web/lang.php on line 25 [client 10.0.0.151] PHP Fatal error: Call to undefined function: fetchrow() in /var/www/html/bacula-web/index.php on line 50 Searching at google I found that bacula-web version 1.1 doesn'tpostgresql support, is true? Possibly, I use the current version which is 1.2 and I have been using it successfully with postgresql for some time (6 months to a year). --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-web x postgresql
After used your patch, i finally make my bacula-web works... Now everything it's ok... tks for your patience... Goldim [EMAIL PROTECTED] wrote: Ahh... The current cvs version has a patch that works only for 8.1 or greater. Sorry about that. There is a patch at http://bugs.gentoo.org/attachment.cgi?id=82865 that I wrote to disable this, basically it does not call the function to calculate the size of the database and instead it returns 1 as the size. John --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: what's your postgresql version? I'm using postgresql-7.4.11-1.FC3.1. when i access the page i got this error: DB Error: unknown error - messages: postgres[10294]: [1-1] ERROR: function pg_database_size(unknown) does not exist postgres[10294]: [1-2] HINT: No function matches the given name and argument types. You may need to add explicit type casts. I have the package postgresql-contrib-7.4.11-1.FC3.1 (I think this function is in this one). [EMAIL PROTECTED] wrote: The latest cvs version is here http://sourceforge.net/cvs/?group_id=50727 It is in the gui part. Also there is an older version of 1.2 in bacula gui file ( bacula-gui-1.38.5.tar.gz) which can be downloaded here http://sourceforge.net/project/showfiles.php?group_id=50727#files John --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: Where did you download this version? tks Goldim [EMAIL PROTECTED] wrote: --- Leonardo dos Santos Goldim [EMAIL PROTECTED] wrote: - I'm using the bacula-web 1.1... - error_log: [client 10.0.0.151] PHP Notice: Use of undefined constant hostspec -assumed 'hostspec' in /var/www/html/bacula-web/classes.inc on line 44 [client 10.0.0.151] PHP Notice: Use of undefined constant username -assumed 'username' in /var/www/html/bacula-web/classes.inc on line 45 [client 10.0.0.151] PHP Notice: Use of undefined constant password -assumed 'password' in /var/www/html/bacula-web/classes.inc on line 46 [client 10.0.0.151] PHP Notice: Use of undefined constant database -assumed 'database' in /var/www/html/bacula-web/classes.inc on line 47 [client 10.0.0.151] PHP Notice: Use of undefined constant phptype -assumed 'phptype' in /var/www/html/bacula-web/classes.inc on line 48 [client 10.0.0.151] PHP Notice: Use of undefined constant lang -assumed 'lang' in /var/www/html/bacula-web/lang.php on line 25 [client 10.0.0.151] PHP Fatal error: Call to undefined function: fetchrow() in /var/www/html/bacula-web/index.php on line 50 Searching at google I found that bacula-web version 1.1 doesn'tpostgresql support, is true? Possibly, I use the current version which is 1.2 and I have been using it successfully with postgresql for some time (6 months to a year). --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net
Re: [Bacula-users] Low backup throughput (High load average?)
On Thu, 13 Apr 2006 15:04:41 -0400, Ian Levesque [EMAIL PROTECTED] said: Hi, On Apr 13, 2006, at 12:34 PM, Martin Simmons wrote: Did you try using spooling? Yes, it puts an enormous load on the backup server; I'm not sure why. I do utilize spooling for incrementals, but I expect them to be slower (which they are). Spooling splits the backup into phases of collecting from the client, writing to the tape (repeated) and then writing to the database. It could be worthwhile investigating the spooling slowness to see if it occurs in one particular phase (look at the console output for spooling messages). Without spooling it might be difficult to detect which phase is slow because they are interleaved for each file sent by the client. At the risk of veering this discussion off-topic, I've seen that during the spooling to disk phase, my server becomes very slow to respond, though the CPU usage is still relatively light. I've put some of the cacti graphs from the server online if anyone feels like checking them out: http://sbgrid.org/bacula/ Last night our daily incrementals ran as usual, and one can see in the graphs that CPU usage never exceeded 50%, whereas the load average peaked at around 5. The incrementals that ran last night: 13-Apr 00:00 sbgrid-dir: Start Backup JobId 84, Job=EML2.2006-04-13_00.00.00 12-Apr 23:51 eml2-fd: DIR and FD clocks differ by -630 seconds, FD automatically adjusting. 13-Apr 00:02 sbgrid-sd: Spooling data ... 13-Apr 00:08 sbgrid-sd: Committing spooled data to Volume 03L2. Despooling 27,165,575 bytes ... 13-Apr 00:08 sbgrid-sd: Sending spooled attrs to the Director. Despooling 389,684 bytes ... 13-Apr 01:00 sbgrid-dir: Start Backup JobId 85, Job=CRYSTAL_HOME. 2006-04-13_01.00.00 13-Apr 00:49 home-fd: DIR and FD clocks differ by -635 seconds, FD automatically adjusting. 13-Apr 01:00 sbgrid-sd: Spooling data ... 13-Apr 01:20 sbgrid-sd: Committing spooled data to Volume 05L2. Despooling 6,617,884,648 bytes ... 13-Apr 01:28 sbgrid-sd: Sending spooled attrs to the Director. Despooling 1,471,546 bytes ... 13-Apr 02:00 sbgrid-dir: Start Backup JobId 86, Job=FS4_XRAY. 2006-04-13_02.00.00 13-Apr 01:49 xray-fd: DIR and FD clocks differ by -634 seconds, FD automatically adjusting. 13-Apr 02:00 sbgrid-sd: Spooling data ... 13-Apr 02:42 sbgrid-sd: Committing spooled data to Volume 05L2. Despooling 10,782,446,112 bytes ... 13-Apr 02:53 sbgrid-sd: Sending spooled attrs to the Director. Despooling 572,734 bytes ... 13-Apr 03:00 sbgrid-dir: Start Backup JobId 87, Job=EML3.2006-04-13_03.00.00 13-Apr 02:49 eml3-fd: DIR and FD clocks differ by -637 seconds, FD automatically adjusting. 13-Apr 03:00 sbgrid-sd: Spooling data ... 13-Apr 03:09 sbgrid-sd: Committing spooled data to Volume 05L2. Despooling 152,612,206 bytes ... 13-Apr 03:09 sbgrid-sd: Sending spooled attrs to the Director. Despooling 97,522 bytes ... Are these times the same as those in the graphs? It is strange that outbound traffic is high between 00:00 and 00:30. It looks like something else is accessing the server overnight (presumably it was also doing this between 22:45 and 23:15). I assume the spool disk is local. Simultaneuously reading and writing different parts of the same disk is a good way to boost the load average. :-) __Martin --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to support Solaris
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Kern, I run bacula-dir and bacula-sd on Solaris 9 on a UE450 and bacula-fd on Solaris 10, on a V20z. As Solaris support is vital to me -- and certainly a large percentage of the userbase -- I'd be willing to help in any way that I can. I am not a programmer, and really would be completely unqualified to fix coding problems, but I can do pretty much anything else (and do have some spare hardware to work with -- and, in the case of Solaris 10, might be able to provide a Solaris zone with tape drive access for testing). I don't have a /huge/ amount of time, but probably enough for whatever you'd need. I'm sure delayed is better than not at all. How can I help out best? _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - User Support Spec. III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 Kern Sibbald wrote: Hello, I do not feel that I can adequately support Solaris any longer so will very likely drop it from the officially supported platforms. Why? Because I don't have access to a tape drive for Solaris, and I no longer have the time to devote to testing Solaris prior to each release. For example, the regression script does not complete on version 1.38.8. What does this mean? It means that when Bacula is released it will not be tested on Solaris. It is likely to work, but I cannot guarantee it. It also means that Solaris specific bugs, like the current tape drive bug will be closed unfixed. Possible solutions: The best possible solution is for one or more Solaris users to step forward and to run the regression scripts prior to each release as well as possibly run it in production mode. In addition, we need one or more debuggers to resolve Solaris specific problems. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.2.2 (MingW32) iD8DBQFEPr13mb+gadEcsb4RArQkAJ9L3pC0VtxLVPVmmzpCCbIezpDn4QCeI/SI I8G0itEk9nHYceqgzrfov3k= =l03/ -END PGP SIGNATURE- --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HELP - where are my jobs?
On Thu, 13 Apr 2006 14:27:45 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Wed, 12 Apr 2006 10:30:07 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Fri, 07 Apr 2006 10:43:30 -0400, Emery Guevremont [EMAIL PROTECTED] said: I have a weird problem. I'm trying to restore some files from a tape backup taken a few months ago. The problem is that the files aren't on the tape. If I use the query command in bconsole to find out which tape has the files, it says the files are on tape GKN079. If I check the last date written field for tape GKN079 it says Dec. 23rd 2005. I can also confirm the files I'm trying to restored when backed up on dec. 18 and dec. 20. Now when I use the bls command to list the different jobs contained on the tape, it stops at a job done on dec. 15. This is the last entry from my bls command: JobId : 9417 VerNum: 11 PoolName : BDDump PoolType : Backup JobName : VMDBDmaitre-BDDump ClientName: vmdbdmaitre-fd Job (unique name) : VMDBDmaitre-BDDump.2005-12-14_20.05.11 FileSet : BDDump-fs JobType : B JobLevel : I JobFiles : 531 JobBytes : 5,129,941,915 StartBlock: 0 EndBlock : 4,463 StartFile : 55 EndFile : 54 JobErrors : 0 JobStatus : T Date written : 15-Dec-2005 08:15 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. End of physical tape. What I'm wondering is where are the jobs that were done between dec. 15, 2005 and dec. 23, 2005? I've also used the bls command to list the files on tape and the last file on tape dates back to dec. 15. Here's how bls end after listing my files: End Session Record: VolSessionId=153 VolSessionTime=1134158972 JobId=9417 DataLen=209 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. Unknown Record: VolSessionId=0 VolSessionTime=0 JobId=0 DataLen=0 4417 files found. What does unknown record mean? Whether I look at the logs or on bconsole, no errors ever happened with the backups between dec. 15 and dec. 23. Everything indicates my backups should be on tape GKN079, but I don't see it on the tape. Is the tape dying? BTW I also tried reading the tape on a different drive, and I got the same result. I suggest you post the output of running select * from jobmedia where mediaid=xx; from the bconsole sql command, where xx is the mediaid of GKN079. Also, what is the jobid of the job you are trying to restore? __Martin The jobid of the job in question is 9580. I've attached a file that contains the output from the sql query. The problem starts from jobid 9435. Every jobs after 8435 aren't available. One thing I noticed is that there's no start or end file number 61, it skips from 60 to 62. Could this be causing the problem? Yes, possibly. I can think of three reasons why 61 could be missing now: - There was an error during that job. - There is a bug in bacula that writes junk. - It has been pruned. It is interesting that to see other gaps too, e.g. 39. From the numbering, it looks like 39 might be from job 9410. Did that job run? Yes this job ran with the termination status OK, but there was nothing to backup so it's normal there was nothing on the tape for job 9410. OK, perhaps it didn't record this in the database, though your dd output does show a single 64512 byte block at that position on the tape. Was the tape in the drive continuously for all of these jobs? If not, maybe the discontinuities occur at the point where the tape was reinserted? I'm using an Autoloader, and the tape is always in the drive. If so, how do I force bextract to skip fileid 61? Given the Unknown Record error, it might not be mpossible. It could be interesting to play with mt and dd to see what happens at various points on the tape. Each file should be readable using dd and the size should be slightly larger than reported in the job output. E.g. (parameters may need adjusting): mt rewind mt fsf 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 39 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 40 mt rewind mt fsf 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 61 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 62 __Martin Size of file 38 is 894523392 Size of file 39 is 64512 Size of file 40 is 105348096 Size of file 60 is 423005184 Size of file
Re: [Bacula-users] HELP - where are my jobs?
Martin Simmons wrote: On Thu, 13 Apr 2006 14:27:45 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Wed, 12 Apr 2006 10:30:07 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Fri, 07 Apr 2006 10:43:30 -0400, Emery Guevremont [EMAIL PROTECTED] said: I have a weird problem. I'm trying to restore some files from a tape backup taken a few months ago. The problem is that the files aren't on the tape. If I use the query command in bconsole to find out which tape has the files, it says the files are on tape GKN079. If I check the last date written field for tape GKN079 it says Dec. 23rd 2005. I can also confirm the files I'm trying to restored when backed up on dec. 18 and dec. 20. Now when I use the bls command to list the different jobs contained on the tape, it stops at a job done on dec. 15. This is the last entry from my bls command: JobId : 9417 VerNum: 11 PoolName : BDDump PoolType : Backup JobName : VMDBDmaitre-BDDump ClientName: vmdbdmaitre-fd Job (unique name) : VMDBDmaitre-BDDump.2005-12-14_20.05.11 FileSet : BDDump-fs JobType : B JobLevel : I JobFiles : 531 JobBytes : 5,129,941,915 StartBlock: 0 EndBlock : 4,463 StartFile : 55 EndFile : 54 JobErrors : 0 JobStatus : T Date written : 15-Dec-2005 08:15 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. End of physical tape. What I'm wondering is where are the jobs that were done between dec. 15, 2005 and dec. 23, 2005? I've also used the bls command to list the files on tape and the last file on tape dates back to dec. 15. Here's how bls end after listing my files: End Session Record: VolSessionId=153 VolSessionTime=1134158972 JobId=9417 DataLen=209 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. Unknown Record: VolSessionId=0 VolSessionTime=0 JobId=0 DataLen=0 4417 files found. What does unknown record mean? Whether I look at the logs or on bconsole, no errors ever happened with the backups between dec. 15 and dec. 23. Everything indicates my backups should be on tape GKN079, but I don't see it on the tape. Is the tape dying? BTW I also tried reading the tape on a different drive, and I got the same result. I suggest you post the output of running select * from jobmedia where mediaid=xx; from the bconsole sql command, where xx is the mediaid of GKN079. Also, what is the jobid of the job you are trying to restore? __Martin The jobid of the job in question is 9580. I've attached a file that contains the output from the sql query. The problem starts from jobid 9435. Every jobs after 8435 aren't available. One thing I noticed is that there's no start or end file number 61, it skips from 60 to 62. Could this be causing the problem? Yes, possibly. I can think of three reasons why 61 could be missing now: - There was an error during that job. - There is a bug in bacula that writes junk. - It has been pruned. It is interesting that to see other gaps too, e.g. 39. From the numbering, it looks like 39 might be from job 9410. Did that job run? Yes this job ran with the termination status OK, but there was nothing to backup so it's normal there was nothing on the tape for job 9410. OK, perhaps it didn't record this in the database, though your dd output does show a single 64512 byte block at that position on the tape. Was the tape in the drive continuously for all of these jobs? If not, maybe the discontinuities occur at the point where the tape was reinserted? I'm using an Autoloader, and the tape is always in the drive. If so, how do I force bextract to skip fileid 61? Given the Unknown Record error, it might not be mpossible. It could be interesting to play with mt and dd to see what happens at various points on the tape. Each file should be readable using dd and the size should be slightly larger than reported in the job output. E.g. (parameters may need adjusting): mt rewind mt fsf 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 39 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 40 mt rewind mt fsf 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 61 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 62 __Martin Size of file 38 is 894523392 Size of file 39 is 64512 Size of file 40 is 105348096 Size of file 60 is 423005184 Size of file 61 is 0 Size of file 62 is 350106624 So what can I do now? 0 is rather worrying. I think the problem might be that reading 0 bytes (without error) is the way that the OS indicates the end of the tape,
Re: [Bacula-users] HELP - where are my jobs?
On Thu, 13 Apr 2006 17:40:02 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Thu, 13 Apr 2006 14:27:45 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Wed, 12 Apr 2006 10:30:07 -0400, Emery Guevremont [EMAIL PROTECTED] said: Martin Simmons wrote: On Fri, 07 Apr 2006 10:43:30 -0400, Emery Guevremont [EMAIL PROTECTED] said: I have a weird problem. I'm trying to restore some files from a tape backup taken a few months ago. The problem is that the files aren't on the tape. If I use the query command in bconsole to find out which tape has the files, it says the files are on tape GKN079. If I check the last date written field for tape GKN079 it says Dec. 23rd 2005. I can also confirm the files I'm trying to restored when backed up on dec. 18 and dec. 20. Now when I use the bls command to list the different jobs contained on the tape, it stops at a job done on dec. 15. This is the last entry from my bls command: JobId : 9417 VerNum: 11 PoolName : BDDump PoolType : Backup JobName : VMDBDmaitre-BDDump ClientName: vmdbdmaitre-fd Job (unique name) : VMDBDmaitre-BDDump.2005-12-14_20.05.11 FileSet : BDDump-fs JobType : B JobLevel : I JobFiles : 531 JobBytes : 5,129,941,915 StartBlock: 0 EndBlock : 4,463 StartFile : 55 EndFile : 54 JobErrors : 0 JobStatus : T Date written : 15-Dec-2005 08:15 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. End of physical tape. What I'm wondering is where are the jobs that were done between dec. 15, 2005 and dec. 23, 2005? I've also used the bls command to list the files on tape and the last file on tape dates back to dec. 15. Here's how bls end after listing my files: End Session Record: VolSessionId=153 VolSessionTime=1134158972 JobId=9417 DataLen=209 bls: Got EOF at file 61 on device /dev/nst0, Volume GKN079 bls: End of Volume at file 61 on device /dev/nst0, Volume GKN079 bls: End of all volumes. Unknown Record: VolSessionId=0 VolSessionTime=0 JobId=0 DataLen=0 4417 files found. What does unknown record mean? Whether I look at the logs or on bconsole, no errors ever happened with the backups between dec. 15 and dec. 23. Everything indicates my backups should be on tape GKN079, but I don't see it on the tape. Is the tape dying? BTW I also tried reading the tape on a different drive, and I got the same result. I suggest you post the output of running select * from jobmedia where mediaid=xx; from the bconsole sql command, where xx is the mediaid of GKN079. Also, what is the jobid of the job you are trying to restore? __Martin The jobid of the job in question is 9580. I've attached a file that contains the output from the sql query. The problem starts from jobid 9435. Every jobs after 8435 aren't available. One thing I noticed is that there's no start or end file number 61, it skips from 60 to 62. Could this be causing the problem? Yes, possibly. I can think of three reasons why 61 could be missing now: - There was an error during that job. - There is a bug in bacula that writes junk. - It has been pruned. It is interesting that to see other gaps too, e.g. 39. From the numbering, it looks like 39 might be from job 9410. Did that job run? Yes this job ran with the termination status OK, but there was nothing to backup so it's normal there was nothing on the tape for job 9410. OK, perhaps it didn't record this in the database, though your dd output does show a single 64512 byte block at that position on the tape. Was the tape in the drive continuously for all of these jobs? If not, maybe the discontinuities occur at the point where the tape was reinserted? I'm using an Autoloader, and the tape is always in the drive. If so, how do I force bextract to skip fileid 61? Given the Unknown Record error, it might not be mpossible. It could be interesting to play with mt and dd to see what happens at various points on the tape. Each file should be readable using dd and the size should be slightly larger than reported in the job output. E.g. (parameters may need adjusting): mt rewind mt fsf 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 38 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 39 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 40 mt rewind mt fsf 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 60 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 61 dd if=/dev/nsa0 bs=64512 | wc -c # size of file 62 __Martin Size of file
Re: [Bacula-users] Unable to support Solaris
Ryan Novosielski wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Kern, I run bacula-dir and bacula-sd on Solaris 9 on a UE450 and bacula-fd on Solaris 10, on a V20z. As Solaris support is vital to me -- and certainly a large percentage of the userbase -- I'd be willing to help in any way that I can. I am not a programmer, and really would be completely unqualified to fix coding problems, but I can do pretty much anything else (and do have some spare hardware to work with -- and, in the case of Solaris 10, might be able to provide a Solaris zone with tape drive access for testing). I don't have a /huge/ amount of time, but probably enough for whatever you'd need. I'm sure delayed is better than not at all. How can I help out best? _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - User Support Spec. III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 Yeah, I also have a Sun 450 using 4 AIT drives , and was hoping I could continue to run bacula on that hardware since it can feed the tapes much better then a linux-pc. I have never noticed any problems with tape drives in Solaris. /birre --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] ERR=Connection refused
Hello all i have a fresh install of bacula using mysql database on fedora core 3. I have the following error message paroused though the FAQ's were i found an answer that suggests i should possiably submit a bug report. I have tried this with the default *.conf files and also some i modified to try and make things work. Please help. 13-Apr 15:51 bconsole: Fatal error: bnet.c:859 Unable to connect to Director daemon on shoemasters.com:9101. ERR=Connection refused --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Migration from SQLite to MySQL.
Hi All, I just migrated from SQLite to MySQL with my Bacula setup. And I thought you might valuesome end user feedback.Things to note, the docmentation is a bit deficient (actually missleading) concerning such migrations. It might be a good Idea to update the Documentation to avoid leading peopleastray.From the Documentation: blockquote You may begin using Bacula with SQLite then later find that you want to switch to MySQL for any of a number of reasons: SQLite tends to use more disk than MySQL, SQLite apparently does not handle database sizes greater than 2GBytes, ... Several users have done so by first producing an ASCII "dump" of the SQLite database, then creating the MySQL tables with the create_mysql_tables script that comes with Bacula, and finally feeding the SQLite dump into MySQL using the -f command line option to continue past the errors that are generated by the DDL statements that SQLite's dump creates. Of course, you could edit the dump and remove the offending statements. Otherwise, MySQL accepts the SQL produced by SQLite. /blockquote Following these directions resulted in a MySQL database in which PoolId's were incorrect and several other inconsistancies. I then found the following message in the mailing list archives. http://article.gmane.org/gmane.comp.bacula.user/2142/match=bacula+sqlite+mysql+script which had the following script attatched to it: shellscript #! /bin/sh## Convert a Bacula 1.31a (1.32 should also be ok) Sqlite database to MySQL## The MySQL database MUST be setup with the proper schema first.## Written by Nic Bellamy [EMAIL PROTECTED], Sept/Oct 2003. echo .dump |sqlite bacula.db |awk '/^INSERT INTO / $3 != "NextId" $3 != "Version" { print $0 }' |sed 's/^INSERT INTO Media /INSERT INTO Media (MediaId,VolumeName,Slot,PoolId,MediaType,FirstWritten,LastWritten,LabelDate,VolJobs,VolFiles,VolBlocks,VolMounts,VolBytes,VolErrors,VolWrites,VolCapacityBytes,VolStatus,Recycle,VolRetention,VolUseDuration,MaxVolJobs,MaxVolFiles,MaxVolBytes) /; /INSERT INTO File VALUES\(.*,NULL\)/d' |mysql -f bacula /shellscript This script did a better job, but failed to insert my volumes properly. The SQL statements produced where: INSERT INTO Media ('Bunch of Field Names') VALUES('Bunch of Values'); The problem was thatthere weremore values in VALUES('Bunch of Values') then there were Field Names specified. Deleting the Field specifications and just doing the following fixed that problem: INSERT INTO Media VALUES('Bunch of Values'); Also Restore Jobs were not inserted because both the PoolId and the FileSetId were 'NULL' and they needed to be '0' as the MySQL tables disallowed null values. So the SQL had to be edited to replace the 'NULL' Values. So clearly the above script needs some work, but it is servicable, and there should be some reference to guide people in the documentation. Cheers, Silas Bennett =0)
[Bacula-users] Re: [Bacula-devel] ERR=Connection refused
redirected to the users list as it's really not devel related On 13 Apr 2006 at 15:52, RYAN M. vAN GINNEKEN wrote: Hello all i have a fresh install of bacula using mysql database on fedora core 3. I have the following error message paroused though the FAQ's were i found an answer that suggests i should possiably submit a bug report. I have tried this with the default *.conf files and also some i modified to try and make things work. Please help. 13-Apr 15:51 bconsole: Fatal error: bnet.c:859 Unable to connect to Director daemon on shoemasters.com:9101. ERR=Connection refused Is this when starting up bconsole? What do you get for: telent shoemasters.com 9101 After the above, what is in /var/log/message? Do you need something in /etc/host.allow? Like ALL : ALL : ALLOW for example. -- Dan Langille : Software Developer looking for work my resume: http://www.freebsddiary.org/dan_langille.php --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-devel] Re: [Bacula-users] Unable to support Solaris
On 13 Apr 2006 at 17:07, Ryan Novosielski wrote: How can I help out best? Kern will be able to add to this, but I thought I'd outline what I provide to Kern for testing on FreeBSD. He has access to a FreeBSD 5.4 box. He does has root access on the box, but that may not be required. He has access to a DLT tape drive. The box in question is actually running in a jail (aka virtual server). That is all the virtual server does. It's there for his regression testing. The tape drive is not used for anything else but what he needs. The system is always powered on and with a tape in the drive. The rest of the system is used by me for various things, but the jail runs along quietly in the background. I never really notice Kern on the box. He's very quiet. ;) --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: [Bacula-devel] Bacula packaging
On Thursday 06 April 2006 14:31, Dan Langille wrote: On 6 Apr 2006 at 9:50, Kern Sibbald wrote: - For each port I would like to have all the necessary scripts and control files committed to the Bacula source code in the appropriate part of bacula-source/platforms/... This will permit continuation of the port if a port person is not able to continue the work. This code can be committed and maintained by each of the ports persons directly. For the FreeBSD port, these files are all in the FreeBSD source tree. I don't think it makes sense to put it into the Bacula source tree because the files require the infrastructure provided by the FreeBSD ports tree. http://www.freebsd.org/cgi/cvsweb.cgi/ports/sysutils/bacula-server/ Since the files are maintained in the FreeBSD source tree, I agree, there is no reason to add them to the Bacula tree. FYI: The above files allow a FreeBSD user to download, configure, patch, and install Bacula by issuing make install. This would be the equivalent of installing from source and is referred to as the port or installing the port. To create a binary package one only need issue the command make package. After installation, one cannot differentiate something installed from a port from something installing from the package. They both wind up in the package FreeBSD management system. For your information, here is the current list of packagers. I request each of them as well as anyone who is interested to send a note to this list to let us know what you think. Jose Luis Tallon (Debian) Scott Barninger (RPMS) Lars Koeller (FreeBSD) I recently became the FreeBSD packager (in FreeBSD terminology, I'm the port maintainer). I also maintain the development port of Bacula. That means we have four ports: http://www.freshports.org/sysutils/bacula-server/ http://www.freshports.org/sysutils/bacula-client/ http://www.freshports.org/sysutils/bacula-server-devel/ http://www.freshports.org/sysutils/bacula-client-devel/ Thanks. I'll update my notes to indicate that you are the FreeBSD Bacula package maintainer. Keith Conger (MacOSX) Thomas Cameron (Gentoo) Luca Berra (Mandrivia) Eamon Brosnan(MacOSX) Geert Hendrickx (NetBSD) I should also note here that, much to my surprise and pleasure, Geert Hendrickx has been keeping up with the Bacula releases quite nicely. If you are interested, please see: http://pkgsrc.se/sysutils/bacula -- Best regards, Kern ( /\ V_V --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Recycling and scratch pool
Hello. New bacula user asking one question after reading pages of docs and mailing list archives. Got a question about 1.38.6 recycle algorithm : here is my problem: On the pdf doc of the release 1.38.5 it's said that the recycle algo uses tapes from the scratch pool AFTER checking for any recyclable volume but now in the new html doc (1.38.6 or 7) it is the opposite : bacula uses the scratch pool BEFORE checking recyclable volumes (and it's the way 138.6 does ) do i mis-understand a thing or is it a normal behaviour, is there any way to go backward to 1.38.5 behaviour with an option i missed? thank you in advance. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: Bacula packaging
Kern Sibbald wrote: Hello, With the exception of the RPMs that are built by Scott, and the FreeBSD port, I have noticed that all the other official Bacula ports have seriously lagged. I suspect that this is because the people responsible for those ports are no longer available: too busy with work, changed jobs, lost interest, ... Luca Berra (Mandrivia) I am sorry, but i fall in the list of persons that have lagged behind, mostly because i have been swamped in work, i'll try to catch up or get someone else from Mandriva (btw it is spelt Mandriva, not Mandrivia) to take over the port. For the time being please keep my name. regards, L. -- Luca Berra --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Storage fallback from Tape to File
[seems like this message never arrived to the list - trying agin] Usually, my backups go to tape but I only have one tape, and the machine is 'resonable remote' and no one is 'babysitting' the site. So, when the tape fills, I usually can't/don't get the opportunity to change tape in a couple of days. In the meantime, I would like Bacula to do the rest of the backup to a FileStorage. Preferably automatically if the correct/requested tape haven't been mounted within x hours... And WHEN the correct/new tape is inserted, I would like all jobs that went to the FileStorage to be _moved_ to tape. -- nuclear Ft. Meade Rule Psix counter-intelligence 747 Semtex Cuba class struggle South Africa Saddam Hussein genetic North Korea Peking Treasury AK-47 [See http://www.aclu.org/echelonwatch/index.html for more about this] [Or http://www.europarl.eu.int/tempcom/echelon/pdf/rapport_echelon_en.pdf] If neither of these works, try http://www.aclu.org and search for echelon. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
RE: [Bacula-devel] Re: [Bacula-users] Surprise bug + Scratch pool algorithm
I'm also unclear on whether Bacula currently tracks which volumes are in an autochanger. Right now, I have two volumes that are both recorded in the database as InChanger = 1 and Slot = 4, but it's not obvious which tape is actually in the changer. An interesting question. Would it be useful to add a MOVE VOLUME command that was aware of the operator area in some of the larger libraries? (Side explanation: on some of the bigger libraries, there is a reserved set of slots that are physically accessible from the outside without opening the library case and forcing a full inventory of the library.) MOVE VOLUME could be coded to know that a certain range of slots represented the operator area, and if a slot in that range was the destination, set InChanger to 0. If an operator slot is the source of a move, then set InChanger to 1. I think this will need to tie into the discussion Arno and I were having wrt to volume management. Up to now, InChanger=1 has implied that the media was available and mountable. I think there's more states than that, and we'll need to be more disciplined about media movement in the future. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
RE: [Bacula-devel] Re: [Bacula-users] Surprise bug + Scratch pool algorithm
Sorry, but I don't understand what a MOVE VOLUME -- or rather what an operator area is. I do understand the concept of an area that is accessible from the outside without opening the library case. Sorry -- terminology thing again. In the very large libraries (the big STK and IBM silos), the operator area is the port where you can load/unload volumes w/o opening the case. It's usually addressed as a range of special slot numbers (in my STK silos, it's slot 9900-9910, in the IBM ones it's slots 1 through 10010) By the way, I don't see any problem for InChanger to have multiple values. Kind of a misleading name, though. It's really a volume state indication -- eg, the volume is mountable or not. Rough idea I was discussing with Arno on the volume management thing: There's three things we need to know for a classic full volume management lifecycle implementation: 1) the state of a volume (where it is in the volume management cycle) 2) the location of a volume (set of predefined locations) 3) a comment to indicate information that may not be determinable from the media itself (the case of a DR vendor needing a external ID # that is different from the volser of the media is an example where you would need that kind of ability to tag a comment onto a volume record) If we use the cycle that TSM uses (a pretty classic implementation), we get about 7 standard states, only one of which makes sense using InChanger as a variable name (MOUNTABLE, the implication of the current InChanger=1). You've already added the location field as an index to a location table. This is Good. A comment field in the volume record would be a simple text string (60-80 bytes). We redefine InChanger to be VolumeState (or add a VolumeState variable and transiton to it over time). -- Best regards, Kern ( /\ V_V ** ACCEPT: CRM114 PASS Markovian Matcher ** CLASSIFY succeeds; success probability: 1. pR: 83.5363 Best match to file #0 (nonspam.css) prob: 1. pR: 83.5363 Total features in input file: 8464 #0 (nonspam.css): features: 4585181, hits: 2781358, prob: 1.00e+00, pR: 83.54 #1 (spam.css): features: 3820341, hits: 2731932, prob: 2.91e-84, pR: - 83.54 --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
RE: [Bacula-devel] Re: [Bacula-users] Surprise bug + Scratch pool algorithm
Kind of a misleading name, though. It's really a volume state indication -- eg, the volume is mountable or not. In its current usage, I find it to be the best name. It indicates if the volume is in the changer or not. It does work, but I think it reflects an assumption born of Bacula's history -- that we're dealing with relatively small libraries that are dedicated for this purpose. As we grow into the enterprise space, it's probably not a good assumption to make long term. For example, one of our 3494s has 15K+ volumes physically present. Not all of those volumes may be available for use -- but they are still physically in the library unit. What would InChanger mean in that situation? It's not critical to the discussion at hand. It's more of a think about this for the future comment. This shouldn't pose any problems. We redefine InChanger to be VolumeState (or add a VolumeState variable and transiton to it over time). I'm not sure I want to change InChanger. Every change to the database is extremely painful for me, particularly because of SQLite which does not have ALTER TABLE -- it requires hours of work involving minutia. grumpy Ugh. Not to be rude, but that sounds like a good reason to just toss it and require a real DBMS for Bacula. In these days of good cheap packaged DBMSes, is it really worth the headache to deal with SQLlite? How tough is 'apt-get install mysql'... pleh. Never mind. Not relevant to this discussion. /grumpy What would the new values for InChanger (or VolumeState) be? Offhand, how about this: 0 Unavailable (for whatever reason: missing, broken, lost) 1 MOUNTABLE (the equivalent of today's InChanger=1) 2 NOTMOUNTABLE (may still be in the changer, but administratively unavailable waiting for pickup) 3 COURIEROUT (picked up by courier and in transit to offsite vault) 4 VAULT (confirmed arrived and checked in at offsite vault) 5 VAULTRETRIEVE (ready/eligible to return from offsite vault) 6 COURIERIN (picked up by courier and in transit back to you) 7 ONSITERETRIEVE (arrived onsite, but not yet checked back into library) States 1-7 are a progressive cycle (eg, 1-2, 2-3, ... 7-1). States 0 and 1 should map directly to the current InChanger usage. The distinction between unavailable and not mountable will be important for copypools -- we need to distinguish between the volume is permanently gone from the volume is not online or directly available. Note that the meaning of the courier states and the vault state (in terms of the location of the vault and the identity of the courier) would be defined separately (vault defined by one of the location values) and we'd need to come up with a way to specify courier information, but I think that falls into the province of the DR manager that Arno's discussed. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: testing autochanger Dell-124T
John Boris jboris at adphila.org writes: I have a Dell 124T with a CERTANCE Drive installed. I am running Fedora Core 3. I am following the manual to test bacula with my setup. ... It looks like it never changed the tape. If the idea of the fill test is to see if it will go from tape to tape without intervention, then I must have something misconfigured. Anyone on the list using the Dell-124T and can shed some light? John, Did you find a resolution to this problem elsewhere? I am considering the purchase of a tape loader and the 124T looks good on paper but after a lot of googling this is the first post I've seen with someone using a 124T and bacula, so far your results don't seem promising... -Fred --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: [Bacula-devel] ERR=Connection refused
- Dan Langille [EMAIL PROTECTED] wrote: redirected to the users list as it's really not devel related Thanks Dan that is where i meant to sent the message anyway. On 13 Apr 2006 at 15:52, RYAN M. vAN GINNEKEN wrote: Hello all i have a fresh install of bacula using mysql database on fedora core 3. I have the following error message paroused though the FAQ's were i found an answer that suggests i should possiably submit a bug report. I have tried this with the default *.conf files and also some i modified to try and make things work. Please help. 13-Apr 15:51 bconsole: Fatal error: bnet.c:859 Unable to connect to Director daemon on shoemasters.com:9101. ERR=Connection refused Is this when starting up bconsole? Yes, I think i may have messed up my bconsole file are the first couple of lines sopposed to look like this. Think i got a little crazy with vi and ended up commenting out the second line cause of errors starting bconsole. #!/bin/sh # which dirname /dev/null # does dirname exit? if [ $? = 0 ] ; then cwd=`dirname $0` if [ x$cwd = x. ]; then What do you get for: telent shoemasters.com 9101 [EMAIL PROTECTED] bacula]# telnet shoemasters.com 9101 Trying 68.144.188.169... telnet: connect to address 68.144.188.169: Connection refused telnet: Unable to connect to remote host: Connection refused added these to /etc/services bacula-dir 9101/udp# bacula dir bacula-dir 9101/tcp# bacula dir bacula-fd 9102/udp# bacula fd bacula-fd 9102/tcp# bacula fd bacula-sd 9103/udp# bacula sd bacula-sd 9103/tcp# bacula sd After the above, what is in /var/log/message? Nothing Do you need something in /etc/host.allow? Like ALL : ALL : ALLOW for example. YOu mean hosts.allow right an no it is empty i will add ALL : ALL : ALLOW still refused telnet same as above -- Dan Langille : Software Developer looking for work my resume: http://www.freebsddiary.org/dan_langille.php --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Computer King/CaNMail http://www.computerking.ca http://www.canmail.org Sales, Service, and Hosting Email, Data, and Web Packages Ask about web design specials Affiliates http://www.computerking.ca/pages/links/affiliates/affiliates.htm Maybe Computer Science should be in the College of Theology. -- R. S. Barton --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Schedule Resource problem
Hi, Our backups are run in 3 phases (7pm, 9pm, and 4am) to allow certain tasks (ie. Windows ntbackup jobs, mysql dumps, etc.) to complete before backing them up. We do differential backups mon-thu, and full backups on Fridays. The first Full backup of the month becomes an archive backup that is kept indefinitely. The problem occurs when the first day of the month is a Saturday (such as this month). Phase 3 of the monthly job will run on the first of the month, and phases 1 and 2 will run the following Friday. Is there any way to make a schedule specification such as 1st fri at 9:00pm + 7 hours ? Or has anyone else resolved this issue differently? Thanks, Brent.
[Bacula-users] Automatic volume recycling fails
The recycling of used volumes fails. The retention is set to 2 days, but when the job starts (after 6 days without using the tape), I get the following information: Current Volume Do_2-s8 not acceptable because: 1000 OK VolName=Do_2-s8 VolJobs=11 VolFiles=29 VolBlocks=358018 VolBytes=23096161180 VolMounts=153 VolErrors=0 VolWrites=10878720 MaxVolBytes=0 VolCapacityBytes=0 VolStatus=Used Slot=8 MaxVolJobs=0 MaxVolFiles=0 InChanger=0 VolReadTime=0 VolWriteTime=0 EndFile=28 EndBlock=1128 VolParts=0 LabelType=0 13-Apr 08:43 bacula-sd: Please mount Volume Do_2-s8 on Storage Device VS160 (/dev/st0) for Job rechnungsdruck.2006-04-13_08.41.08 The tape Do_2-s8 is mounted and when I purge it manually and do a mount, the backup will start. This ist what list media shows: | mediaid | volumename | volstatus | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-++---++--+--+-+--+---+---+-+ | 67 | Do_2-s8| Used | 23,096,161,180 | 29 | 172,800 | 1 | 8 | 0 | DLT8000 | 2006-04-07 00:16:56 This is from bacula-dir.conf: Pool { Name = Mo-Do Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 2d # 2 Tage Volume Use Duration = 2d# noch 2 Tage nach dem Start des Accept Any Volume = yes # write on any volume in the } What goes wrong here? Thanks for help. -- Mit freundlichen Grüßen Melle Service GmbH i.A. Thomas Sturm eMail: sturm.thomas at melle.de --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: [Bacula-devel] ERR=Connection refused
On 13 Apr 2006 at 21:19, RYAN M. vAN GINNEKEN wrote: - Dan Langille [EMAIL PROTECTED] wrote: redirected to the users list as it's really not devel related Thanks Dan that is where i meant to sent the message anyway. On 13 Apr 2006 at 15:52, RYAN M. vAN GINNEKEN wrote: Hello all i have a fresh install of bacula using mysql database on fedora core 3. I have the following error message paroused though the FAQ's were i found an answer that suggests i should possiably submit a bug report. I have tried this with the default *.conf files and also some i modified to try and make things work. Please help. 13-Apr 15:51 bconsole: Fatal error: bnet.c:859 Unable to connect to Director daemon on shoemasters.com:9101. ERR=Connection refused Is this when starting up bconsole? Yes, I think i may have messed up my bconsole file are the first couple of lines sopposed to look like this. Think i got a little crazy with vi and ended up commenting out the second line cause of errors starting bconsole. #!/bin/sh # which dirname /dev/null # does dirname exit? if [ $? = 0 ] ; then cwd=`dirname $0` if [ x$cwd = x. ]; then bconsole is a binary. What do you get for: telent shoemasters.com 9101 [EMAIL PROTECTED] bacula]# telnet shoemasters.com 9101 Trying 68.144.188.169... telnet: connect to address 68.144.188.169: Connection refused telnet: Unable to connect to remote host: Connection refused This sonds like the director is not running. Please confirm. added these to /etc/services bacula-dir 9101/udp# bacula dir bacula-dir 9101/tcp# bacula dir bacula-fd 9102/udp# bacula fd bacula-fd 9102/tcp# bacula fd bacula-sd 9103/udp# bacula sd bacula-sd 9103/tcp# bacula sd After the above, what is in /var/log/message? Nothing Do you need something in /etc/host.allow? Like ALL : ALL : ALLOW for example. YOu mean hosts.allow right an no it is empty i will add ALL : ALL : ALLOW still refused telnet same as above I suspect the director is not running. --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-devel] Re: [Bacula-users] Unable to support Solaris
I won't be able to provide a full-time modern tape drive. There's a possibility that I'll be able to scrape something together (might end up being a DDS2 drive though or something like that). My other option is the use of a DAT72 drive, but only at certain times (ie. not between the hours of 04:00 and 08:00 GMT on Tuesday). There's also one spare DLT-8000, but this drive may be needed now and then -- I can likely provide warning ahead of time. Tape heads are something that have been fairly hard to come by. :) I will do my best -- we have been getting a lot out of this product without putting really anything into it. Dan Langille wrote: On 13 Apr 2006 at 17:07, Ryan Novosielski wrote: How can I help out best? Kern will be able to add to this, but I thought I'd outline what I provide to Kern for testing on FreeBSD. He has access to a FreeBSD 5.4 box. He does has root access on the box, but that may not be required. He has access to a DLT tape drive. The box in question is actually running in a jail (aka virtual server). That is all the virtual server does. It's there for his regression testing. The tape drive is not used for anything else but what he needs. The system is always powered on and with a tape in the drive. The rest of the system is used by me for various things, but the jail runs along quietly in the background. I never really notice Kern on the box. He's very quiet. ;) --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users