I would have to say that Bob Hetzel is on to something. I have 769 clients and the client list is unwieldly. The only way for me to find my client is to cut and past the list into an editor and use a search function. After choosing a restore client I often restore to an alternate computer. The restore client list is returned alphabetically. Why the inconsistency?
Sometimes I run out of screen buffer (putty) and can't see the entire list. Is it possible for me to pass params to bconsole to initiate a restore without having to deal with long lists of clients? Brian Kelly -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 12, 2008 5:09 PM To: bacula-users@lists.sourceforge.net Subject: Bacula-users Digest, Vol 31, Issue 21 Send Bacula-users mailing list submissions to bacula-users@lists.sourceforge.net To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/bacula-users or, via email, send a message with subject or body 'help' to [EMAIL PROTECTED] You can reach the person managing the list at [EMAIL PROTECTED] When replying, please edit your Subject line so it is more specific than "Re: Contents of Bacula-users digest..." Today's Topics: 1. Re: offsite backup question (Berend Dekens) 2. Re: offsite backup question (John Fitzpatrick) 3. Disk hash/catalog comparisons. (Alan Brown) 4. Re: Hung on "Dir inserting attributes" (Jason Dixon) 5. Re: Hung on "Dir inserting attributes" (ebollengier) 6. Bacula restore strange error. (Brice Figureau) 7. Re: Hung on "Dir inserting attributes" (Dan Langille) 8. Re: Bacula in the press (Dan Langille) 9. Re: Hung on "Dir inserting attributes" (Jason Dixon) 10. Re: Looking for a better setup (James Cort) 11. Re: How to clear the restore job history (Martin Simmons) 12. bacula-sd volume data errors during copy from disk to tape (Pasi K?rkk?inen) 13. Re: Hung on "Dir inserting attributes" (Dan Langille) 14. deadlock on batch insert (Dan Langille) 15. Re: Bacula-usersMoving from Tape to DVD (Wes Hardaker) 16. Re: Bacula-usersMoving from Tape to DVD (Jari Fredriksson) 17. SD on Ethernet Disk (subbustrato) 18. Problems appending to a Tape (Russell Sutherland) 19. Re: SD on Ethernet Disk (Arno Lehmann) 20. Re: client list for restores sort order (Arno Lehmann) 21. Re: Fatal Error doing Full Backup (Arno Lehmann) ---------------------------------------------------------------------- Message: 1 Date: Wed, 12 Nov 2008 13:18:59 +0100 From: Berend Dekens <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] offsite backup question To: John Fitzpatrick <[EMAIL PROTECTED]>, bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=UTF-8; format=flowed Hey John, I have a similar problem at the moment. The problem originates from the fact that Bacula seems to be unable to seperate restore jobs based on storage pools (so a system with files stored in multiple pools will require volumes from all pools used). As far as I know this is currently not solved - you might work around it by making a full offsite backup followed by a full local backup: this way both locations have a complete data set. But for my sake it is too much work and takes too much space. Bacula 3.0 will have Copy Jobs - a job type which copies backup jobs between storage pools. I think that is great for getting the offsite backups you and me want :-) Regards, Berend Dekens John Fitzpatrick schreef: > > Hi everyone, > > I have been running nightly backups using a single pool of 19 volumes. > The schedule is for > Schedule { > Name = "WeeklyCycle" > Run = Full 1st sat at 23:05 > Run = Differential 2nd-5th sat at 23:05 > Run = Incremental mon-fri at 23:05 > } > > What i want to do is take tapes offsite once a month and what I did > was to create a new pool > Pool { > Name = Offsite_Backup > Pool Type = Backup > Recycle = yes # Bacula can automatically > recycle Volumes > AutoPrune = yes # Prune expired volumes > Volume Retention = 30 days # one year > Accept Any Volume = yes # write on any volume in the pool > Cleaning Prefix = LTC > } > > then added 2 tapes to it and ran the jobs associated with each client > Job { > Name = "ie-serv-2_backup" > Type = Backup > Level = Incremental > Client = ie-serv-2-fd > FileSet = "ie-serv-2 Full Set" > Schedule = "WeeklyCycle" > Storage = PV128T > Messages = Standard > Pool = Servers_Nightly > Priority = 10 > Write Bootstrap = "/var/bacula/ie-serv-2.bsr" > } > > modifying the Type to Full > > This seemed fine and the usual scheduled backup ran as expected > > So I removed the tapes for offsite, put the other 2 back in and > restarted bacula. > > Tested a backup and it keeps asking for the two offsite tapes which is > alright now as I have them on my desk but how should I be doing this? > > was thinking define another job for offsite with new bootstrap but > then what about the catalog I only have one, can I create another? > > All comments welcome. > > regard, > John > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ------------------------------------------------------------------------ > > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > ------------------------------ Message: 2 Date: Wed, 12 Nov 2008 12:34:27 +0000 (GMT) From: John Fitzpatrick <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] offsite backup question To: Berend Dekens <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=utf-8 Hi Berend, I was thinking of doing it that way, a full backup for offsite followed by a full to stay in the changer. It just seems a long way around it, a full backup for each client takes 15 hours in total. Thanks Kevin, but I thought I had already included that "Add the option 'recycle current volume = yes' to the offsite pool" with recycle = yes I will run another full back locally and test a restore from local, then restore from my offsite set. Thanks, John Berend wrote: Hey John, I have a similar problem at the moment. The problem originates from the fact that Bacula seems to be unable to seperate restore jobs based on storage pools (so a system with files stored in multiple pools will require volumes from all pools used). As far as I know this is currently not solved - you might work around it by making a full offsite backup followed by a full local backup: this way both locations have a complete data set. But for my sake it is too much work and takes too much space. Bacula 3.0 will have Copy Jobs - a job type which copies backup jobs between storage pools. I think that is great for getting the offsite backups you and me want :-) Regards, Berend Dekens John Fitzpatrick schreef: > > Hi everyone, > > I have been running nightly backups using a single pool of 19 volumes. > The schedule is for > Schedule { > Name = "WeeklyCycle" > Run = Full 1st sat at 23:05 > Run = Differential 2nd-5th sat at 23:05 > Run = Incremental mon-fri at 23:05 > } > > What i want to do is take tapes offsite once a month and what I did > was to create a new pool > Pool { > Name = Offsite_Backup > Pool Type = Backup > Recycle = yes # Bacula can automatically > recycle Volumes > AutoPrune = yes # Prune expired volumes > Volume Retention = 30 days # one year > Accept Any Volume = yes # write on any volume in the pool > Cleaning Prefix = LTC > } > > then added 2 tapes to it and ran the jobs associated with each client > Job { > Name = "ie-serv-2_backup" > Type = Backup > Level = Incremental > Client = ie-serv-2-fd > FileSet = "ie-serv-2 Full Set" > Schedule = "WeeklyCycle" > Storage = PV128T > Messages = Standard > Pool = Servers_Nightly > Priority = 10 > Write Bootstrap = "/var/bacula/ie-serv-2.bsr" > } > > modifying the Type to Full > > This seemed fine and the usual scheduled backup ran as expected > > So I removed the tapes for offsite, put the other 2 back in and > restarted bacula. > > Tested a backup and it keeps asking for the two offsite tapes which is > alright now as I have them on my desk but how should I be doing this? > > was thinking define another job for offsite with new bootstrap but > then what about the catalog I only have one, can I create another? > > All comments welcome. > > regard, > John > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ------------------------------------------------------------------------ > > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > ------------------------------ Message: 3 Date: Wed, 12 Nov 2008 13:04:16 +0000 (GMT) From: Alan Brown <[EMAIL PROTECTED]> Subject: [Bacula-users] Disk hash/catalog comparisons. To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: TEXT/PLAIN; charset=US-ASCII Bacula 2.4.1 I need to do a verify of the state of a filesystem at a particular date vs what's in there now, as some files have been overwritten with nulls whilst having their timestamps preserved (hardware problems). I've tried using "Verify Disk to Catalog", but this only seems to say if a file is newer/older than the Catalog entry, vs changed checksum (all backup sets have SHA1 checksums) Am I approaching this the wrong way or does bacula not currently have the capability of detecting changed checksums for backed up files? (I know about initcatalog, but that's not appropriate in this instance) ------------------------------ Message: 4 Date: Wed, 12 Nov 2008 08:23:58 -0500 From: Jason Dixon <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Hung on "Dir inserting attributes" To: ebollengier <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii On Wed, Nov 12, 2008 at 12:56:21AM -0800, ebollengier wrote: > > Hello, > > The batch mode improve the speed with postgresql by a factor of 10 (maybe > 20), using > a very big job (15M files) with the standard mode won't work too. I don't understand what you're saying. Are you suggesting that either way I won't be able to perform this backup due to the number of files? Thanks, -- Jason Dixon OmniTI Computer Consulting, Inc. [EMAIL PROTECTED] 443.325.1357 x.241 ------------------------------ Message: 5 Date: Wed, 12 Nov 2008 05:46:54 -0800 (PST) From: ebollengier <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Hung on "Dir inserting attributes" To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii Jason Dixon-6 wrote: > > On Wed, Nov 12, 2008 at 12:56:21AM -0800, ebollengier wrote: >> >> Hello, >> >> The batch mode improve the speed with postgresql by a factor of 10 (maybe >> 20), using >> a very big job (15M files) with the standard mode won't work too. > > I don't understand what you're saying. Are you suggesting that either > way I won't be able to perform this backup due to the number of files? > The backup is possible, but your configuration (hardware and software) needs to be able to do this big insert. For example, if you have only 256MB for ram and 1 poor old ide drive, it will take some time. I just say that the old "per file" insertion mode will take 10 more time, and it's already too long for you. With Postgres, you can run your catalog backup at the same time than other jobs (try to avoid having 10 jobs during this job) Bye -- View this message in context: http://www.nabble.com/Hung-on-%22Dir-inserting-attributes%22-tp20450040p2046 0645.html Sent from the Bacula - Users mailing list archive at Nabble.com. ------------------------------ Message: 6 Date: Wed, 12 Nov 2008 15:38:06 +0100 From: Brice Figureau <[EMAIL PROTECTED]> Subject: [Bacula-users] Bacula restore strange error. To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain Hi, I'm using a LTO-4 autochanger with a bacula-sd (v2.4.2) configured since about one or two months with: Maximum Block Size = 2097152 When I configured this setting I didn't get any SD or director warnings or issues (or at least none that I could see). Today I wanted to restore a full backup of a client that crashed hard. I got the following error: 12-Nov 12:08 backup-sd JobId 2357: Ready to read from volume "ACM504L4" on device "LTO4" (/dev/nst0). 12-Nov 12:08 backup-sd JobId 2357: Forward spacing Volume "ACM504L4" to file:block 43:16. 12-Nov 12:09 backup-sd JobId 2357: Error: block.c:290 Volume data error at 43:16! Block length 2097152 is insane (too large), probably due to a bad archive. Looking to block.c around line 290, I see: /* Sanity check */ if (block_len > MAX_BLOCK_SIZE) { dev->dev_errno = EIO; MAX_BLOCK_SIZE is a constant whose value is: 1024*1024+1, which is smaller than what I configured. Is there really a limit on the maximum size of a block? The documentation doesn't seem to say this. Maybe some of the developper should change the documentation to indicate that there is indeed a limit and check at sd start that the currently given maximum block size is under this limit? I can file a bug report if needed. Should I? Anyway, I increased the value of this constant and I could restore this full jobs without any issue (ok that wasn't so straightforward, but I finally could restore the job). Thanks, -- Brice Figureau <[EMAIL PROTECTED]> ------------------------------ Message: 7 Date: Wed, 12 Nov 2008 07:07:13 -0800 From: Dan Langille <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Hung on "Dir inserting attributes" To: Jason Dixon <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote: > We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs fine > for > most backup jobs. However, we've encountered a particular job that > hangs indefinitely with the status "Dir inserting attributes". It's > important to note that all of our other jobs complete successfully > except this one. What others have said confirmed what I thought. I too think this job is not hanging. It is inserting. select * from pg_stat_activity The above will probably show the INSERT below. Using systems tools such as top, vmstat, iostat, and ps, you should be able to prove that progress is being made. > > > Running Jobs: > JobId Level Name Status > ====================================================================== > 90 Full Unix_zimbra.2008-11-10_15.26.10 Dir inserting Attributes > ==== > > This particular job is for our Zimbra server (2.4.3 on Linux x86_64). > The job is predictably large (275GB, 15M files). I asked our > PostgreSQL > DBA to review the database and he found a hung statement (backslashes > are mine): > > INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, \ > MD5)SELECT batch.FileIndex, batch.JobId, Path.PathId, \ > Filename.FilenameId,batch.LStat, batch.MD5 FROM batch JOIN Path ON \ > (batch.Path = Path.Path) JOIN Filename ON (batch.Name = Filename.Name) > > At this point, other jobs (except Catalog Backup) will continue to run > and complete successfully. But to get the Catalog Backup running, I > have to cancel the zimbra job, restart bacula-dir, and kick off the > Catalog Backup job. Otherwise, the Catalog jobs will just sit there > waiting to execute. I've let these jobs sit for days in this state, > so > it's not like I'm being impatient. :) Days? Oh. Hmmm. Perhaps you need to tune postgresql.conf a bit more. What are the hardware specs for the database server? > > > One other note. If the DBA kills that query in the database, the job > completes. Although the director reports an Error, it updates the > catalog successfully. If I cancel the job inside bconsole, nothing > else gets updated in the catalog, presumably due to a database lock. > The first job below (jobid 90) was one I cancelled; the next (jobid > 104) was where the database query was killed. > > *llist jobid=90 > No results to list. > > *llist jobid=104 > jobid: 104 > job: Unix_zimbra.2008-11-11_11.19.05 > name: Unix_zimbra > purgedfiles: 0 > type: B > level: F > clientid: 2 > name: zimbra > jobstatus: f > schedtime: 2008-11-11 11:19:29 > starttime: 2008-11-11 11:19:33 > endtime: 2008-11-11 17:10:42 > realendtime: 2008-11-11 17:10:42 > jobtdate: 1,226,441,442 > volsessionid: 16 > volsessiontime: 1,226,346,967 > jobfiles: 15,020,757 > joberrors: 1 > jobmissingfiles: 0 > poolid: 1 > poolname: Default > priorjobid: 0 > filesetid: 2 > fileset: Zimbra Set -- Dan Langille http://langille.org/ ------------------------------ Message: 8 Date: Wed, 12 Nov 2008 07:27:03 -0800 From: Dan Langille <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Bacula in the press To: Arno Lehmann <[EMAIL PROTECTED]> Cc: bacula-users <bacula-users@lists.sourceforge.net> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes On Nov 12, 2008, at 12:20 AM, Arno Lehmann wrote: > Hi, > > 12.11.2008 03:00, Dan Langille wrote: >> http://www.enterprisenetworkingplanet.com/netos/article.php/3784081 >> >> "If you're looking for a darned good open-source backup solution, >> this >> may be your lucky day for an interview with this data-sucking >> vampire." >> >> It does a good job of introducing the components. > > But it also talks about Storage DIRECTOR and File DIRECTOR... and the > feedback form does not work because, instead of a captcha image, I > just get a text stating that the session is invalid or expired. > > Not that funny... I let the author know. I think this type of mistake is not a big issue. -- Dan Langille http://langille.org/ ------------------------------ Message: 9 Date: Wed, 12 Nov 2008 10:39:00 -0500 From: Jason Dixon <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Hung on "Dir inserting attributes" To: Dan Langille <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii On Wed, Nov 12, 2008 at 07:07:13AM -0800, Dan Langille wrote: > > On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote: > >> We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs fine for >> most backup jobs. However, we've encountered a particular job that >> hangs indefinitely with the status "Dir inserting attributes". It's >> important to note that all of our other jobs complete successfully >> except this one. > > What others have said confirmed what I thought. I too think this job > is not hanging. It is inserting. For two days? This isn't a slow box. Here is the pg_stat_activity we gathered yesterday. According to our DBA, it was deadlocked as exhibited by pids 6192 and 21732 both having ExclusiveLock's. http://pastebin.com/f26d96438 Thanks, -- Jason Dixon OmniTI Computer Consulting, Inc. [EMAIL PROTECTED] 443.325.1357 x.241 ------------------------------ Message: 10 Date: Wed, 12 Nov 2008 15:56:05 +0000 From: James Cort <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Looking for a better setup To: "junior.listas" <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1 junior.listas wrote: > 1) mysql tables became huge ( each backup adds a million and six > hundred thousand lines ), so i split the configuration into 2 daemons > with 2 different bases, one for mon,tue,wed and other for thu,fri( and > one 3th for monthly bkps ) ; because between a backup starts, delete old > lines and start add newest lines take 45 mins; just to re-create the > catalog, before restore anything it takes 1 hour. I have a similar problem with postgres; the catalog database is now so large that restoring it from a pg_dump backup takes 3-4 hours. This is before you account for the length of time taken to read it from the tape. In a DR scenario, that's 3-4 hours sitting there twiddling your thumbs waiting for the catalog to come back so you can do some useful restores. My solution so far has been to script a database sync and LVM snapshot of the volume on which the database resides, and then backup the snapshot. In theory at least, restoring the snapshot should give me the underlying files back and it's undergone no worse than a system crash. Provided things like wal_sync are enabled, everything should be OK. All my testing indicates that this should work but I'm a little nervous as it's far from a properly supported solution. James. -- James Cort IT Manager U4EA Technologies Ltd. -- U4EA Technologies http://www.u4eatech.com ------------------------------ Message: 11 Date: Wed, 12 Nov 2008 17:13:12 GMT From: Martin Simmons <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] How to clear the restore job history To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> There is no other related data for these jobs. I made a mistake though: you need delete from job where type in ('R') ... to delete restore jobs. Type 'V' is verify and type 'D' is admin. __Martin >>>>> On Wed, 12 Nov 2008 10:47:11 +0800, Quanzhong Zhang said: > > Hello Martin, > > Thank you very much for your replay! > But are you sure there are no related data in other table for this data? > > Best Regards, > Zhang QZ > > > -----Original Message----- > From: Martin Simmons [mailto:[EMAIL PROTECTED] > Sent: Tuesday, November 11, 2008 6:57 PM > To: Quanzhong Zhang > Cc: bacula-users@lists.sourceforge.net > Subject: Re: [Bacula-users] How to clear the restore job history > >>>>> On Tue, 11 Nov 2008 09:28:28 +0800, Quanzhong Zhang said: > > > > Hello, > > > > I found there are many restore job history in the table "Job", and can > > not find out the way for clear it. > > Could you kindly give me help? > > Bacula never deletes them. > > I run the following SQL once a week (on PostgreSQL) to delete those > older than > 2 months: > > delete from job where type in ('V', 'D') and starttime < now()-interval > '2 months'; > > __Martin > ------------------------------ Message: 12 Date: Wed, 12 Nov 2008 19:38:40 +0200 From: Pasi K?rkk?inen <[EMAIL PROTECTED]> Subject: [Bacula-users] bacula-sd volume data errors during copy from disk to tape To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii Hello list! I'm testing Bacula 2.5.19 (upcoming 3.0.0) and copying jobs from disk pools to tape. I'm getting some errors during the copy process.. has anyone else seen these?: bacula-sd JobId 2994: Start Copying JobId 2994, Job=CopyPool3UncopiedToTape.2008-11-12_16.40.09.26 bacula-sd JobId 2994: Using Device "IBM-LTO3-Drive" bacula-sd JobId 2994: Ready to read from volume "Pool3-Vol-0090" on device "FSDevice3" (/mnt/backup1/pool03). bacula-sd JobId 2994: Forward spacing Volume "Pool3-Vol-0090" to file:block 0:218. bacula-sd JobId 2994: Error: block.c:1098 Volume data error at 0:2594608255! Short block of 2944 bytes on device "FSDevice3" (/mnt/backup1/pool03) discarded. bacula-sd JobId 2994: Error: read_record.c:148 block.c:1098 Volume data error at 0:2594608255! Short block of 2944 bytes on device "FSDevice3" (/mnt/backup1/pool03) discarded. bacula-sd JobId 2994: End of file 0 on device "FSDevice3" (/mnt/backup1/pool03), Volume "Pool3-Vol-0090" bacula-sd JobId 2994: End of Volume at file 0 on device "FSDevice3" (/mnt/backup1/pool03), Volume "Pool3-Vol-0090" bacula-sd JobId 2994: Ready to read from volume "Pool3-Vol-0091" on device "FSDevice3" (/mnt/backup1/pool03). bacula-sd JobId 2994: Forward spacing Volume "Pool3-Vol-0091" to file:block 0:218. bacula-sd JobId 2994: Error: block.c:1098 Volume data error at 0:2314368047! Short block of 3024 bytes on device "FSDevice3" (/mnt/backup1/pool03) discarded. bacula-sd JobId 2994: Error: read_record.c:148 block.c:1098 Volume data error at 0:2314368047! Short block of 3024 bytes on device "FSDevice3" (/mnt/backup1/pool03) discarded. bacula-sd JobId 2994: End of file 0 on device "FSDevice3" (/mnt/backup1/pool03), Volume "Pool3-Vol-0091" bacula-sd JobId 2994: End of Volume at file 0 on device "FSDevice3" (/mnt/backup1/pool03), Volume "Pool3-Vol-0091" bacula-sd JobId 2994: Ready to read from volume "Pool3-Vol-0092" on device "FSDevice3" (/mnt/backup1/pool03). bacula-sd JobId 2994: Forward spacing Volume "Pool3-Vol-0092" to file:block 0:218. However, the job terminates with: SD Files Written: 102,756 SD Bytes Written: 14,278,163,609 (14.27 GB) SD Errors: 0 SD termination status: OK Termination: Copying OK So.. does someone what's going on? -- Pasi ------------------------------ Message: 13 Date: Wed, 12 Nov 2008 10:05:24 -0800 From: Dan Langille <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Hung on "Dir inserting attributes" To: Jason Dixon <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes On Nov 12, 2008, at 7:39 AM, Jason Dixon wrote: > On Wed, Nov 12, 2008 at 07:07:13AM -0800, Dan Langille wrote: >> >> On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote: >> >>> We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs >>> fine for >>> most backup jobs. However, we've encountered a particular job that >>> hangs indefinitely with the status "Dir inserting attributes". It's >>> important to note that all of our other jobs complete successfully >>> except this one. >> >> What others have said confirmed what I thought. I too think this job >> is not hanging. It is inserting. > > For two days? Yes. For two days. :) This is why I asked for hardware details later in my post. :) > This isn't a slow box. Here is the pg_stat_activity we > gathered yesterday. According to our DBA, it was deadlocked as > exhibited by pids 6192 and 21732 both having ExclusiveLock's. > > http://pastebin.com/f26d96438 Thank you. That is someone we can use to debug the issue. By we, I don't include me. Sorry, I won't be able to look at this for a while. > > > Thanks, > > -- > Jason Dixon > OmniTI Computer Consulting, Inc. > [EMAIL PROTECTED] > 443.325.1357 x.241 -- Dan Langille http://langille.org/ ------------------------------ Message: 14 Date: Wed, 12 Nov 2008 10:17:05 -0800 From: Dan Langille <[EMAIL PROTECTED]> Subject: [Bacula-users] deadlock on batch insert To: bacula-users <bacula-users@lists.sourceforge.net> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes We may have a problem with deadlock on batch insert. I have not looked closely, it it appears to be two batch inserts running at the same time. Begin forwarded message: > From: Jason Dixon <[EMAIL PROTECTED]> > Date: November 12, 2008 7:39:00 AM PST > To: Dan Langille <[EMAIL PROTECTED]> > Cc: bacula-users@lists.sourceforge.net > Subject: Re: [Bacula-users] Hung on "Dir inserting attributes" > > On Wed, Nov 12, 2008 at 07:07:13AM -0800, Dan Langille wrote: >> >> On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote: >> >>> We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs >>> fine for >>> most backup jobs. However, we've encountered a particular job that >>> hangs indefinitely with the status "Dir inserting attributes". It's >>> important to note that all of our other jobs complete successfully >>> except this one. >> >> What others have said confirmed what I thought. I too think this job >> is not hanging. It is inserting. > > For two days? This isn't a slow box. Here is the pg_stat_activity we > gathered yesterday. According to our DBA, it was deadlocked as > exhibited by pids 6192 and 21732 both having ExclusiveLock's. > > http://pastebin.com/f26d96438 > > Thanks, > > -- > Jason Dixon > OmniTI Computer Consulting, Inc. > [EMAIL PROTECTED] > 443.325.1357 x.241 -- Dan Langille http://langille.org/ ------------------------------ Message: 15 Date: Wed, 12 Nov 2008 10:20:32 -0800 From: Wes Hardaker <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Bacula-usersMoving from Tape to DVD To: "Jari Fredriksson" <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii >>>>> On Fri, 7 Nov 2008 22:14:29 +0200, "Jari Fredriksson" <[EMAIL PROTECTED]> said: JF> Now wondering best practises with DVD backups. The biggest one for me was adding -dvd-compat to the "self.growparams" settings in /etc/bacula/dvd-handler (near line 112) -- "In the bathtub of history the truth is harder to hold than the soap, and much more difficult to find." -- Terry Pratchett ------------------------------ Message: 16 Date: Wed, 12 Nov 2008 20:50:30 +0200 From: "Jari Fredriksson" <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Bacula-usersMoving from Tape to DVD To: "Wes Hardaker" <[EMAIL PROTECTED]> Cc: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="iso-8859-1" >>>>>> On Fri, 7 Nov 2008 22:14:29 +0200, "Jari >>>>>> Fredriksson" <[EMAIL PROTECTED]> said: > >> Now wondering best practises with DVD backups. > > The biggest one for me was adding -dvd-compat to the > "self.growparams" settings in /etc/bacula/dvd-handler > (near line 112) Ok, a happy camper! Which version of Bacula you are using? Seems the current ones are broken or I have a serious configuration error somewhere. I think -dvd-compat fixes some dvd writing issues, but I have no problems there. DVD will be written fine, but the problems are in catalog updating and using recucled volumes. ------------------------------ Message: 17 Date: Wed, 12 Nov 2008 22:06:50 +0000 (UTC) From: subbustrato <[EMAIL PROTECTED]> Subject: [Bacula-users] SD on Ethernet Disk To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii Is it possible set as storage demon an Ethernet Disk? bye, sub ------------------------------ Message: 18 Date: Wed, 12 Nov 2008 17:01:52 -0500 From: "Russell Sutherland" <[EMAIL PROTECTED]> Subject: [Bacula-users] Problems appending to a Tape To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1 When trying to write/append some data to an existing labelled and mounted tape I get: *messages 12-Nov 16:56 backup-sd JobId 12120: Job backup-data.2008-11-12_16.56.30 waiting. Cannot find any appendable volumes. Please use the "label" command to create a new Volume for: Storage: "Dell-PV-110T" (/dev/nsa0) Pool: Default Media type: LTO-2 *list media Pool=Default +---------+------------+-----------+---------+---------------+----------+--- -----------+---------+------+-----------+--------------+-------------------- -+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +---------+------------+-----------+---------+---------------+----------+--- -----------+---------+------+-----------+--------------+-------------------- -+ | 595 | Catalog-01 | Append | 1 | 4,023,197,419 | 0 | 34,560,000 | 1 | 0 | 0 | Media-backup | 2008-11-12 04:59:35 | | 642 | BG7385 | Append | 1 | 2,644,992 | 2 | 34,560,000 | 1 | 0 | 0 | LTO-2 | 2008-11-12 16:47:41 | +---------+------------+-----------+---------+---------------+----------+--- -----------+---------+------+-----------+--------------+-------------------- -+ * Why can my system not find any appendable volumes? It appears that the default Pool is ready to append to Volume Name: BG7385. In general, I find adding, mounting and labelling new tapes a bit confusing, especially when this is being done to an existing running system. -- Russell Sutherland [EMAIL PROTECTED] +1.416.696.7600 ------------------------------ Message: 19 Date: Wed, 12 Nov 2008 23:24:01 +0100 From: Arno Lehmann <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] SD on Ethernet Disk To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi, 12.11.2008 23:06, subbustrato wrote: > Is it possible set as storage demon an Ethernet Disk? I assume that by "Ethernet disk" you mean a NAS device. Yes, it is possible if the device actually runs a SD. Yes, it is possible to use a NAS device as final destination for Baculas volumes. No, it is not possible to simply refer to the NAS device as a storage device in the Director configuration if there is *no* SD running on it. No, it is not possible to use a NAS device if you can't mount it to the machine the SD runs on. Select whichever answer fits to your environment :-) Arno > bye, > sub -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabr?ck www.its-lehmann.de ------------------------------ Message: 20 Date: Thu, 13 Nov 2008 00:03:18 +0100 From: Arno Lehmann <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] client list for restores sort order To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hello, 11.11.2008 18:15, Bob Hetzel wrote: > I've currently got over 150 backup clients installed with bacula so when > I want to do a restore and I have it list the clients by name the list > is rather unwieldy. I'm thinking the list is ordered by when they were > added? > > If it's doing a database query to generate this client list, where can > the sort order be changed? Ideally I'd like to change it to order by > client name. This seems to be done in cats/sql_get.c function get_client_ids(). I'm not sure if simply adding an "ORDER BY" statement works with all databases if you order by a field not actually requested. Also, this could break existing scripts where you do something like echo 'status client 1 ' so I would carefully consider such a change. Arno > Bob > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabr?ck www.its-lehmann.de ------------------------------ Message: 21 Date: Thu, 13 Nov 2008 00:08:19 +0100 From: Arno Lehmann <[EMAIL PROTECTED]> Subject: Re: [Bacula-users] Fatal Error doing Full Backup To: bacula-users@lists.sourceforge.net Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hello, 11.11.2008 10:00, Isabel Bermejo wrote: > Hi, > I'm using Bacula to backup servers into files (not tapes). One of the > servers has to backup 30GB of information. It has been working fine for 2 > years but 3 weeks ago I received a Fatal Error message. > > Here I post a little bit of the message (it's too large): > 10-Nov 22:40 iesa8-dir: BackupIESA4.2008-11-10_21.30.00 Fatal error: > sql_create.c:564 sql_create.c:564 insert INSERT INTO File > (FileIndex,JobId,PathId,FilenameId,LStat,MD5) VALUES > (42322,10216,14961,17509,'MK EgAR IH0 B IM IM A SXHu BAA CTY BJEhK1 BCNzD+ > BFE418 A A E','0') failed: > database is locked I think the error message is quite clear - the database is locked. ... > This message appears only when doing Full Backup. Does anyone know what is > the problem? That'S more interesting... Bacula itself should be well able to serialize database accesses. Also, if this only happens for this one job, that indicates a more serious problem. Have you checked that the database is usable and what else happens there while the job in question runs? You don't tell us which database you use - with MySQL, 'mysqladmin processlist' will give you something useful, perhaps. > I've read it could be the amount of data I'm backing up but > this has been working fine till 3 weeks ago. I'm using Bacula 1.38 and I > haven't modified nothing at all because it was working fine. 1.38 is definitely no longer fully supported. I suggest you upgrade to the current released version and see if that behaves differently. If the error persists, you should report that, or submit a bug report directly at bugs.bacula.org. Arno > Thank you > ISABEL > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabr?ck www.its-lehmann.de ------------------------------ ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ ------------------------------ _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users End of Bacula-users Digest, Vol 31, Issue 21 ********************************************
smime.p7s
Description: S/MIME cryptographic signature
------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users