[Bacula-users] End of Tape errors with HP LTO-4 drive on Linux
Bacula works perfectly so far. The only serious problem I have is End of Tape detection. E.g. if I need to reboot the backup server, the current tape will be rewinded. The next backup job then seems not to find the end of the last backup and the tape will be set to Error state: 14-Apr 04:00 bacula-sd JobId 925: Volume "Weekly1" previously written, moving to end of data. 14-Apr 04:23 bacula-sd JobId 925: Error: Unable to position to end of data on device "LTO-4" (/dev/nst0): ERR=dev.c:954 ioctl MTEOM error on "LTO-4" (/dev/nst0). ERR=Input/output error. 14-Apr 04:23 bacula-sd JobId 925: Marking Volume "Weekly1" in Error in Catalog. I already tried playing with TWO EOF = yes/no with no luck. Any ideas? Robert -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Could not create JobMedia record
Martin Simmons wrote: > > > > > > > > > > > > > > > > > > > > > On Tue, 13 Apr 2010 04:08:03 -0400, ladolf said: > > > > > > > > > > > > > > > > > > > > > > I am trying to import tape data to bacula catalog using bscan: > > bscan -b mju3-fd_MJU-TED2.bsr -m -n bacula -u bacula -P bacula -h > > localhost -s -S -v /dev/st0 > > > > I got this error: > > bscan: bscan.c:1245 Could not create JobMedia record. ERR=sql_create.c:156 > > Update Media record UPDATE Media SET EndFile=167, EndBlock=27602 WHERE > > MediaId=0 failed: ERR= > > > > This is whole log: > > bacula:~ # bscan -b /root/bacula/mju1-fd_MJU-MES3.bsr -m -n bacula -u > > bacula -P bacula -s -S -v /dev/st0 > > bscan: butil.c:282 Using device: "/dev/st0" for reading. > > 13-Apr 08:17 bscan JobId 0: Ready to read from volume "MJU-MES3" on device > > "LTO3Drive" (/dev/st0). > > bscan: bscan.c:297 First Volume Size = 0 > > bscan: bscan.c:309 Using Database: bacula, User: bacula > > 13-Apr 08:17 bscan JobId 0: Forward spacing Volume "MJU-MES3" to file:block > > 0:1. > > bscan: bscan.c:521 SOS_LABEL: Found Job record for JobId: 375 > > ... > > bscan: bscan.c:689 1,572,864 file records. At file:blk=165:13,267 > > bytes=330,660,788,028 > > bscan: bscan.c:1037 Fileset "MJU_NSS" already exists. > > bscan: bscan.c:1152 Could not update JobId=328 record. ERR=sql_update.c:196 > > Update failed: affected_rows=0 for UPDATE Job SET > > JobStatus='T',EndTime='2010-03-30 > > 05:21:18',ClientId=2,JobBytes=33547479,ReadBytes=0,JobFiles=1594852,JobErrors=0,VolSessionId=43,VolSessionTime=1268211453,PoolId=0,FileSetId=9,JobTDate=1269919278,RealEndTime='2010-03-30 > > 05:21:18',PriorJobId=0 WHERE JobId=328 > > > > bscan: bscan.c:1245 Could not create JobMedia record. ERR=sql_create.c:156 > > Update Media record UPDATE Media SET EndFile=167, EndBlock=27602 WHERE > > MediaId=0 failed: ERR= > > > > What is in the bsr file? Also, I notice that you have two different bsr files > in the command lines above. Do you have any bsr files that work? > > BTW, I hope you aren't using /dev/st0 in your bacula-sd.conf -- it should be > /dev/nst0, otherwise the start of the tape might be overwritten if you run > more than one job. > > __Martin > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > ___ > Bacula-users mailing list > Bacula-users < at > lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users Thanks for the notice __Martin. You are right. The first bsr (TED2) is wrong one. But the second one (mju1-fd_MJU-MES3.bsr) should be valid one. I actually have 3 bsr files (3 jobs) for that monthly tape mju1-fd_MJU-MES3.bsr mju2-fd_MJU-MES3.bsr mju3-fd_MJU-MES3.bsr but only first one is important. Should I include all 3 bsr files in one command line? The reason I am trying to get data from this tape is because I installed a new bacula server. Old bacula server was the same version (3.0.2). A new server used LTO-3 drive, a new one has LTO-4. I left section for LTO-3 drive in bacula-sd.conf. I dumped catalog from old server and inported it to new server. Restore from old tape worked. The problem occured because the first time monthly tape should be used on new server, but backup on new server did not start (forgot to add mount to start of the job). Because old server was still running, I have montly backup, which is in catalog on old server, but not in catalog on new server. I would like to import it to new server. I know I could use bextract in case of emergency, but I would still like to import informations about data on monthly tape into new catalog. Bacula reports that jobs are imported, but volume is not. I am using /dev/st0, not /dev/nst0. Why would be this wrong? I have no problem running more than one job. +-- |This was sent by lado.lan...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows File Recovery
On 14.04.2010 1:54, Jon bruce wrote: > Hello there, > > I have a Linux bacula director with a few clients. So far so good, except > when I need to select files from one client which is a windows computer. > > > From bconsole I enter the command restore, select 6: Select backup for a > client before a specified time and pick my date and time. Then select my > client and FileSet. Bacula shows me ... > > You have selected the following JobIds: 303,345 > > Building directory tree for JobId(s) 303,345 ... > ++ > 61,909 files inserted into the tree. > > Then dumps me to the file selection mode. I can now do ls and see (for > example) d:\office\Employee files/ however trying cd "d:\office\Employee > files/" does not work, it returns "Invalid path given.". I've tried > different combinations of \ and / and " and ', etc all with the same > result. cddoes show me that directory as well. > > If I use *Employee* it works, however I need a specific directory under > that, not the whole thing. Based on > http://man.chinaunix.net/network/bacula/bacula_manual/Bacula_Consol_Restor_Comman.html#SECTION0002111000 > I am trying the right command. > > Any thoughts or help would be great. I should point out that I'm using > bacula 5.0.1 from Debian BackPorts and the windows side was downloaded > from > sourceforge. > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > Hello. I always use in situation of setting files/folders for restore such scheme. At directory tree I make cd step only on one level in depth, i.e. > ls see directories names. maybe copy name of needed dir > cd [DirectoryName] and so on -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Full/Inc Questions (Noob)
On 14/04/10 03:53, ikkysleepy wrote: > > Hi, > > I have two external backup drives that I want to incorporate using Bacula, > but have some questions: > > > 1) When making a Full backup, does this replace the expired backup or will > this create a new Volume on the drive? Depends on your pool configuration. In most setups it'll recycle an older volume that's outside its retention period. See the bacula documentation. > 2) Can you force the Full backup to expire on a weekend? Why would you want to? ... and yes, using a cron job that prunes (safe) or purges (unsafe) it via a command to the director. > 3) Will auto-pruning prune the oldest incremental? Depends on your retention setup. > 4) I read that having many incremental backups, like I plan on having will > make the restoring of files slow compared to a diff, can someone confirm this? I've never had a problem, and sometimes have hundreds of incrementals. However, I use disk-based storage. On tape it might well be an issue. -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
On 14/04/10 00:19, Jerry Lowry wrote: > I also get an error saying that it can not create a directory on the > same disk for the same reason " ERR= No space left on device". But I > think this is the same type of error. Betcha you've run out of free inodes on the target file system. Run "df -i" to see. -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula won't backup files with apostrophes
On 13/04/10 20:54, James Harper wrote: > The OP seems to be using an actual Windows server so this may not be > relevant, but there are stacks of SMB appliances (that may run Windows > or not) that are closed wrt putting additional software on them, and the > only way to get the data on or off is via SMB. Most of them don't run Windows and don't have Windows' limits about opening a file multiple times, though, so you can at least still back up open files. You don't get any guarantee of consistent copies, but then you don't get that with Bacula on a unix or Mac system either due to the lack of a VSS equivalent. (I know, you can take a full file system snapshot and mount it as I do for my mail spool backups, but clumsy?!?) -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
thanks Ralf, after playing around with the setting, that was what it was. It seems to be restoring nowI say seems because the 'st dir' show the job waiting on the storage 'File 1', although when I look at the disk is has directories and files and is growing in used space. Any ideas why it says 'waiting on storage 'File1' and yet it is running? jerry Ralf Gross wrote: Jerry Lowry schrieb: Martin, I am trying to restore the files to the file system on the bacula server. The client 'swift-fd' definitely does NOT have room on the disk to restore all the pdfs. That is why my restore is configured with -> "where= /backup0/bacula-restores". No, jlowry:swift 61>ls /home/hardware/backup0 /home/hardware/backup0: No such file or directory When it tries the restore it fails to create the directory structure on the backup server. This is based on the error message that I get. 12-Apr 13:54 swift-fd JobId 137: Error: restore.c:1133 Write error on /backup0/bacula-restores/home/hardware/pdf/rca/sarah.tv.pdf: No space left on device your are trying to restore to the client swift-fd, I guess this is not what you want. You have to change this in your restore settings. Ralf -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TR: Getting auto-label feature to work properly
Try using 'LabelFormat' without space? On 12/04/10 19:19, Dominique Jeannerod wrote: > One up on this question please. > > I can’t get the auto-labeling function to work as expected -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Volume selection
> I configured bacula with multiple pools and I assigned some volumes to > each pool before hand. > In the past two differential backups, bacula did not use the volumes > already assigned to the pool, but it took one from the scratch pool, > assigned to the pool and used it. > > Could anyone clarify why bacula is not using the volumes previously > assigned to the pool that are empty, and is importing a new volume from > the scratch pool? > > Any help would be very much appreciated. > They probably are not available for recycling. Take a look at the list media command in the bacula console. BTW. I work in the Radiology Department at pitt. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula Full/Inc Questions (Noob)
Hi, I have two external backup drives that I want to incorporate using Bacula, but have some questions: 1) When making a Full backup, does this replace the expired backup or will this create a new Volume on the drive? 2) Can you force the Full backup to expire on a weekend? 3) Will auto-pruning prune the oldest incremental? 4) I read that having many incremental backups, like I plan on having will make the restoring of files slow compared to a diff, can someone confirm this? Here is my planed setup: Source: ~460 GB (M-F) Daily Changes: ~0.5-2 GB Backup Drive #1 size: 1 TB Backup Drive #2 size: 1 TB Schedule: Week #1 Drive #1, run Full Backup (Expire in 3 months) on a weekend Drive #1, run daily Incremental backup M-F for Week Week #2 Drive #2, run Full Backup (Expire in 3 months) on a weekend Take Drive #1 home on Monday Drive #2, run daily Incremental backup M-F for Week Week #3 Take Drive #2 home on Monday Drive #1, run daily Incremental backup M-F for Week Week #4 Take Drive #1 home on Monday Drive #2, run daily Incremental backup M-F for Week . . . The purpose of the two drives is to have at least one week of data off-site, plus weeks worth of incrementals. Thanks, +-- |This was sent by ikkysle...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Windows File Recovery
Hello there, I have a Linux bacula director with a few clients. So far so good, except when I need to select files from one client which is a windows computer. >From bconsole I enter the command restore, select 6: Select backup for a client before a specified time and pick my date and time. Then select my client and FileSet. Bacula shows me ... You have selected the following JobIds: 303,345 Building directory tree for JobId(s) 303,345 ... ++ 61,909 files inserted into the tree. Then dumps me to the file selection mode. I can now do ls and see (for example) d:\office\Employee files/ however trying cd "d:\office\Employee files/" does not work, it returns "Invalid path given.". I've tried different combinations of \ and / and " and ', etc all with the same result. cd does show me that directory as well. If I use *Employee* it works, however I need a specific directory under that, not the whole thing. Based on http://man.chinaunix.net/network/bacula/bacula_manual/Bacula_Consol_Restor_Comman.html#SECTION0002111000 I am trying the right command. Any thoughts or help would be great. I should point out that I'm using bacula 5.0.1 from Debian BackPorts and the windows side was downloaded from sourceforge. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Volume selection
Hi I configured bacula with multiple pools and I assigned some volumes to each pool before hand. In the past two differential backups, bacula did not use the volumes already assigned to the pool, but it took one from the scratch pool, assigned to the pool and used it. Could anyone clarify why bacula is not using the volumes previously assigned to the pool that are empty, and is importing a new volume from the scratch pool? Any help would be very much appreciated. Thanks Max -- Massimiliano (Max) Novelli System Administrator University of Pittsburgh Email: m...@pitt.edu Phone: +1.412.624-6898 LRDC Suite 718 3939 O'Hara Street Pittsburgh, PA 15260 Phone: +1.412.586.9251 Oxford Building Suite 450, Room 461 3501 Forbes Avenue Pittsburgh, PA 15213 -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
Jerry Lowry schrieb: > Martin, I am trying to restore the files to the file system on the > bacula server. The client 'swift-fd' definitely does NOT have room on > the disk to restore all the pdfs. That is why my restore is configured > with -> "where= /backup0/bacula-restores". > > No, > jlowry:swift 61>ls /home/hardware/backup0 > /home/hardware/backup0: No such file or directory > > When it tries the restore it fails to create the directory structure on > the backup server. This is based on the error message that I get. > > 12-Apr 13:54 swift-fd JobId 137: Error: restore.c:1133 Write error on > /backup0/bacula-restores/home/hardware/pdf/rca/sarah.tv.pdf: No space left on > device your are trying to restore to the client swift-fd, I guess this is not what you want. You have to change this in your restore settings. Ralf -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
Martin, I am trying to restore the files to the file system on the bacula server. The client 'swift-fd' definitely does NOT have room on the disk to restore all the pdfs. That is why my restore is configured with -> "where= /backup0/bacula-restores". No, jlowry:swift 61>ls /home/hardware/backup0 /home/hardware/backup0: No such file or directory When it tries the restore it fails to create the directory structure on the backup server. This is based on the error message that I get. 12-Apr 13:54 swift-fd JobId 137: Error: restore.c:1133 Write error on /backup0/bacula-restores/home/hardware/pdf/rca/sarah.tv.pdf: No space left on device thanks, jerry Martin Simmons wrote: On Tue, 13 Apr 2010 09:19:11 -0700, Jerry Lowry said: Craig, The file systems are definitely not full, especially /backup0. The disk backup is on the /backup1 volume, it size is below. FilesystemSize Used Avail Use% Mounted on /dev/sda1 241G 6.5G 222G 3% / tmpfs 1.7G 236K 1.7G 1% /dev/shm /dev/sda3 963G 31G 884G 4% /backup0 /dev/sdb1 917G 232G 640G 27% /backup1 /dev/sde1 917G 201G 670G 24% /backup2 /dev/sdf1 917G 72M 871G 1% /backup3 /dev/sdc1 917G 210G 661G 25% /backup4 /dev/sdd1 917G 759G 112G 88% /backup5 /dev/sda4 165G 1.5G 155G 1% /database ++ total 232G -rw-r- 1 root root 231G 2010-04-10 14:00 hardware-0014 I don't think any of the files are bigger that 2GB as they are all pdf documents and tool updates. At most maybe 30 MB but nothing in the GB region. As for restoring the right client. I walk through the 'bat' restore and select the client ( only have three ) it walks through and creates the build list. The 'bacula-restores' directory is owned by 'root' but is wide open as far as privileges. I have only two different full backups this one and another one. So there aren't alot of .bsr files to select from and they match the client that was backed up. I also get an error saying that it can not create a directory on the same disk for the same reason " ERR= No space left on device". But I think this is the same type of error. When you do a restare, there are two clients to consider: the one from the original backup and the one where the restore occurs. By default, they are the same. Just to be doubly sure, was that df output generated on the machine running as swift-fd, which is the where the restore is occurring? Can you see the /backup0/bacula-restores/home/hardware/pdf/altera/quartus/81_linux/ directory on that machine? __Martin Still no joy in restore. thanks Craig Ringer wrote: On 13/04/10 05:15, Jerry Lowry wrote: Hi, I am still tweaking a new installation of bacula 5.0.1 on Centos 5.4. The backups work fine but I am trying to get the restore to work and I keep getting the following errors: Volume "hardware-0014" tofile:block 7:2933114700. 10-Apr 12:51 swift-fd JobId 118: Error: restore.c:1133 Write error on /backup0/bacula-restores/home/hardware/pdf/altera/quartus/81_linux/81_nios2eds_linux.tar: No space left on device The volume is a disk drive and I am trying to restore it to a dedicated restore directory on a different disk. I have checked the config files with an old set that I was running under 1.38 and it look very similar( ie names of pools and disks were changed). "No space left on device" can also mean with some file systems "this file is bigger than the maximum file size permitted by this file system". Is 81_nios2eds_linux.tar bigger than 2GB? What file system is being restored onto? Are you *SURE* that /backup0/bacula-restores has the free space required (according to "df -h /backup0/bacula-restores" )? Are you restoring to the right client? -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
> On Tue, 13 Apr 2010 09:19:11 -0700, Jerry Lowry said: > > Craig, > The file systems are definitely not full, especially /backup0. The disk > backup is on the /backup1 volume, it size is below. > > FilesystemSize Used Avail Use% Mounted on > /dev/sda1 241G 6.5G 222G 3% / > tmpfs 1.7G 236K 1.7G 1% /dev/shm > /dev/sda3 963G 31G 884G 4% /backup0 > /dev/sdb1 917G 232G 640G 27% /backup1 > /dev/sde1 917G 201G 670G 24% /backup2 > /dev/sdf1 917G 72M 871G 1% /backup3 > /dev/sdc1 917G 210G 661G 25% /backup4 > /dev/sdd1 917G 759G 112G 88% /backup5 > /dev/sda4 165G 1.5G 155G 1% /database > ++ > total 232G > -rw-r- 1 root root 231G 2010-04-10 14:00 hardware-0014 > > I don't think any of the files are bigger that 2GB as they are all pdf > documents and tool updates. At most maybe 30 MB but nothing in the GB > region. > > As for restoring the right client. I walk through the 'bat' restore and > select the client ( only have three ) it walks through and creates the > build list. The 'bacula-restores' directory is owned by 'root' but is > wide open as far as privileges. > I have only two different full backups this one and another one. So > there aren't alot of .bsr files to select from and they match the client > that was backed up. > > I also get an error saying that it can not create a directory on the > same disk for the same reason " ERR= No space left on device". But I > think this is the same type of error. When you do a restare, there are two clients to consider: the one from the original backup and the one where the restore occurs. By default, they are the same. Just to be doubly sure, was that df output generated on the machine running as swift-fd, which is the where the restore is occurring? Can you see the /backup0/bacula-restores/home/hardware/pdf/altera/quartus/81_linux/ directory on that machine? __Martin > > Still no joy in restore. > thanks > > > Craig Ringer wrote: > > On 13/04/10 05:15, Jerry Lowry wrote: > >> Hi, I am still tweaking a new installation of bacula 5.0.1 on Centos > >> 5.4. The backups work fine but I am trying to get the restore to work > >> and I keep getting the following errors: > >> > >> Volume "hardware-0014" tofile:block 7:2933114700. > >> 10-Apr 12:51 swift-fd JobId 118: Error: restore.c:1133 Write error on > >> /backup0/bacula-restores/home/hardware/pdf/altera/quartus/81_linux/81_nios2eds_linux.tar: > >> > >> No space left on device > >> > >> The volume is a disk drive and I am trying to restore it to a dedicated > >> restore directory on a different disk. I have checked the config files > >> with an old set that I was running under 1.38 and it look very similar( > >> ie names of pools and disks were changed). > > > > "No space left on device" can also mean with some file systems "this > > file is bigger than the maximum file size permitted by this file system". > > > > Is 81_nios2eds_linux.tar bigger than 2GB? What file system is being > > restored onto? > > > > Are you *SURE* that /backup0/bacula-restores has the free space > > required (according to "df -h /backup0/bacula-restores" )? > > > > Are you restoring to the right client? > > > > -- > > Craig Ringer > -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
Am Tue, 13 Apr 2010 15:59:25 +0200 schrieb Koldo Santisteban: > thanks for your answer. > The first stage was with mysql 5.0.77, and works with bacula 3.0.3 > without > problems. I have used the same database and server with bacula 5.0.1. > The bacula server + DB is a 3,5 Gb Ram with a Xeon processor. I have > tested my environment installing postgree on the same server and with a > empty db. I create full bacula server backup and then try to restore. I > have detected that the restore process works fine usgin bweb and bacula > 5.0.1, what is the difference between bat and bweb? noticed too, bat takes forever on building trees on restores. bconsole is _much_ faster. - Thomas -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
Heya, This response isn't advice, just a statement about how 5.0.1 is working out for me in a mysql environment. I've read a lot of concerns out there and like you say, there are issues, but no magic bullet, so I too am trying to understand the situation so as not to create problems for myself now or down the road. My catalog... mysql-5.0.77 (64bit) MyISAM 210Gb in size 1,412,297,215 records in File table note: database built with bacula 2x scripts, upgraded with 3x scripts, then again with 5x scripts (i.e. nothing customized along the way) My OS & hardware for bacula DIR+SD server... Centos 5.4 (fully patched) 8Gb RAM 2Gb Swap 1Tb EXT3 filesystem on external fiber RAID5 array (dedicated to database, incl. temp files) 2 dual-core [AMD Opteron(tm) Processor 2220] CPUs My experience... I was worried when I migrated to 5.x because I had heard of slow mysql issues, but building the "most recent" restore tree for a 1.23Tb 6,578,204-files FileSet takes just under 5 minutes. That response time seems reasonable and acceptable to me. Hope this info helps at least define what's possible -- would be nice to see more stats about the bacula community in general. Good luck! thanks, Stephen On 04/13/2010 05:42 AM, Koldo Santisteban wrote: > Hello > I am working with bacula 5.0.1. On first stage i setup the server with > bacula 5.0.1 and Mysql, but, when i need to restore i have found that > "the bulid tree process" take 10-12 hours (or more). I have read all > about this issues and i can see that no exists any "magic" solution. In > order to solve it, i have migrate from mysql to postgre, but i can see > the same symtopms. Perhaps it works better, but, in my opnion, this is > not serios on a production environment. > If it´s possible, i will appreciate it people share their experience > with bacula last version and this kind of issues. A couple of month ago > i finished to deploy bacula on my environment, but now, i am considering > to go back all. > Please any comment regarding this case is welcome. > Regards > > > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Stephen Thompson Berkeley Seismological Laboratory step...@seismo.berkeley.edu215 McCone Hall # 4760 404.538.7077 (phone) University of California, Berkeley 510.643.5811 (fax) Berkeley, CA 94720-4760 -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-devel mailing list bacula-de...@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TR: Getting auto-label feature to work properly
Yes, I also understood with the documentation that my configuration should
work.
I have the same problem with 3.0.3, and 5.0.1 versions.
The problem occurs with regular backup jobs, only when scheduled (or ran in
parallel), as manual tests on a single job are ok (volumes are being
recycled, and then new volumes auto-labeled).
-Message d'origine-
De : Craig Ringer [mailto:cr...@postnewspapers.com.au]
Envoyé : mardi 13 avril 2010 10:47
À : Dominique Jeannerod
Cc : bacula-users@lists.sourceforge.net
Objet : Re: [Bacula-users] TR: Getting auto-label feature to work properly
On 13/04/10 16:29, Dominique Jeannerod wrote:
> Thanks a lot Craig, for your answer.
> I didn't configure a "maximum volumes" directive, so what I was expecting
> Bacula to do is :
> - Auto-Recycle a volume if possible, regarding retention periods.
> - Automatically create a new one with auto-label feature
>
> I there an implicit maximum volumes limit ?
You know, I don't think I've ever tried using a pool without an explicit
max volumes. As far as I know there's no built-in limit.
The documentation:
http://www.bacula.org/fr/dev-manual/Automatic_Volume_Recycling.html
suggests that your pool definitions:
> Pool {
> Name = PS_Default
> Pool Type = Backup
> Recycle = yes
> AutoPrune = yes
> VolumeRetention = 3 days
> Use Volume Once = yes
> Label Format = "SYS-SD-FR-2-${C_SYS+}"
> NextPool = PS_VFull
> }
>
> Pool {
> Name = PS_VFull
> Pool Type = Backup
> Recycle = yes
> AutoPrune = yes
> VolumeRetention = 3 days
> Use Volume Once = yes
> Label Format = "SYS-VFULL-SD-FR-2-${C_SYSVFULL+}"
> Storage = fr-201-sd-vfull
> }
... should result in proper recycling.
Is the problem with a migration job? Or a regular backup job?
What does "list volumes" show?
( This sort of thing is why I *REALLY* wish Bacula would say *why* it
wanted a volume mount when it's using an auto-label pool. It's like
going next door and saying "er, can I borrow a bucket?" when what you
want to be saying is "help, help, my house is on fire!" )
--
Craig Ringer
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
Craig, The file systems are definitely not full, especially /backup0. The disk backup is on the /backup1 volume, it size is below. FilesystemSize Used Avail Use% Mounted on /dev/sda1 241G 6.5G 222G 3% / tmpfs 1.7G 236K 1.7G 1% /dev/shm /dev/sda3 963G 31G 884G 4% /backup0 /dev/sdb1 917G 232G 640G 27% /backup1 /dev/sde1 917G 201G 670G 24% /backup2 /dev/sdf1 917G 72M 871G 1% /backup3 /dev/sdc1 917G 210G 661G 25% /backup4 /dev/sdd1 917G 759G 112G 88% /backup5 /dev/sda4 165G 1.5G 155G 1% /database ++ total 232G -rw-r- 1 root root 231G 2010-04-10 14:00 hardware-0014 I don't think any of the files are bigger that 2GB as they are all pdf documents and tool updates. At most maybe 30 MB but nothing in the GB region. As for restoring the right client. I walk through the 'bat' restore and select the client ( only have three ) it walks through and creates the build list. The 'bacula-restores' directory is owned by 'root' but is wide open as far as privileges. I have only two different full backups this one and another one. So there aren't alot of .bsr files to select from and they match the client that was backed up. I also get an error saying that it can not create a directory on the same disk for the same reason " ERR= No space left on device". But I think this is the same type of error. Still no joy in restore. thanks Craig Ringer wrote: On 13/04/10 05:15, Jerry Lowry wrote: Hi, I am still tweaking a new installation of bacula 5.0.1 on Centos 5.4. The backups work fine but I am trying to get the restore to work and I keep getting the following errors: Volume "hardware-0014" tofile:block 7:2933114700. 10-Apr 12:51 swift-fd JobId 118: Error: restore.c:1133 Write error on /backup0/bacula-restores/home/hardware/pdf/altera/quartus/81_linux/81_nios2eds_linux.tar: No space left on device The volume is a disk drive and I am trying to restore it to a dedicated restore directory on a different disk. I have checked the config files with an old set that I was running under 1.38 and it look very similar( ie names of pools and disks were changed). "No space left on device" can also mean with some file systems "this file is bigger than the maximum file size permitted by this file system". Is 81_nios2eds_linux.tar bigger than 2GB? What file system is being restored onto? Are you *SURE* that /backup0/bacula-restores has the free space required (according to "df -h /backup0/bacula-restores" )? Are you restoring to the right client? -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: bacula won't backup files with apostrophes
--- On Tue, 4/13/10, Mark Coolen wrote: From: Mark Coolen Subject: Re: [Bacula-users] Fwd: bacula won't backup files with apostrophes To: "Joseph Spenner" Cc: bacula-users@lists.sourceforge.net Date: Tuesday, April 13, 2010, 8:38 AM I don't think that would help me in this situation, would it? I have no login access to the server so I won't be allowed to set up the whole server in a virtual machine. ... or, do you mean something else? Yes, virtualization would probably require their involvement. But it's not too tough to virtualize an existing system. It might mean a little down time though. The benefits are tremendous-- from a resource and a recoverability standpoint. Are they not interested in disaster recovery? Or will it take a failure before that need arises? -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: bacula won't backup files with apostrophes
I don't think that would help me in this situation, would it? I have no login access to the server so I won't be allowed to set up the whole server in a virtual machine. ... or, do you mean something else? 2010/4/13 Joseph Spenner > --- On *Tue, 4/13/10, Mark Coolen * wrote: > > > > I'm a TSA at a large school board. The server is at my main school, but > because of new policies that came in when we switched over to Active > Directory from Novell I don't have login rights to the fileserver anymore. > This means that I can't install the bacula client. > > There is no sane backup solution at my biggest school so I decided to use > Ubuntu LTS, a terrabyte external HD and bacula. I do the backups in the > middle of the night (which, of course, is how bacula really likes to work > ;-) and workstations are shut down at 6:30 PM so the number of open files is > minimal. This really is the best I can do at the moment unfortunately. > > I'm trying to document how well things work (and, except for this issue, > they work perfectly) so that I can argue for the client being installed on > the server. I don't hold out much hope though. > > Ever thought about virtualization? (ie: VirtualBox) > You could virtualize this Windows system, then run bacula on the VirtualBox > host and not have to mess with the Windows piece at all. Of course, it will > be a complete backup every night, but at least you'd be covered. > > > > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > > -- ___ | Coolen Software Solutions | +1.519.652.9378 | mark.coo...@gmail.com |___ -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: bacula won't backup files with apostrophes
--- On Tue, 4/13/10, Mark Coolen wrote: I'm a TSA at a large school board. The server is at my main school, but because of new policies that came in when we switched over to Active Directory from Novell I don't have login rights to the fileserver anymore. This means that I can't install the bacula client. There is no sane backup solution at my biggest school so I decided to use Ubuntu LTS, a terrabyte external HD and bacula. I do the backups in the middle of the night (which, of course, is how bacula really likes to work ;-) and workstations are shut down at 6:30 PM so the number of open files is minimal. This really is the best I can do at the moment unfortunately. I'm trying to document how well things work (and, except for this issue, they work perfectly) so that I can argue for the client being installed on the server. I don't hold out much hope though. Ever thought about virtualization? (ie: VirtualBox) You could virtualize this Windows system, then run bacula on the VirtualBox host and not have to mess with the Windows piece at all. Of course, it will be a complete backup every night, but at least you'd be covered. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Could not create JobMedia record
> On Tue, 13 Apr 2010 04:08:03 -0400, ladolf said: > > I am trying to import tape data to bacula catalog using bscan: > bscan -b mju3-fd_MJU-TED2.bsr -m -n bacula -u bacula -P bacula -h localhost > -s -S -v /dev/st0 > > I got this error: > bscan: bscan.c:1245 Could not create JobMedia record. ERR=sql_create.c:156 > Update Media record UPDATE Media SET EndFile=167, EndBlock=27602 WHERE > MediaId=0 failed: ERR= > > This is whole log: > bacula:~ # bscan -b /root/bacula/mju1-fd_MJU-MES3.bsr -m -n bacula -u bacula > -P bacula -s -S -v /dev/st0 > bscan: butil.c:282 Using device: "/dev/st0" for reading. > 13-Apr 08:17 bscan JobId 0: Ready to read from volume "MJU-MES3" on device > "LTO3Drive" (/dev/st0). > bscan: bscan.c:297 First Volume Size = 0 > bscan: bscan.c:309 Using Database: bacula, User: bacula > 13-Apr 08:17 bscan JobId 0: Forward spacing Volume "MJU-MES3" to file:block > 0:1. > bscan: bscan.c:521 SOS_LABEL: Found Job record for JobId: 375 > ... > bscan: bscan.c:689 1,572,864 file records. At file:blk=165:13,267 > bytes=330,660,788,028 > bscan: bscan.c:1037 Fileset "MJU_NSS" already exists. > bscan: bscan.c:1152 Could not update JobId=328 record. ERR=sql_update.c:196 > Update failed: affected_rows=0 for UPDATE Job SET > JobStatus='T',EndTime='2010-03-30 > 05:21:18',ClientId=2,JobBytes=33547479,ReadBytes=0,JobFiles=1594852,JobErrors=0,VolSessionId=43,VolSessionTime=1268211453,PoolId=0,FileSetId=9,JobTDate=1269919278,RealEndTime='2010-03-30 > 05:21:18',PriorJobId=0 WHERE JobId=328 > > bscan: bscan.c:1245 Could not create JobMedia record. ERR=sql_create.c:156 > Update Media record UPDATE Media SET EndFile=167, EndBlock=27602 WHERE > MediaId=0 failed: ERR= What is in the bsr file? Also, I notice that you have two different bsr files in the command lines above. Do you have any bsr files that work? BTW, I hope you aren't using /dev/st0 in your bacula-sd.conf -- it should be /dev/nst0, otherwise the start of the tape might be overwritten if you run more than one job. __Martin -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
thanks for your answer. The first stage was with mysql 5.0.77, and works with bacula 3.0.3 without problems. I have used the same database and server with bacula 5.0.1. The bacula server + DB is a 3,5 Gb Ram with a Xeon processor. I have tested my environment installing postgree on the same server and with a empty db. I create full bacula server backup and then try to restore. I have detected that the restore process works fine usgin bweb and bacula 5.0.1, what is the difference between bat and bweb? On Tue, Apr 13, 2010 at 3:10 PM, John Drescher wrote: > > I am working with bacula 5.0.1. On first stage i setup the server with > > bacula 5.0.1 and Mysql, but, when i need to restore i have found that > "the > > bulid tree process" take 10-12 hours (or more). I have read all about > this > > issues and i can see that no exists any "magic" solution. In order to > solve > > it, i have migrate from mysql to postgre, but i can see the same > symtopms. > > Perhaps it works better, but, in my opnion, this is not serios on a > > production environment. > > If it´s possible, i will appreciate it people share their experience with > > bacula last version and this kind of issues. A couple of month ago i > > finished to deploy bacula on my environment, but now, i am considering to > go > > back all. > > Please any comment regarding this case is welcome. > > Regards > > You need to tune your database. Is it on a fast raid 5, 10, or 6? How > many files are in your dataset? Do you have 8GB of ram on your > database server or more? How big is your postgres database? > > I have between 8 and 10 million files in my 30GB postgres database for > bacula and restore times are nothing like this. My database server is > 5 years old. Although it is on a different machine than the director. > > John > -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: bacula won't backup files with apostrophes
On 04/13/10 08:58, Mark Coolen wrote: > I'm a TSA at a large school board. The server is at my main school, but > because of new policies that came in when we switched over to Active > Directory from Novell I don't have login rights to the fileserver > anymore. This means that I can't install the bacula client. Ah, so yet another situation where policies written by the ignorant actively get in the way of getting critical work done. I feel your pain. :p -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, Free Stater It's not the years, it's the mileage. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
> I am working with bacula 5.0.1. On first stage i setup the server with > bacula 5.0.1 and Mysql, but, when i need to restore i have found that "the > bulid tree process" take 10-12 hours (or more). I have read all about this > issues and i can see that no exists any "magic" solution. In order to solve > it, i have migrate from mysql to postgre, but i can see the same symtopms. > Perhaps it works better, but, in my opnion, this is not serios on a > production environment. > If it´s possible, i will appreciate it people share their experience with > bacula last version and this kind of issues. A couple of month ago i > finished to deploy bacula on my environment, but now, i am considering to go > back all. > Please any comment regarding this case is welcome. > Regards You need to tune your database. Is it on a fast raid 5, 10, or 6? How many files are in your dataset? Do you have 8GB of ram on your database server or more? How big is your postgres database? I have between 8 and 10 million files in my 30GB postgres database for bacula and restore times are nothing like this. My database server is 5 years old. Although it is on a different machine than the director. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
On Tue, Apr 13, 2010 at 02:42:15PM +0200, Koldo Santisteban wrote: > Hello > I am working with bacula 5.0.1. On first stage i setup the server with > bacula 5.0.1 and Mysql, but, when i need to restore i have found that "the > bulid tree process" take 10-12 hours (or more). I have read all about this Could you share more info on your environment ? MySQL version (and specific settings like MyISAM/InnoDB buffers etc), hardware specs, number of records in various tables (count(*) in File, Job, Path, Filename...) http://wiki.bacula.org/doku.php?id=faq#jobs_with_accurate_filesets_take_forever_deprecated http://wiki.bacula.org/doku.php?id=faq#restore_takes_a_long_time_to_retrieve_sql_results_from_mysql_catalog If you look into: http://bugs.bacula.org/view.php?id=1472 it seems that the issue is only with bacula 5 series; bacula 3.0.3 and lower are *much* faster (less then 10 minutes instead of 20+ hours). The bug is being looked into currently. Apart from this bug, there is also a discussion on this list with subject "VirtualFull mysql query blocks other jobs for a?long time" which tackles wider SQL issues... > issues and i can see that no exists any "magic" solution. In order to solve > it, i have migrate from mysql to postgre, but i can see the same symtopms. Again, more data ? PostgreSQL version ? is it any faster (it should be about 600% faster on same datasets according to links above) or not ? > Perhaps it works better, but, in my opnion, this is not serios on a > production environment. I agree. Apart from downgrading (which could be quite ok for you, but it was not possible for us for other issues, like bug 1528) you could reduce your file retention (it helps greatly) Anyway, if you can, downgrade to 3.0.3; if you can't, look into bug 1472 and share your info. > If it´s possible, i will appreciate it people share their experience with > bacula last version and this kind of issues. A couple of month ago i > finished to deploy bacula on my environment, but now, i am considering to go > back all. see the http://bugs.bacula.org/view.php?id=1472 for my info, and also for things that fix it (like undefining new_db_get_file_list in sql_get.c) -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
On Tue, Apr 13, 2010 at 02:03:39PM +0100, Graham Keeling wrote: > On Tue, Apr 13, 2010 at 02:42:15PM +0200, Koldo Santisteban wrote: > > Hello > > I am working with bacula 5.0.1. On first stage i setup the server with > > bacula 5.0.1 and Mysql, but, when i need to restore i have found that "the > > bulid tree process" take 10-12 hours (or more). I have read all about this > > issues and i can see that no exists any "magic" solution. In order to solve > > it, i have migrate from mysql to postgre, but i can see the same symtopms. > > Perhaps it works better, but, in my opnion, this is not serios on a > > production environment. > > If it´s possible, i will appreciate it people share their experience with > > bacula last version and this kind of issues. A couple of month ago i > > finished to deploy bacula on my environment, but now, i am considering to go > > back all. > > Please any comment regarding this case is welcome. > > Regards > > Hello, > > I had similar problems with virtual and accurate backups until I made sure > that the indexes on my mysql database were the bacula defaults. > In particular, I had these indexes on my File table: > > JobId > JobId, PathId, FilenameId > PathId > FilenameId > > Once I had removed the PathId and FilenameId indexes, my queries changed from > taking many hours to taking about a second. For clarity, I now have these indexes on my File table: JobId JobId, PathId, FilenameId > > To check these on your database: > Log into mysql. > use bacula; > show indexes from File; > > If you have any extra indexes, you can drop them like this: > > drop index on File; > e.g: drop index PathId on File; > > If you need to add one: > > create index on File (); > e.g: create index JobId on File (JobId); > > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: bacula won't backup files with apostrophes
I'm a TSA at a large school board. The server is at my main school, but because of new policies that came in when we switched over to Active Directory from Novell I don't have login rights to the fileserver anymore. This means that I can't install the bacula client. There is no sane backup solution at my biggest school so I decided to use Ubuntu LTS, a terrabyte external HD and bacula. I do the backups in the middle of the night (which, of course, is how bacula really likes to work ;-) and workstations are shut down at 6:30 PM so the number of open files is minimal. This really is the best I can do at the moment unfortunately. I'm trying to document how well things work (and, except for this issue, they work perfectly) so that I can argue for the client being installed on the server. I don't hold out much hope though. Mark Coolen On 13 April 2010 08:26, Craig Ringer wrote: > On 13/04/10 20:10, Mark Coolen wrote: > >> Thanks for the ideas. I can't run the bacula client on the server, so >> I'm forced to do things this way (I know it isn't, and that's a huge >> understatement, the right way to do it). >> > > Yeah, yer not kidding. For one thing, there's no way to use the volume > shadow copy service over a cifs mount from a *nix box, so you won't be able > to back up files that're open on the Windows box by a local app or one using > a file remotely over smb/cifs. You also won't be able to get consistent > copies of files that're written to at the time of backup. > > You really can't get *any* saner backup option than this? > > -- > Craig Ringer > -- ___ | Coolen Software Solutions | +1.519.652.9378 | mark.coo...@gmail.com |___ -- ___ | Coolen Software Solutions | +1.519.652.9378 | mark.coo...@gmail.com |___ -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
On Tue, Apr 13, 2010 at 02:42:15PM +0200, Koldo Santisteban wrote: > Hello > I am working with bacula 5.0.1. On first stage i setup the server with > bacula 5.0.1 and Mysql, but, when i need to restore i have found that "the > bulid tree process" take 10-12 hours (or more). I have read all about this > issues and i can see that no exists any "magic" solution. In order to solve > it, i have migrate from mysql to postgre, but i can see the same symtopms. > Perhaps it works better, but, in my opnion, this is not serios on a > production environment. > If it´s possible, i will appreciate it people share their experience with > bacula last version and this kind of issues. A couple of month ago i > finished to deploy bacula on my environment, but now, i am considering to go > back all. > Please any comment regarding this case is welcome. > Regards Hello, I had similar problems with virtual and accurate backups until I made sure that the indexes on my mysql database were the bacula defaults. In particular, I had these indexes on my File table: JobId JobId, PathId, FilenameId PathId FilenameId Once I had removed the PathId and FilenameId indexes, my queries changed from taking many hours to taking about a second. To check these on your database: Log into mysql. use bacula; show indexes from File; If you have any extra indexes, you can drop them like this: drop index on File; e.g: drop index PathId on File; If you need to add one: create index on File (); e.g: create index JobId on File (JobId); -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula won't backup files with apostrophes
> > On 13/04/10 20:10, Mark Coolen wrote: > > Thanks for the ideas. I can't run the bacula client on the server, so > > I'm forced to do things this way (I know it isn't, and that's a huge > > understatement, the right way to do it). > > Yeah, yer not kidding. For one thing, there's no way to use the volume > shadow copy service over a cifs mount from a *nix box, so you won't be > able to back up files that're open on the Windows box by a local app or > one using a file remotely over smb/cifs. You also won't be able to get > consistent copies of files that're written to at the time of backup. > > You really can't get *any* saner backup option than this? The OP seems to be using an actual Windows server so this may not be relevant, but there are stacks of SMB appliances (that may run Windows or not) that are closed wrt putting additional software on them, and the only way to get the data on or off is via SMB. James -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula 5.0.1 and db issues - please, share your experience
Hello I am working with bacula 5.0.1. On first stage i setup the server with bacula 5.0.1 and Mysql, but, when i need to restore i have found that "the bulid tree process" take 10-12 hours (or more). I have read all about this issues and i can see that no exists any "magic" solution. In order to solve it, i have migrate from mysql to postgre, but i can see the same symtopms. Perhaps it works better, but, in my opnion, this is not serios on a production environment. If it´s possible, i will appreciate it people share their experience with bacula last version and this kind of issues. A couple of month ago i finished to deploy bacula on my environment, but now, i am considering to go back all. Please any comment regarding this case is welcome. Regards -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula won't backup files with apostrophes
On 13/04/10 20:10, Mark Coolen wrote: > Thanks for the ideas. I can't run the bacula client on the server, so > I'm forced to do things this way (I know it isn't, and that's a huge > understatement, the right way to do it). Yeah, yer not kidding. For one thing, there's no way to use the volume shadow copy service over a cifs mount from a *nix box, so you won't be able to back up files that're open on the Windows box by a local app or one using a file remotely over smb/cifs. You also won't be able to get consistent copies of files that're written to at the time of backup. You really can't get *any* saner backup option than this? -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula won't backup files with apostrophes
Thanks for the ideas. I can't run the bacula client on the server, so I'm forced to do things this way (I know it isn't, and that's a huge understatement, the right way to do it). I'll try setting the iocharset option and see if that works. I should have thought of that. It doesn't make sense that Bacula would be causing this particular problem ;-) Mark On 13 April 2010 04:30, Craig Ringer wrote: > On 13/04/10 02:05, Mark Coolen wrote: > >> Hi; >> I'm backing up files from a Windows share connecting with cifs (samba) >> using autofs. I'm getting an error with files with apostrophes that the >> files doesn't exist and it lists the file path with a ? instead of the >> apostrophe. >> > > First: Perhaps it'd be easier to just run a bacula-fd on the Windows > system, bypassing this issue and giving you reliable backup of files that're > open or being written to during the backup (using VSS) ? > > If for some reason you can't do that, read on. > > This sounds like a character encoding problem. Are they regular ASCII > apostrophes, or are they 'curly' apostrophes (proper inverted commas) ? > > If you create a file name with other unicode characters, is it visible or > does it show up with "???" too? Try a filename like: > > fileåæïöû > > ( this email is in utf-8, so if you're using a brain-dead mail client that > doesn't recognise the encoding declared in the header you might have to save > it and open it as a utf-8 text file in a text editor to see the above ). > > or: > > 立法院上午 > > (random text from news.google.com.tw) > > > If it turns out to be an encoding issue, you'll need to set the `iocharset' > mount option for mount.cifs correctly. See "man mount.cifs" and the output > of the "locale" command. > > If your local encoding isn't utf-8 you won't be able to reliably back up > all possible files that may appear on a Windows system, as some characters > on the remote system will lack local equivalents. > > > -- > Craig Ringer > -- ___ | Coolen Software Solutions | +1.519.652.9378 | mark.coo...@gmail.com |___ -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to Backup a bacula director with another bacula
Bellucci Srl3 Bellucci Srl schrieb: > "13-Apr 12:19 bckam101-dir JobId 46775: Fatal error: Unable to authenticate > with File daemon at "bckam102:9102". Possible causes: Passwords or names not > the same or > > Maximum Concurrent Jobs exceeded on the FD or FD networking messed up > (restart daemon). > > Please see > http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION00376 > for help. > > 13-Apr 12:19 bckam102-fd: Fatal Error at authenticate.c:143 because: > > Incorrect password given by Director at client. > ... The passwords do not match. There is nothing different in backing up a bacula server or a other client. The password must match. One thing to take care of is the database that has to be backed up on the bacula-dir. So you have to dump the db before backup. Ralf -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to turn off 'ask the operator'?
Hello, I am using disk based backups and bacula-5.0.1. When the disk gets full up, bacula gets stuck in a state where a job 'is waiting for a mount request'. Presumably, it wants the system operator to do something. However, at this point, the system operator cannot do anything but cancel the job. I would like to be able to turn off the 'ask the operator' feature so that it just cancels the job straight away. Is there an option for doing this? Thanks. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] VirtualFull mysql query blocks other jobs for a long time
Hello,
I now believe that the 'taking hours' problem that I was having was
down to having additional indexes on my File table, as Eric suggested.
I am using mysql-5.0.45.
I had these indexes:
JobId
JobId, PathId, FilenameId
PathId
FilenameId
Now I have these indexes:
JobId
JobId, PathId, FilenameId
The queries on my 'real' database now take about a second, rather than half a
day.
A suggestion - perhaps the following comment in src/cats/make_mysql_tables.in
could be changed to include a warning:
#
# Possibly add one or more of the following indexes
# to the above File table if your Verifies are
# too slow.
#
# INDEX (PathId),
# INDEX (FilenameId),
# INDEX (FilenameId, PathId)
# INDEX (JobId),
#
However, I also tested the 3.0.3 and 5.0.1 queries using Eric's test script and
the much larger database that it generates.
I found that there is a definite slowdown.
Results from do_bench("10,13", 220). In this case, the slowdown is about
15%.
new|220|220|312
old|220|220|268
graham|220|220|158
Result 'graham' is the time it takes to do a query that I came up with that
looks similar to the postgresql query, but uses the mysql group by trick that
is frowned upon:
SELECT MAX(JobTDate) AS JobTDate, JobId, FileId, FileIndex, PathId, FilenameId,
LStat, MD5 FROM
(SELECT JobTDate, JobId, FileId, FileIndex, PathId, FilenameId, LStat, MD5
FROM
(SELECT FileId, JobId, PathId, FilenameId, FileIndex, LStat, MD5
FROM File WHERE JobId IN ($jobid)
UNION ALL
SELECT File.FileId, File.JobId, PathId, FilenameId,
File.FileIndex, LStat, MD5
FROM BaseFiles JOIN File USING (FileId)
WHERE BaseFiles.JobId IN ($jobid)
) AS T JOIN Job USING (JobId)
ORDER BY FilenameId, PathId, JobTDate DESC ) AS U
GROUP BY PathId, FilenameId
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to Backup a bacula director with another bacula
Hi all, i write you for an issue, I try to backup a bacula server with another bacula server, but I receive always the same error message: "13-Apr 12:19 bckam101-dir JobId 46775: Fatal error: Unable to authenticate with File daemon at "bckam102:9102". Possible causes: Passwords or names not the same or Maximum Concurrent Jobs exceeded on the FD or FD networking messed up (restart daemon). Please see http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION00376 for help. 13-Apr 12:19 bckam102-fd: Fatal Error at authenticate.c:143 because: Incorrect password given by Director at client. 13-Apr 12:19 bckam101-dir JobId 46775: Warning: Unexpected Client Job message: 2999 Authentication failed.". This is my scenario: SERVER ONE - (Bacula 3.0.1) LSB Version: :core-3.1-amd64:core-3.1-ia32:core-3.1-noarch:graphics-3.1-amd64:graphics-3.1-ia32:graphics-3.1-noarch Distributor ID: RedHatEnterpriseServer Description: Red Hat Enterprise Linux Server release 5.3 (Tikanga) Release: 5.3 Codename:Tikanga SERVER TWO - (Bacula 3.0.3) LSB Version: :core-3.1-amd64:core-3.1-ia32:core-3.1-noarch:graphics-3.1-amd64:graphics-3.1-ia32:graphics-3.1-noarch Distributor ID: RedHatEnterpriseServer Description: Red Hat Enterprise Linux Server release 5.3 (Tikanga) Release: 5.3 Codename:Tikanga I have add a job definitions for the SERVER TWO in the SERVER ONE Director config file and for resolve the authenticate problem I have try a password like SERVER TWO hostname (like a normal client), the password for the Director or the password for the SD. I have add in the SERVER TWO FD and SD config files a definitions for the SERVER ONE Director where ask "List Directors who are permitted to contact this File / Storage daemon" but I receive always the authentication error. This two backup servers working really fine for many clients. Now I want to try to cross this backups for a disaster recovery strategy: if my SERVER TWO explodes with his storage I have a copy of his configuration on the SERVER ONE. How is possible backup a Bacula server with another Bacula server? Thanks a lot in advance to all Luca Questo messaggio di posta elettronica contiene informazioni di carattere confidenziale rivolte esclusivamente al destinatario sopra indicato. E' vietato l'uso, la diffusione, distribuzione o riproduzione da parte di ogni altra persona. Nel caso aveste ricevuto questo messaggio di posta elettronica per errore, siete pregati di segnalarlo immediatamente al mittente e distruggere quanto ricevuto (compresi i file allegati) senza farne copia. Qualsivoglia utilizzo non autorizzato del contenuto di questo messaggio costituisce violazione dell'obbligo di non prendere cognizione della corrispondenza tra altri soggetti, salvo pi? grave illecito, ed espone il responsabile alle relative conseguenze. Confidentially notice. This e-mail transmission may contain legally privileged and/or confidential information. Please do not read it if you are not the intended recipient(S). Any use, distribution, reproduction or disclosure by any other person is strictly prohibited. If you have received this e-mail in error, please notify the sender and destroy the original transmission and its attachments without reading or saving it in any manner. Seat Pagine Gialle S.p.A. Cap. Soc. Euro 450.265.793,58 - Sede legale Milano -Via Grosio 10/4 CAP 20151; Sede secondaria Torino - Corso Mortara 22 - CAP 10149 ;Registro Imprese di Milano, Codice Fiscale e Partita IVA n. 03970540963 -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
On Mon, Apr 12, 2010 at 02:15:05PM -0700, Jerry Lowry wrote: > Hi, I am still tweaking a new installation of bacula 5.0.1 on Centos > 5.4. The backups work fine but I am trying to get the restore to work > and I keep getting the following errors: > > Volume "hardware-0014" to file:block 7:2933114700. > 10-Apr 12:51 swift-fd JobId 118: Error: restore.c:1133 Write error on > /backup0/bacula-restores/home/hardware/pdf/altera/quartus/81_linux/81_nios2eds_linux.tar: > No space left on device > > The volume is a disk drive and I am trying to restore it to a dedicated > restore directory on a different disk. I have checked the config files It looks to me like you've run out of disk space (Disk full) on your /backup0/bacula-restores disk -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TR: Getting auto-label feature to work properly
Thanks a lot Craig, for your answer.
I didn't configure a "maximum volumes" directive, so what I was expecting
Bacula to do is :
- Auto-Recycle a volume if possible, regarding retention periods.
- Automatically create a new one with auto-label feature
I there an implicit maximum volumes limit ?
-Message d'origine-
De : Craig Ringer [mailto:cr...@postnewspapers.com.au]
Envoyé : mardi 13 avril 2010 10:24
À : Dominique Jeannerod
Cc : bacula-users@lists.sourceforge.net
Objet : Re: [Bacula-users] TR: Getting auto-label feature to work properly
On 12/04/10 19:19, Dominique Jeannerod wrote:
> One up on this question please.
>
> I cant get the auto-labeling function to work as expected
Works for me on bacula 3.0.x.
> Does anyone use the same functions : backup to disk, auto-label of
> volumes, and auto-recycling ?
Yes.
> What happens now is that old volumes are recycled as they should be, but
> new volumes are not created when needed, and Im getting the famous
> message :
You've probably just set retention periods in your pools such that
bacula isn't allowed to recycle any of the used volumes, nor is it
allowed to create any new ones (due to max volumes) so it's asking you
for help. Try "list volumes" and look at the retention periods.
Remember that at any time you must have one volume free and ready for
recycling. If you have retention of 4 weeks, a schedule that runs one
job a week, and max volumes = 4 in the pool you *will* run out of
volumes, because one hasn't been purged before the next run. Set your
retention to 22 days (3*7+1) or set max volumes to 5.
Another cause for running out of volumes is when you've manually run a
job which has a pool with quite tight retention periods and max volumes
settings. The manually run job uses a volume from the pool, so later
there aren't enough free so everything grinds to a halt. Hard to say
what Bacula *should* do in this situation, but it's current approach
ain't helpful.
I really wish bacula, when it ran out of volumes, would emit a useful
message like:
"Bacula-dir: Unable to obtain volume from pool {pool-name}. No existing
volumes may be recycled due to retention rules, and max volumes =
{value} prevents automatic labeling of a new volume."
Instead, it just emails you to ask you to mount a volume, which isn't
exactly helpful.
--
Craig ringer
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TR: Getting auto-label feature to work properly
On 13/04/10 16:29, Dominique Jeannerod wrote:
> Thanks a lot Craig, for your answer.
> I didn't configure a "maximum volumes" directive, so what I was expecting
> Bacula to do is :
> - Auto-Recycle a volume if possible, regarding retention periods.
> - Automatically create a new one with auto-label feature
>
> I there an implicit maximum volumes limit ?
You know, I don't think I've ever tried using a pool without an explicit
max volumes. As far as I know there's no built-in limit.
The documentation:
http://www.bacula.org/fr/dev-manual/Automatic_Volume_Recycling.html
suggests that your pool definitions:
> Pool {
> Name = PS_Default
> Pool Type = Backup
> Recycle = yes
> AutoPrune = yes
> VolumeRetention = 3 days
> Use Volume Once = yes
> Label Format = "SYS-SD-FR-2-${C_SYS+}"
> NextPool = PS_VFull
> }
>
> Pool {
> Name = PS_VFull
> Pool Type = Backup
> Recycle = yes
> AutoPrune = yes
> VolumeRetention = 3 days
> Use Volume Once = yes
> Label Format = "SYS-VFULL-SD-FR-2-${C_SYSVFULL+}"
> Storage = fr-201-sd-vfull
> }
... should result in proper recycling.
Is the problem with a migration job? Or a regular backup job?
What does "list volumes" show?
( This sort of thing is why I *REALLY* wish Bacula would say *why* it
wanted a volume mount when it's using an auto-label pool. It's like
going next door and saying "er, can I borrow a bucket?" when what you
want to be saying is "help, help, my house is on fire!" )
--
Craig Ringer
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
On 13/04/10 05:15, Jerry Lowry wrote: > Hi, I am still tweaking a new installation of bacula 5.0.1 on Centos > 5.4. The backups work fine but I am trying to get the restore to work > and I keep getting the following errors: > > Volume "hardware-0014" tofile:block 7:2933114700. > 10-Apr 12:51 swift-fd JobId 118: Error: restore.c:1133 Write error on > /backup0/bacula-restores/home/hardware/pdf/altera/quartus/81_linux/81_nios2eds_linux.tar: > No space left on device > > The volume is a disk drive and I am trying to restore it to a dedicated > restore directory on a different disk. I have checked the config files > with an old set that I was running under 1.38 and it look very similar( > ie names of pools and disks were changed). "No space left on device" can also mean with some file systems "this file is bigger than the maximum file size permitted by this file system". Is 81_nios2eds_linux.tar bigger than 2GB? What file system is being restored onto? Are you *SURE* that /backup0/bacula-restores has the free space required (according to "df -h /backup0/bacula-restores" )? Are you restoring to the right client? -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula won't backup files with apostrophes
On 13/04/10 02:05, Mark Coolen wrote: > Hi; > I'm backing up files from a Windows share connecting with cifs (samba) > using autofs. I'm getting an error with files with apostrophes that the > files doesn't exist and it lists the file path with a ? instead of the > apostrophe. First: Perhaps it'd be easier to just run a bacula-fd on the Windows system, bypassing this issue and giving you reliable backup of files that're open or being written to during the backup (using VSS) ? If for some reason you can't do that, read on. This sounds like a character encoding problem. Are they regular ASCII apostrophes, or are they 'curly' apostrophes (proper inverted commas) ? If you create a file name with other unicode characters, is it visible or does it show up with "???" too? Try a filename like: fileåæïöû ( this email is in utf-8, so if you're using a brain-dead mail client that doesn't recognise the encoding declared in the header you might have to save it and open it as a utf-8 text file in a text editor to see the above ). or: 立法院上午 (random text from news.google.com.tw) If it turns out to be an encoding issue, you'll need to set the `iocharset' mount option for mount.cifs correctly. See "man mount.cifs" and the output of the "locale" command. If your local encoding isn't utf-8 you won't be able to reliably back up all possible files that may appear on a Windows system, as some characters on the remote system will lack local equivalents. -- Craig Ringer -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TR: Getting auto-label feature to work properly
On 12/04/10 19:19, Dominique Jeannerod wrote:
> One up on this question please.
>
> I can’t get the auto-labeling function to work as expected
Works for me on bacula 3.0.x.
> Does anyone use the same functions : backup to disk, auto-label of
> volumes, and auto-recycling ?
Yes.
> What happens now is that old volumes are recycled as they should be, but
> new volumes are not created when needed, and I’m getting the famous
> message :
You've probably just set retention periods in your pools such that
bacula isn't allowed to recycle any of the used volumes, nor is it
allowed to create any new ones (due to max volumes) so it's asking you
for help. Try "list volumes" and look at the retention periods.
Remember that at any time you must have one volume free and ready for
recycling. If you have retention of 4 weeks, a schedule that runs one
job a week, and max volumes = 4 in the pool you *will* run out of
volumes, because one hasn't been purged before the next run. Set your
retention to 22 days (3*7+1) or set max volumes to 5.
Another cause for running out of volumes is when you've manually run a
job which has a pool with quite tight retention periods and max volumes
settings. The manually run job uses a volume from the pool, so later
there aren't enough free so everything grinds to a halt. Hard to say
what Bacula *should* do in this situation, but it's current approach
ain't helpful.
I really wish bacula, when it ran out of volumes, would emit a useful
message like:
"Bacula-dir: Unable to obtain volume from pool {pool-name}. No existing
volumes may be recycled due to retention rules, and max volumes =
{value} prevents automatic labeling of a new volume."
Instead, it just emails you to ask you to mount a volume, which isn't
exactly helpful.
--
Craig ringer
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Could not create JobMedia record
I am trying to import tape data to bacula catalog using bscan: bscan b mju3-fd_MJU-TED2.bsr m n bacula u bacula -P bacula h localhost s S v /dev/st0 I got this error: bscan: bscan.c:1245 Could not create JobMedia record. ERR=sql_create.c:156 Update Media record UPDATE Media SET EndFile=167, EndBlock=27602 WHERE MediaId=0 failed: ERR= This is whole log: bacula:~ # bscan -b /root/bacula/mju1-fd_MJU-MES3.bsr -m -n bacula -u bacula -P bacula -s -S -v /dev/st0 bscan: butil.c:282 Using device: "/dev/st0" for reading. 13-Apr 08:17 bscan JobId 0: Ready to read from volume "MJU-MES3" on device "LTO3Drive" (/dev/st0). bscan: bscan.c:297 First Volume Size = 0 bscan: bscan.c:309 Using Database: bacula, User: bacula 13-Apr 08:17 bscan JobId 0: Forward spacing Volume "MJU-MES3" to file:block 0:1. bscan: bscan.c:521 SOS_LABEL: Found Job record for JobId: 375 bscan: bscan.c:689 32,768 file records. At file:blk=4:10,978 bytes=8,703,061,051 bscan: bscan.c:689 65,536 file records. At file:blk=12:10,007 bytes=24,631,024,504 bscan: bscan.c:689 98,304 file records. At file:blk=17:12,296 bytes=34,772,701,821 bscan: bscan.c:689 131,072 file records. At file:blk=41:17,177 bytes=83,059,132,886 bscan: bscan.c:689 163,840 file records. At file:blk=48:14,540 bytes=96,880,864,444 bscan: bscan.c:689 196,608 file records. At file:blk=56:19,592 bytes=113,197,106,283 bscan: bscan.c:689 229,376 file records. At file:blk=58:27,181 bytes=117,684,093,523 bscan: bscan.c:689 262,144 file records. At file:blk=62:1,354 bytes=124,014,167,373 bscan: bscan.c:689 294,912 file records. At file:blk=70:14,673 bytes=140,863,486,186 bscan: bscan.c:689 327,680 file records. At file:blk=78:10,895 bytes=156,610,411,395 bscan: bscan.c:689 360,448 file records. At file:blk=83:13,104 bytes=166,746,960,779 bscan: bscan.c:689 393,216 file records. At file:blk=86:8,809 bytes=172,466,482,115 bscan: bscan.c:689 425,984 file records. At file:blk=89:11,381 bytes=178,628,819,126 bscan: bscan.c:689 458,752 file records. At file:blk=89:18,176 bytes=179,066,906,879 bscan: bscan.c:689 491,520 file records. At file:blk=92:22,443 bytes=185,338,483,956 bscan: bscan.c:689 524,288 file records. At file:blk=94:28,568 bytes=189,731,077,990 bscan: bscan.c:689 557,056 file records. At file:blk=97:1,878 bytes=194,006,613,756 bscan: bscan.c:689 589,824 file records. At file:blk=98:24,191 bytes=197,444,114,700 bscan: bscan.c:689 622,592 file records. At file:blk=101:1,503 bytes=201,977,734,504 bscan: bscan.c:689 655,360 file records. At file:blk=103:5,551 bytes=206,236,416,311 bscan: bscan.c:689 688,128 file records. At file:blk=105:20,407 bytes=211,191,859,732 bscan: bscan.c:689 720,896 file records. At file:blk=107:11,985 bytes=214,646,482,899 bscan: bscan.c:689 753,664 file records. At file:blk=109:4,482 bytes=218,160,362,222 bscan: bscan.c:689 786,432 file records. At file:blk=111:11,846 bytes=222,632,833,079 bscan: bscan.c:689 819,200 file records. At file:blk=113:16,598 bytes=226,936,844,498 bscan: bscan.c:689 851,968 file records. At file:blk=114:30,066 bytes=229,804,061,984 bscan: bscan.c:689 884,736 file records. At file:blk=116:23,355 bytes=233,368,979,739 bscan: bscan.c:689 917,504 file records. At file:blk=118:21,228 bytes=237,229,506,388 bscan: bscan.c:689 950,272 file records. At file:blk=120:10,759 bytes=240,552,144,588 bscan: bscan.c:689 983,040 file records. At file:blk=122:7,032 bytes=244,309,483,708 bscan: bscan.c:689 1,015,808 file records. At file:blk=125:175 bytes=249,863,830,608 bscan: bscan.c:689 1,048,576 file records. At file:blk=127:3,697 bytes=254,088,554,605 bscan: bscan.c:689 1,081,344 file records. At file:blk=129:1,135 bytes=257,921,027,684 bscan: bscan.c:689 1,114,112 file records. At file:blk=131:13,974 bytes=262,746,474,845 bscan: bscan.c:689 1,146,880 file records. At file:blk=133:9,000 bytes=266,423,396,078 bscan: bscan.c:689 1,179,648 file records. At file:blk=134:26,385 bytes=269,543,135,181 bscan: bscan.c:689 1,212,416 file records. At file:blk=137:6,189 bytes=274,237,434,348 bscan: bscan.c:689 1,245,184 file records. At file:blk=140:2,814 bytes=280,016,262,795 bscan: bscan.c:689 1,277,952 file records. At file:blk=142:23,266 bytes=285,332,608,122 bscan: bscan.c:689 1,310,720 file records. At file:blk=151:193 bytes=301,834,299,444 bscan: bscan.c:689 1,343,488 file records. At file:blk=152:6,006 bytes=304,207,955,949 bscan: bscan.c:689 1,376,256 file records. At file:blk=155:2,927 bytes=310,005,898,602 bscan: bscan.c:689 1,409,024 file records. At file:blk=156:24,495 bytes=313,395,284,202 bscan: bscan.c:689 1,441,792 file records. At file:blk=157:16,031 bytes=314,848,411,398 bscan: bscan.c:689 1,474,560 file records. At file:blk=158:13,330 bytes=316,673,068,788 bscan: bscan.c:689 1,507,328 file records. At file:blk=159:10,262 bytes=318,474,063,228 bscan: bscan.c:689 1,540,096 file records. At file:blk=164:27,701 bytes=329,592,591,048 bscan: bscan.c:689 1,572,864 file records. At fil
[Bacula-users] Canceled jobs make empty record in DB
Then I cancel incorrect jobs which started but didn't finished (for example because wasn't tape in tape drive) I can see this title of these jobs in View Browser without any information. I think it's no good, because it prevent us to understanding how many real backups we have. -- View this message in context: http://old.nabble.com/Canceled-jobs-make-empty-record-in-DB-tp28219424p28219424.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
