Re: [Bacula-users] Unable to restore jobs created on one client, on another
Richard Scobie wrote: > Bacula 5.0.2 Linux. Summary: Backup of Box A was done to Storage Daemon backup1 Update slots performed after tape removal Tape was then moved to Storage Daemon flash Fatal errors when attempting to restore files and requested tape mounted: 21-Oct 12:01 library1-dir JobId 466: Start Restore Job RestoreFiles.2010-10-21_12.00.58_04 21-Oct 12:05 library1-dir JobId 466: Using Device "flash_LTO-4" 21-Oct 12:05 flash-sd JobId 466: Fatal error: No Volume names found for restore. 21-Oct 12:05 flash-fd JobId 466: Fatal error: job.c:2004 Bad response to Read Data command. Wanted 3000 OK data , got 3000 error 21-Oct 12:05 library1-dir JobId 466: Using Device "Drive-1" 21-Oct 12:05 flash-fd JobId 466: Fatal error: Failed to authenticate Storage daemon. 21-Oct 12:05 library1-dir JobId 466: Fatal error: Bad response to Storage command: wanted 2000 OK storage , got 2902 Bad storage For what it's worth, this problem still occurs after an update to 5.0.3 and a catalog restore from 2 months back. Regards, Richard -- Nokia and AT&T present the 2010 Calling All Innovators-North America contest Create new apps & games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to restore jobs created on one client, on another
Dan Langille wrote: > Instead, what you're saying is: > > - backup of Box A was done to Storage Daemon backup1 > - tape was then moved to Storage Daemon flash Yes, sorry for the confusion. > Does the Director know that the tape has moved from one system to another? Only in the sense that once the tapes were removed from backup1's autoloader, the command "update slots" was done. Is there something else that needs doing? Regards, Richard -- Nokia and AT&T present the 2010 Calling All Innovators-North America contest Create new apps & games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to restore jobs created on one client, on another
Dan Langille wrote: >> I don't understand here why it attempts to use "Drive-1", which is the >> drive on the creation host, backup1. > > My guess: because that's where the Catalog says is it? A "list media" for the Archive pool shows the "In changer" and "Slot" flag for AR0030L4 to be 0. Regards, Richard -- Nokia and AT&T present the 2010 Calling All Innovators-North America contest Create new apps & games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Unable to restore jobs created on one client, on another
Bacula 5.0.2 Linux. I have a number of Jobs, written to LTO4 tape on a host, backup1, which I am trying to restore from with the tapes loaded in a host called flash. Director is running on host library1. These restores are failing with either an error: "RestoreFiles.2010-10-21_13.54.01_08is waiting on max Storage jobs", and there are no other jobs pending, or fail completely with "Fatal Error". All bacula fds,sds and director have been restarted a number of times. Below is a typical fatal error scenario: "restore jobid="345" client="backup1-fd_arc" file="?restore_476707713_16" done 1 file selected to be restored. Bootstrap records written to /var/bacula/library1-dir.restore.1.bsr The job will require the following Volume(s) Storage(s)SD Device(s) === AR0030L4 HP_MSL2024HP_MSL2024 NOTE: HP_MSL2024 is attached to backup1 and job is modified to set flash as the restore client and storage: .mod restoreclient="flash-fd_arc" fileset="Full Set" storage="flash_LTO-4" replace="always" when="2010-10-21 12:00:30" bootstrap="/var/bacula/library1-dir.restore.1.bsr" where="/mnt/storage1/share/bacula/restores" priority="10" yes Job queued. JobId=466 NOTE: A "status" shows: Select daemon type for status (1-4): library1-dir Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 21-Oct-10 11:56, 0 Jobs run since started. Heap: heap=135,168 smbytes=85,035 max_bytes=1,096,857 bufs=360 max_bufs=365 Full Backup 1122-Oct-10 09:10 BackupCatalog Catalog2 466 RestoreFiles.2010-10-21_12.00.58_04is waiting on Storage flash_LTO-4 NOTE: the requested volume is then mounted: Select Storage resource (1-3): 3001 Mounted Volume: AR0030L4 3001 Device "flash_LTO-4" (/dev/nst0) is mounted with Volume "AR0030L4" NOTE: At this point the job fails with a fatal error. 21-Oct 12:01 library1-dir JobId 466: Start Restore Job RestoreFiles.2010-10-21_12.00.58_04 21-Oct 12:05 library1-dir JobId 466: Using Device "flash_LTO-4" 21-Oct 12:05 flash-sd JobId 466: Fatal error: No Volume names found for restore. 21-Oct 12:05 flash-fd JobId 466: Fatal error: job.c:2004 Bad response to Read Data command. Wanted 3000 OK data , got 3000 error 21-Oct 12:05 library1-dir JobId 466: Using Device "Drive-1" 21-Oct 12:05 flash-fd JobId 466: Fatal error: Failed to authenticate Storage daemon. 21-Oct 12:05 library1-dir JobId 466: Fatal error: Bad response to Storage command: wanted 2000 OK storage , got 2902 Bad storage 21-Oct 12:05 library1-dir JobId 466: Error: Bacula library1-dir 5.0.2 (28Apr10): 21-Oct-2010 12:05:07 Build OS: x86_64-unknown-linux-gnu redhat JobId: 466 Job:RestoreFiles.2010-10-21_12.00.58_04 Restore Client: flash-fd_arc Start time: 21-Oct-2010 12:01:00 End time: 21-Oct-2010 12:05:07 Files Expected: 1 Files Restored: 0 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 0 FD termination status: SD termination status: Waiting on FD Termination:*** Restore Error *** 21-Oct 12:05 library1-dir JobId 466: Error: Bacula library1-dir 5.0.2 (28Apr10): 21-Oct-2010 12:05:07 Build OS: x86_64-unknown-linux-gnu redhat JobId: 466 Job:RestoreFiles.2010-10-21_12.00.58_04 Restore Client: flash-fd_arc Start time: 21-Oct-2010 12:01:00 End time: 21-Oct-2010 12:05:07 Files Expected: 1 Files Restored: 0 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 1 FD termination status: SD termination status: Waiting on FD Termination:*** Restore Error *** I don't understand here why it attempts to use "Drive-1", which is the drive on the creation host, backup1. Am I missing something basic here? All the jobs tried restore OK on backup1, where they were created. Regards, Richard -- Nokia and AT&T present the 2010 Calling All Innovators-North America contest Create new apps & games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ideas for a backup strategy
David Noriega wrote: > Its an idea, but not what I asked. I would have gone with a completely > disked based backup, but that kind of hardware is expensive to do it > right. I asked about multiplexing. I figure I could take /home and My apologies, I distinctly thought you said "as much data as these drives can take pouring into them, since this is taking too long to do a backup". The outlined solution achieves that at a much lower cost than a completely disk based backup system. Regards, Richard -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ideas for a backup strategy
David Noriega wrote: > both drives and 2) has as much data as these drives can take pouring > into them, since this is taking too long to do a backup. I've read a One solution to feed your drives at full speed, is to build a low cost server containing an array of SATA drives, sufficient to hold all that you are backing up, and attach the library to it. Rsync the data you are backing up to it, and do your backup from this array. I have been running a setup like this to backup 11TB of uncompessible data to a single drive LTO4 library and it takes around 27 hours. This also reduces the backup performance impct on your primary storage. Regards, Richard -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger weakness
Richard Scobie wrote: > Device status: > Device "FileStorage" (/mnt/exp1/bacula) is not open. > Device "flash_LTO-4" (/dev/nst0) is mounted with: > Volume: AR0030L4 > Pool:*unknown* > Media type: LTO-4 > Total Bytes Read=2,048 Blocks Read=2 Bytes/block=1,024 > Positioned at File=0 Block=0 > > > Used Volume status: > AR0030L4 on device "flash_LTO-4" (/dev/nst0) > Reader=0 writers=0 devres=0 volinuse=0 > I'm not sure if it is related, but the above from "status all" shows AR0030L4 in Pool:*unknown*, but a "list media" clearly shows it in the "Archive" pool. Regards, Richard -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger weakness
Dan Langille wrote: >> Surely if a tape is mounted in a drive and the label is read, this >> should become the new location for this tape? > > Are you issuing a mount command after inserting the tape into the other drive? Yes and when the restore job is submitted, here are the results. Restore job, ID 400 is submitted: The job will require the following Volume(s) Storage(s)SD Device(s) === *AR0030L4 HP_MSL2024HP_MSL2024 Volumes marked with "*" are online. 22 files selected to be restored. The HP_MSL2024 is unavailable, but the tapes have been removed and AR0030L4 is mounted in an LTO4 drive on another machine: 3001 Mounted Volume: AR0030L4 3001 Device "flash_LTO-4" (/dev/nst0) is mounted with Volume "AR0030L4" At this point the job fails to proceed, with the following "status all": library1-dir Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 19-Jul-10 08:41, 62 Jobs run since started. Heap: heap=1,740,800 smbytes=110,606 max_bytes=22,074,467 bufs=385 max_bufs=677 Scheduled Jobs: Level Type Pri Scheduled Name Volume === Full Backup11 07-Sep-10 09:10BackupCatalog Catalog1 Running Jobs: Console connected at 07-Sep-10 07:07 Console connected at 07-Sep-10 07:07 Console connected at 07-Sep-10 07:12 Console connected at 07-Sep-10 07:18 JobId Level Name Status == 400 RestoreFiles.2010-09-07_07.14.43_19 is waiting on max Storage jobs Terminated Jobs: JobId LevelFiles Bytes Status FinishedName 390 Full 11.773 G OK 31-Aug-10 09:21 BackupCatalog 391 Full 11.773 G OK 01-Sep-10 09:20 BackupCatalog 392 Full 11.773 G OK 02-Sep-10 09:21 BackupCatalog 393 Full 11.773 G OK 03-Sep-10 09:21 BackupCatalog 3940 0 Error03-Sep-10 10:24 RestoreFiles 3950 0 Cancel 03-Sep-10 10:44 RestoreFiles 3960 0 Cancel 03-Sep-10 10:50 RestoreFiles 397 Full 11.773 G OK 04-Sep-10 09:20 BackupCatalog 398 Full 11.773 G OK 05-Sep-10 09:20 BackupCatalog 399 Full 11.773 G OK 06-Sep-10 09:20 BackupCatalog Connecting to Storage daemon File at backup1.sauce.co.nz:9103 backup1-sd Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 02-Sep-10 16:04, 5 Jobs run since started. Heap: heap=0 smbytes=20,130 max_bytes=156,854 bufs=79 max_bufs=109 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 Running Jobs: No Jobs running. Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 388 Full 11.773 G OK 29-Aug-10 09:21 BackupCatalog 389 Full 11.773 G OK 30-Aug-10 09:21 BackupCatalog 390 Full 11.773 G OK 31-Aug-10 09:21 BackupCatalog 391 Full 11.773 G OK 01-Sep-10 09:20 BackupCatalog 392 Full 11.773 G OK 02-Sep-10 09:21 BackupCatalog 393 Full 11.773 G OK 03-Sep-10 09:21 BackupCatalog 3940 0 Error03-Sep-10 10:24 RestoreFiles 397 Full 11.773 G OK 04-Sep-10 09:20 BackupCatalog 398 Full 11.773 G OK 05-Sep-10 09:20 BackupCatalog 399 Full 11.773 G OK 06-Sep-10 09:20 BackupCatalog Device status: Autochanger "HP_MSL2024" with devices: Drive-1 Device "FileStorage" (/mnt/storage1/bacula) is not open. Device "Drive-1" is not open or does not exist. Used Volume status: Connecting to Storage daemon flash_LTO-4 at flash.sauce.co.nz:9103 flash-sd Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 25-Jun-10 16:00, 20 Jobs run since started. Heap: heap=33,366,016 smbytes=32,983,569 max_bytes=33,591,046 bufs=691 max_bufs=1,304 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 Running Jobs: No Jobs running. Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 333 Full213,7132.750 T OK 16-Jul-10 08:49 Archive 334 Full213,7132.750 T OK 16-Jul-10 16:14 Archive-BAK 340 Full216,1432.334 T OK 21-Jul-10 11
[Bacula-users] Autochanger weakness
Unless I have missed something, it appears that if you have an autochanger full of tapes and it becomes unavailable for whatever reason - say the PSU fails, there is no way of accessing the tapes in another drive, as the system thinks are still loaded in the library and will not allow a restore when mounted in another drive, due to "update slots" not being able to be run. Surely if a tape is mounted in a drive and the label is read, this should become the new location for this tape? Regards, Richard -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Modifying tape location
I have a tape I am trying to restore from on a local LTO drive. It was created at a remote location, in a library which is no longer attached to the SD there and the "update slots" command was not done after this tape was removed, so the Director still sees the tape as residing in the remote library. How can I change this, so I can mount the tape locally and restore from it? Regards, Richard -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] new bacula installation
Jeremiah D. Jester wrote: > I'm confused. The tapeinfo output for /dev/sg1 says it is a 'Tape Drive' and > of type 'TD4' or LT04, the new supported capacity. Sg0 is the hard drive. I > get no output for devices sg3-sg10. Please explain. What is the output of: cat /proc/scsi/sg/device_strs On my sd machine with attached HP changer, I get: ATA WDC WD2002FYPS-004.0 ATA WDC WD2002FYPS-004.0 ATA WDC WD2002FYPS-004.0 ATA WDC WD2002FYPS-004.0 ATA WDC WD2002FYPS-004.0 ATA WDC WD2002FYPS-004.0 ATA WDC WD3202ABYS-002.0 ATA WDC WD3202ABYS-002.0 ATA WDC WD2002FYPS-004.0 ATA WDC WD2002FYPS-004.0 HP Ultrium 4-SCSI B56W HP MSL G3 Series 4.70 This shows the changer component is /dev/sg11. Regards, Richard -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Quantum Scalar i500 slow write speed
Paul Mather wrote: > By definition, random data are not compressible. It's my understanding that > the "compressed capacity" of tapes is based explicitly on an expected 2:1 > compression ratio for source data (and this is usually cited somewhere in the > small print). That is a reasonable estimate for text. Other data may > compress better or worse. Already-compressed or encrypted data will be > incompressible to the tape drive. In other words, "compressed capacity" is > heavily dependent on your source data. Agreed. Looking at our library of around 100 LTO4 tapes, (800GB uncompressed/1600GB uncompressed), using hardware compression, the average full tape content is about 1000GB. >90% of the content is standard and high definition video frames - largely random. However there are some tapes with over 2TB on them, containing 2 bit images where large areas of the frame are the same pixel value. Regards, Richard -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Label barcodes
John Drescher wrote: >> Also, in this scenario, are the tapes labeled in ascending slot order or >> ascending barcode order? > > The latter. Actually it is labeling them in slot order which is annoying. In future I will remember to load all the tapes with ascendinging barcode numbers in ascending slot numbers... Regards, Richard -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://ad.doubleclick.net/clk;226879339;13503038;l? http://clk.atdmt.com/CRS/go/247765532/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Label barcodes
I have just added 10 unlabeled, barcoded tape to a library that contains 10 labeled, barcoded tapes. From the bat application, I have issued the following commands: update slots label barcodes At this point the bat console shows a list of the tapes that will be labelled, but this includes the 10 tapes that already have labels. Is it really going to relabel these? Also, in this scenario, are the tapes labeled in ascending slot order or ascending barcode order? I notice that bacula chooses empty appendable tapes to write to based on the time they were labeled and I would prefer that they are used in ascending barcode order. Regards, Richard -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Extend Retention time
I have a weekly backup set which has a retention time of 13 days. I have just been asked to keep a set that was written 12 days ago. Can someone please tell me how I can extend the retention time for this job? Regards, Richard -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-4 Drive issues
skipunk wrote: > > What would it take to clear up the network bottleneck. I was looking at > another server that came with our gaming system. Same server (memory, hd, > etc) and tape library, running on win2k3 and netbackup with no issues. The > only difference is, it's running 4 nic's. So it's leaving me a bit baffled > that the only real difference is OS and 2 more nics and my system is > experiencing a bottle neck. It's probably the extra 2 NIC's that are making the difference. Unless you can keep the tape drive and I think you mentioned more than one, continuously fed with data at better than 40MB or so a second, per drive, the tape stops, backs up and starts again and this has a huge impact on throughput due to the time taken for this cycle to complete. Once any initial spool is exhausted, the drive will just stutter along in bursts. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-4 Drive issues
skipunk wrote: > > After returning to my office this morning, I had found the server was > connected to a 10/100 switch. I had moved it to the rack and connected it to > the switch 10/100/1000 and nic 1 pulls 1000 on ethtools > nic 2 pulls 100 on ethtools. > > After futher investigation, it looks like nic 2 is capped at 100 mb/s. > > Even running on 1 nic, my speeds have jumped up to a max of 8 Mb/s with an > avg of 3 - 4 Mb/s when doing backups over the net. > > A little better but not where it should be. > > I'm at a loss for the moment. I think you mentioned in a previous post that writing a local, multi GB file to the drive went at full speed, so your drive is setup OK. Given it appears that the network is the bottleneck, you will need to copy all backup data to the machine local to the drive and then backup to tape. The setup in use here rsyncs remote machines to a fast local RAID5 and then bacula is used to tape from there. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-4 Drive issues
skipunk wrote: > Status update. I just finished the first backup job which was 3.6 Gb. It > took 2.5 hours to run. avg speeds finished around 500k/s. > > I've gone as far again to reboot the library and the server and still no > changes. I'm not sure what i'm over looking. I have 1T of data to backup on > one of the servers and at this rate it will take far too long to complete. > Really pointless to even attempt. > This throughput is so low that there almost must be some hardware issue. Is your tape drive sharing the same SAS controller as other storage? In order to take full advantage of LTO4 speed, spooling of all data to a fast drive array is mandatory - backing up highly compressible data using on drive compression, the RAID array I use for spooling is feeding the drive at around 180MB/s. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] I need to buy a Tape Library
Simone Martina wrote: > Someone, from this ML, has bought a new tape library working with Linux > and mtx-changer? While not on the scale you require, I am having very good results with an HP MSL2024 with a single LTO-4 1840 drive fitted. I imagine the larger family members will be no different. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restores via bat version browser very slow.
Gary R. Schmidt wrote: > I think I'll hold off updating for a bit longer. Sigh. I have just discovered the issue of bat being unusably slow restoring on 5.0.X is known about by the developers and is being worked on. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restores via bat version browser very slow.
Gary R. Schmidt wrote: > I think I'll hold off updating for a bit longer. Sigh. Another bat bug I have just discovered going from 3.0.3 to 5.0.2, is mounting tapes in an autochanger from the command window: bat output in console pane: mount Select Storage resource (1-3): Automatically selected Catalog: MyCatalog Enter autochanger slot: 7 7: is an invalid command. Using bconsole works fine. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restores via bat version browser very slow.
I installed 3.0.3 a month or so prior to 5.0.0 being released, with a view to using bat for restores, as it made life much easier for commandline-phobes, and it performed very well. It was then updated to 5.0.1 and restores of anything more than a handfull of files became unusably slow. I noted all the discussion from others seeing similar effects which largely seemed to be caused by extra mysql indexes having been added - something I had not done. Incorrect mysql tuning was also blamed. I then saw a comment by someone who said that it was slow in bat but OK using bconsole and I have just completed the following tests: The director is on the same machine as the mysql database - a default, untuned Fedora 11 mysql 5.1.37. Using bat from a Gb connected machine to restore a tree containing 72,684 files, the progress bar on the GUI takes two minutes to complete Stage 1 -"Processing Checked Directories". Stage 2 - "Filling Database Table" takes about 80 minutes. During this mysql resource usage on the database machine is less than 1% CPU and RAM and bat resource usage is moderate. Switching to bconsole on the Gb connected machine and restoring the same job, it takes about 1 second at the "Building directory tree" stage and 0.5 second at the "72,684 files marked" stage. While I did not spend a lot of time on 3.0.3, I am quitre sure this problem was not apparent then. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume/file size and speed
Joseph Spenner wrote: > Ok, I just used bconsole and recovered a directory in little time at all. > So, bat is the problem. I can use bconsole instead. I might try to go back > to using 1TB files and see how it performs as well. > Thanks for the tip! I can confirm this and will post more fully in a new thread. Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore not loading tape
Bacula 5.0.1 and an HP MSL2024 changer. The drive is empty and the tape I wish to restore from is resident in the library. After choosing some files to restore, I get the following: restore jobid="163" client="backup1-fd_arc" file="?restore_476707713_20" done 3 files selected to be restored. Bootstrap records written to /var/bacula/library1-dir.restore.1.bsr The job will require the following Volume(s) Storage(s)SD Device(s) === *AR0011L4 HP_MSL2024HP_MSL2024 Volumes marked with "*" are online. 3 files selected to be restored. .mod restoreclient="backup1-fd_arc" fileset="Full Set" storage="HP_MSL2024" replace="never" when="2010-04-27 13:34:45" bootstrap="/var/bacula/library1-dir.restore.1.bsr" where="/mnt/storage1/bacula/restores" priority="10" yes Job queued. JobId=168 .messages 27-Apr 13:35 library1-dir JobId 168: Start Restore Job RestoreFiles.2010-04-27_13.35.35_51 After waiting 10 minutes with no sign of activity - no prompting to mount tapes, issuing "messages" showing nothing, no running jobs ahead in the queue, I then manually mount AR0011L4 and the job bursts into life and completes. Why did I need to manually mount the tape? Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Idea/suggestion for dedicated disk-based sd
Gary R. Schmidt wrote: > And using the 64-bit XFS will also better[1] than the standard 32-bit XFS. That would be using the "inode64" mount option. Regards, Richard -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Idea/suggestion for dedicated disk-based sd
Craig Ringer wrote:
> I'm interested in ext3, ext4 and xfs. I should probably look at zfs too,
> but don't have any hosts that it runs on usefully and don't really have
> any personal interest in it.
You may find the XFS mount directive, "filestreams" of benefit here.
There is not much documentation about it, but here is some tutorial
information:
"Filestreams Allocator
A certain class of applications such as those doing film scanner
video ingest will write many large files to a directory in sequence.
It's important for playback performance that these files end up
allocated next to each other on disk, since consecutive data is
retrieved optimally by hardware RAID read-ahead.
XFS's standard allocator starts out doing the right thing as far
as file allocation is concerned. Even if multiple streams are being
written simultaneously, their files will be placed separately and
contiguously on disk. The problem is that once an allocation group
fills up, a new one must be chosen and there's no longer a parent
directory in a unique AG to use as an AG "owner". Without a way
to reserve the new AG for the original directory's use, all the
files being allocated by all the streams will start getting placed
in the same AGs as each other. The result is that consecutive
frames in one directory are placed on disk with frames from other
directories interleaved between them, which is a worst-case layout
for playback performance. When reading back the frames in directory
A, hardware RAID read-ahead will cache data from frames in directory
B which is counterproductive.
Create a file system with a small AG size to demonstrate:
sles10:~ sjv: sudo mkfs.xfs -d agsize=64m /dev/sdb7 > /dev/null
sles10:~ sjv: sudo mount /dev/sdb7 /test
sles10:~ sjv: sudo chmod 777 /test
sles10:~ sjv: cd /test
sles10:/test sjv:
Create ten 10MB files concurrently in two directories:
sles10:/test sjv: mkdir a b
sles10:/test sjv: for dir in a b; do
> > for file in `seq 0 9`; do
> > xfs_mkfile 10m $dir/$file
> > done &
> > done; wait 2>/dev/null
[1] 30904
[2] 30905
sles10:/test sjv: ls -lid * */*
131 drwxr-xr-x 2 sjv users 86 2006-10-20 13:48 a
132 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/0
133 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/1
134 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/2
135 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/3
136 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/4
137 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/5
138 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/6
139 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/7
140 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/8
141 -rw--- 1 sjv users 10485760 2006-10-20 13:48 a/9
262272 drwxr-xr-x 2 sjv users 86 2006-10-20 13:48 b
262273 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/0
262274 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/1
262275 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/2
262276 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/3
262277 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/4
262278 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/5
262279 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/6
262280 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/7
262281 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/8
262282 -rw--- 1 sjv users 10485760 2006-10-20 13:48 b/9
sles10:/test sjv:
Note that all the inodes are in the same AGs as each other. What
about the file data? Use xfs_bmap -v to examine the extents:
sles10:/test sjv: for file in `seq 0 9`; do
> > bmap_a=`xfs_bmap -v a/$file | tail -1`
> > bmap_b=`xfs_bmap -v b/$file | tail -1`
> > ag_a=`echo $bmap_a | awk '{print $4}'`
> > ag_b=`echo $bmap_b | awk '{print $4}'`
> > br_a=`echo $bmap_a | awk '{printf "%-18s", $3}'`
> > br_b=`echo $bmap_b | awk '{printf "%-18s", $3}'`
> > echo a/$file: $ag_a "$br_a" b/$file: $ag_b "$br_b"
> > done
a/0: 0 96..20575 b/0: 1 131168..151647
a/1: 0 20576..41055 b/1: 1 151648..172127
a/2: 0 41056..61535 b/2: 1 172128..192607
a/3: 0 61536..82015 b/3: 1 192608..213087
a/4: 0 82016..102495 b/4: 1 213088..233567
a/5: 0 102496..122975 b/5: 1 233568..254047
a/6: 2 299600..300111 b/6: 2 262208..275007
a/7: 2 338016..338527 b/7: 2 312400..312911
a/8: 2 344672..361567 b/8: 3 393280..401983
a/9: 2 361568..382047 b/9: 3 401984..421951
sles10:/test sjv:
The middle column is the AG number and the right column is the block
range. Note how the extents for files in both directories get
placed on top of each other in AG 2.
Something to note in the results is that even though the file extents
have worked their way up into AGs 2 and 3, the inode numbers show
that the file inodes are all in the same AGs as their parent
directory, i.e. AGs 0 and 1. Why is this? To understand, it's
important to consider the order in which events are occurring. The
two bash processes writing fil
Re: [Bacula-users] Idea/suggestion for dedicated disk-based sd
Phil Stracchino wrote: >> Most practical disk backup setups will involve large RAID-5, RAID-6 or >> RAID-10 arrays. These tend to be striped across the spindles anyway, and >> the file system is rarely properly aware of how this striping occurs. > > *nod* Indeed. Nor should it care, since for general purposes, it > shouldn't matter. It's not the filesystem's problem - except of course > in advanced filesystems like ZFS where the filesystem IS the RAID > implementation. It can be of significant impact on write, as the FS can coalesce writes into stripe sized pieces, minimising read-modify-write cycle. XFS certainly and EXT4 I think, are software md RAID aware and will optimised FS creation based on number of drives and RAID level. In the case of hardware raid or stacked md, it is certainly worth working out the appropriate switch settings manually when creating the FS. Regards, Richard -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Possibility of parallelising encryption?
Craig Ringer wrote: Snip interesting crypto discussion... >> I'd use the hardware encryption (which presumably has no performance >> impact), that is an option on this autochanger, except they want $2500 >> for it... > > Probably because it has a custom ASIC for the crypto algorithm in use to > allow it to go fast enough. Well, I suspect the ASIC is already onboard - the $2500 seems to get you a couple of USB keys to enable it (HP MSL series libraries). > The trouble with this is that if your tape drive/changer dies, you > generally need another one with the same hardware crypto to restore. > This is a really, really ugly situation for disaster recovery. As long as you obtain another MSL library and use one of your original USB keys, you're back in business, but I take your point. Regards, Richard -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Possibility of parallelising encryption?
I have a 2.8GHz Core i7 machine backing up uncompressable data spooled onto an 8 drive RAID5, to LTO-4 tape. Our requirements now dictate that data encryption must be used on the tapes and having configured this, it seems that one core is saturated encrypting the data and the result is that tape write speed is now about 50% slower than when encryption is not used. Would it be possible to optimise this task by perhaps reading data in "chunks", which in turn can be encrypted by a core each, before being recombined and written out to tape? I'd use the hardware encryption (which presumably has no performance impact), that is an option on this autochanger, except they want $2500 for it... Regards, Richard -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling from barcodes ?
John Drescher wrote: > I think you can update slots with the single drive running jobs. You > can not label barcodes however. I can confirm this, as I did this a couple of days ago, although watch out for the size of the emailed job report, which for me was just under 4MB and contained thousands of an error message generated presumably while the update was occuring, but it contined on fine afterwards. Regards, Richard -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Enhancements Request
Bob Cousins wrote: > - Tape verification option -- verify that the bits read back from the > tape are the same as those originally written. Spooling to disk makes > this easier. Also, if a tape fails verification, it should be easy to > restart the write/verify cycle with new media. I used to do this, wasting time and increasing wear on my tape drive, until I discovered that LTO tape drives (hopefully other modern drives as well), read the data back as it is being written (the read head is positioned behind the write head). If an error is detected, it writes a second copy of the data. These will appear as rewrite errors in the drive error log. Regards, Richard -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cancelled job volume still showing "Full"
Alan Brown wrote: > As Timo said, in a tape, jobs may be interleaved. Because of that it's > dangerous to automatically purge one because of a job failure. That makes sense. > Note that if you delete the failed JobId from the database and that job > is the only one on the tape, it will free up for reuse almost immediately. Unfortunately two thirds of the tape contains a previous job I need to keep. Regards, Richard -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cancelled job volume still showing "Full"
Timo Neuvonen wrote: > Cancelling a job does not free the storage that the job occupied before it > was cancelled. Thanks. I guess there is a reason for this but it seems counter intuitive - I'd expect if something is cancelled, for all resources to be freed. Regards, Richard -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Cancelled job volume still showing "Full"
Is there an extra command that needs to be run, in order to free volume space after a job is cancelled? A job was started on an appendable LTO4 tape and for various reasons it was decided to cancel it after it reached the end and was requesting a new volume to be loaded. After the cancelation, the first volume is still showing as "Full", where I would have expected the space used to be the same as before the job was strated. Regards, Richard -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Write ordering?
Phil Stracchino wrote: > If that's a backup of a single host, that sounds ... bizarre. The only > explanation I can think of is that there's a directory tree sitting in > somewhere between those seven files in the directory, that contains a > vast quantity of data. If you look at your filesystem, could this be > the case? My initial post was inaccurate. I restored a single directory which contained 5 files: 4 x 67kB, 1 x 1.9GB - no directories. The report states that that 7 files were expected and 7 restored, so I guess this includes a couple of parent directories. Regards, Richard -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Write ordering?
I am just testing bacula prior to deployment and restored 7 files from one directory from a backup of 3TB. This backup is stored on 3 LTO4 volumes and in order to restore these 7 files, it read from the first and third LTO4 volumes, when I would have expected them to all be adjacent to one another. Is this a deliberate policy to spread data across tapes or a reflection of the FS layout of the data being backed up? Regards, Richard -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Conserving catalog space
Can someone please confirm or not, whether Catalog entries are duplicated when a job of type "Copy" is run, or do both the original and the copy share the same catalog data? Regards, Richard -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] bug in autolabel code in 5.0.0?
Bob Hetzel wrote: > The auto test passed, but I now cannot mount any tape from within > bacula, either completely new (i.e. unlabeled) or filled completely with > bacula backups. It always thinks the tape is not labeled, giving errors > like these: This is exactly what I was seeing and the problem was intermittent, working OK for a tape or two then erroring out. > Perhaps some part of the tape handling is broken in that kernel? Anybody > else running bacula on Ubuntu 9.10? They will need to be using an autochanger. I believe this problem is tied up with the way bacula exercises the drive and the changer, in the SCSI sense. A link in one of posts in the thread I referred you to has a comment from Kern (the author of bacula): "I should not only mention the fact that Bacula tends to expose a lot of driver bugs AND hardware problems, both of which are difficult and time consuming to debug" Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] bug in autolabel code in 5.0.0?
Bob Hetzel wrote: > My next thought was to try use "tar" to read and write from a tape. That > works fine: I've been able to back up an entire directory and restore > files from it. I've also back up a single file and restored that file, > comparing it to the original file and no differences were found. This will not be exercising the autochanger so will probably be fine. What I was wondering is if you are able to restore a bacula backup through the autochanger. > Upgrading to Ubuntu 9.10 brought along a ton of upgraded programs and > libraries so I've no idea where to begin. > > Has anybody got any other ideas? Have a look at this thread: http://marc.info/?l=bacula-users&m=126281654919968&w=2 I have just set up a system using an HP library and was seeing this error and this thread is what I found. Possibly the kernel has been updated on your system and broken things. I had to compile the latest stable to get it working. Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] bug in autolabel code in 5.0.0?
Bob Hetzel wrote: > > Has anybody gotten 5.0.0 to label tapes properly? I upgraded to 5.0.0 a > couple days ago and backups worked that first night until they ran out of > appendable (i.e. already partially written) media. Since that point, I've > been completely stuck. Is bacula the only thing you changed? Are restores from tape working OK or do you still see the ERR=Device or resource busy? Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Questions about the Scratch pool directive
Robert Hartzell wrote: > What I didnt expect to happen is that if a volume is moved from the > scratch pool to another pool and then update volume from pool is run the > RecyclePool attribute is set to *None*. That seems to contradict the > above explanation unless that is what is meant by "modify it by hand". I > would consider this a moderate to serious bug because I had to go back > and manually reset the RecyclePool attribute by hand for that volume > after updating retention times for the pool. For one volume no big > deal... had there been a hundred volumes I would have been, well > somewhat annoyed to say the least. It was set to none in my case, because I had no Recycle pool set in the Scratch pool and while setting one can fix the issue, it limits flexibility. Consider a setup with a "Full", "Diff", "Inc" and "Scratch" pools. I would want to set the recycle Pool entries on the first 3 to themselves, so they return to their own pools. The scratch pool would have no Recycle Pool. I have a large autoloader and I add a number of tapes and using "label barcodes", they are all added to the Scratch pool. From this point, each job as it runs takes a volume from the Scratch pool and it is added to the appropriate pool and I would expect the recycle pool for it to be the same as the pool it has moved to. With the current version it is "None" and I have to manually edit it. The only "Recycle Pool" entry that makes sense for the Scatch pool at this point, to prevent "None" being entered, is "Scratch", which of course means that all recycled volumes go back into the scatch pool, not their own individual ones. The only other option is to periodically check for tapes newly moved from Scratch and modify their Recycle pool entry. Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Questions about the Scratch pool directive
Robert Hartzell wrote: > I know everything can be manually changed... Just trying to get a clear > understanding of what exactly happens to a volumes attributes as bacula > moves it in and out of the scratch pool. After filing the observed behaviour of a scratch volume not inheriting the "Recycle Pool" attribute from the pool it is joining as a bug, here is the official answer: "The RecyclePool is set only on Media creation, and you can only modify it by hand after. If you create the Media in the Full pool, the RecyclePool will be set, this is not the case if you create it with your Scratch pool definition." My take on this is that it should be changed. If the Scratch pool is intended as source of volumes to be available to any pool, it should inherit all attributes of that pool upon joining it. If I see a volume is a member of "Pool X", I would expect it to behave the same way as the Pool X definition, not "Pool X except the Recycle pool may be different if this tape came from the Scratch pool". Adding a Recycle pool entry to the Scratch pool is a workaround, but is unflexible if you wish to use different recycle pool entries in different pools. Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Questions about the Scratch pool directive
Robert Hartzell wrote: > Which says to me that RecyclePool should be defined in the scratch pool > and not the Full pool. I guess this would work if you never label media as anything other than Scratch. > Does this mean that the RecyclePool attribute is > attached to the volume when it's initially created in the Scratch pool > and remains if effect throughout its lifetime? Yes, but it can be modified later. I have just used bat to update the previously mentioned volume, without impacting anything else. See "update volume" console command or bat - Media -> double click on volume -> "Edit" button at top. Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Questions about the Scratch pool directive
Richard Scobie wrote: > Robert Hartzell wrote: > >> hmmm... looks like I need to do some testing. Do you have any volumes >> that have been recycled and moved back to the scratch pool? >> > > Yes. A tape that was initially labeled in the "Full" pool has been > recycled back into Scratch and is showing "Scratch" as its recycle pool. > > I think this is not a bug - I have just checked my Scratch pool > definition and I do not have a RecyclePool defined in it. Thinking about this some more, it probably is a bug. If a volume is taken from the Scratch pool to join another pool, it must inherit all the characteristics of that pools definition. Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Questions about the Scratch pool directive
Robert Hartzell wrote: > hmmm... looks like I need to do some testing. Do you have any volumes > that have been recycled and moved back to the scratch pool? > Yes. A tape that was initially labeled in the "Full" pool has been recycled back into Scratch and is showing "Scratch" as its recycle pool. I think this is not a bug - I have just checked my Scratch pool definition and I do not have a RecyclePool defined in it. So updating the existing Scratch volumes should sort this out. Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Questions about the Scratch pool directive
Robert Hartzell wrote: > It would seem reasonable (to me anyways) that the attributes would be > updated to reflect the current pool. There isn't much in the way of > documentation regarding this feature so hopefully someone can verify one > way or the other and I dont have to set up a test to find out. Sort of - a job running yesterday pulled 3 tapes from the "Scratch" pool into "Full" and while the retention time has been modified to the same as the Full pool, the "Recycle Pool" shows "None", not "Scratch" which is set in the "Full" pool definition. Perhaps this is a bug? Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Character Substitution
ganiuszka wrote: > In "Client Run After Job" directive "%v" will not be replaced because it > can be replaced only on Director side. > So if you has: > > Client Run After Job = "/path/script.sh %i %v" > > than > > %v will be empty. OK thanks. I actually have the "%i_%v" inside the shell script, so along with the reason above, it probably explains why %i is not being substituted either. Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Character Substitution
I have a "Client Run After Job" which runs a bash script which ends up writing a file on the client, "%i_%v.txt" It all works except the substitution is not occuring and it is literally writing the file %i_%v.txt. Is this expected? Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with bat 5.0.0, not seeing console output
John Drescher wrote: > I believe other users mentioned that restarting bat fixed the issue. > And the issue only occurred on the first run of bat. I have to date been unable to see the console on one bat install and have a bug open: http://bugs.bacula.org/view.php?id=1468 (username/password anonymous if you don't have an account) Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bat 5.0.0 not showing Console
Marc Schiffbauer wrote: > Yes, I saw this here, too. Then on another startup of bat, it worked > properly. > > So now, If that happens, I close bat and start it again until the > console is there... > > Using QT4.6.1 here. Still looking into it here. One machine with qt-4.5.3-9.fc11.i586 never shows the console and one with qt-4.3.4 works fine... Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bat 5.0.0 not showing Console
Have just updated all components to 5.0.0 and a remote bat connection does not display the console window - it just stays on the last selected page. When starting bat, it just goes up with a blank page, but all other pages display correctly. Anyone else seeing this? Regards, Richard -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Cloned Jobs
I note that it is possible to run clone jobs by using "Run = in the Job resource. What I would like to do is make 2 tapes (Volumes) that are exact copies, but with only one catalog entry, used if either tape is restored. 1. Does cloning acheive this? 2. Can cloning be performed on a single drive? The doc is a little unclear, stating: "By using the cloning keywords (see below), you can backup the same data (or almost the same data) to two or more drives at the same time." Then further down stating: "Please note that all cloned jobs, as specified in the Run directives are submitted for running before the original job is run (while it is being initialized). This means that any clone job will actually start before the original job, and may even block the original job from starting until the original job finishes unless you allow multiple simultaneous jobs. Even if you set a lower priority on the clone job, if no other jobs are running, it will start before the original job." The implication here is that the clone would run first on one volume and the tape could be changed to run the original job. Regards, Richard -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula hangs "waiting for execution"...
Daniel wrote: > Hello, > > I am having a problem where all jobs but the first immediately after starting > bacula-dir hang "waiting for execution.". I have no further information on > why they are waiting, nor what they are waiting on. They have waited nearly > a week. All jobs I queue after them even ones with the same or higher > priority do not run either. This sounds like the bug that has been discussed a few times over the last month. Do you have a correctly configured/running smtp server running on the box? If not, this causes what you are seeing. Otherwise disable sending of mail from bacula. Regards, Richard -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't find the tape changer
Dan Langille wrote:
> Fusion MPT SPI Host driver 3.12.19.00rh
> ACPI: PCI Interrupt :11:08.0[A] -> GSI 16 (level, low) -> IRQ 169
> mptbase: Initiating ioc0 bringup
> ioc0: 53C1030: Capabilities={Initiator,Target}
> scsi2 : ioc0: LSI53C1030, FwRev=01032700h, Ports=1, MaxQ=255, IRQ=169
> Vendor: IBM Model: ULTRIUM-TD3 Rev: 6B20
> Type: Sequential-Access ANSI SCSI revision: 03
> Vendor: DELL Model: PV-124T Rev: 0043
> Type: Medium Changer ANSI SCSI revision: 02
> st: Version 20040403, fixed bufsize 32768, s/g segs 256
> Attached scsi tape st0 at scsi2, channel 0, id 6, lun 0
No, it's not attached to to a PERC, but it still could be a RAID controller.
The LSI 53C1030 is a dual channel Ultra 320 controller chip and as such
cold be used as a straight controller, (my system is using an 53C1020 -
single channel version without problem.
However, there are RAID controller products using the 53C1030:
so you will need to check.
Regards,
Richard
--
Throughout its 18-year history, RSA Conference consistently attracts the
world's best and brightest in the field, creating opportunities for Conference
attendees to learn about information security's most important issues through
interactions with peers, luminaries and emerging and established companies.
http://p.sf.net/sfu/rsaconf-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't find the tape changer
Dan Langille wrote: > ganiuszka wrote: >> Here is a instruction about Dell PowerVault 124T and LUNs under Linux. >> >> http://support.dell.com/support/edocs/stor-sys/124t/en/124tvs16/install.html#enabling_lun_linux >> >> Subject "Enabling LUN Support in Linux" >> >> Maybe this is the solution. > > This is what I see now (output slightly altered to make it easier to read): > > # cat /proc/scsi/scsi > Attached devices: > Host: scsi0 Channel: 00 Id: 08 Lun: 00 > Vendor: DP Model: BACKPLANERev: 1.05 > Type: EnclosureANSI SCSI revision: 05 > > Host: scsi0 Channel: 02 Id: 00 Lun: 00 > Vendor: DELL Model: PERC 5/i Rev: 1.03 > Type: Direct-AccessANSI SCSI revision: 05 > > Host: scsi1 Channel: 00 Id: 17 Lun: 00 > Vendor: DELL Model: MD1000 Rev: A.03 > Type: EnclosureANSI SCSI revision: 05 > > Host: scsi1 Channel: 02 Id: 00 Lun: 00 > Vendor: DELL Model: PERC 5/E Adapter Rev: 1.03 > Type: Direct-AccessANSI SCSI revision: 05 > > Host: scsi1 Channel: 02 Id: 01 Lun: 00 > Vendor: DELL Model: PERC 5/E Adapter Rev: 1.03 > Type: Direct-AccessANSI SCSI revision: 05 > > > ## pretty sure this is the tape drive > > Host: scsi2 Channel: 00 Id: 06 Lun: 00 > Vendor: IBM Model: ULTRIUM-TD3 Rev: 6B20 > Type: Sequential-AccessANSI SCSI revision: 03 > > > ## and that this is the tape changer > > Host: scsi2 Channel: 00 Id: 06 Lun: 01 > Vendor: DELL Model: PV-124T Rev: 0043 > Type: Medium Changer ANSI SCSI revision: 02 Dan, is the changer attached to one of the PERC controllers (which I believe are RAID controllers)? If so, the note in the above mentioned Dell doc (SCSI Bus Requirements) may be the answer: "NOTE: The autoloader may not work with multiple SCSI LUNS when attached to a redundant array of independent disks (RAID) controller. The autoloader is not recommended for use with a RAID controller. If this problem occurs, it is recommended that the autoloader be attached to a separate SCSI bus controller on the server." " -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
Richard Scobie wrote: > Thanks for the followup, but after finding the thread referenced below > yesterday, I switch the SCSI HBA and library into another box (different > motherboard) and it is humming along fine using the same config files. > > Granted this box is running Fedora 8, not Fedora 11 as the previous box > was, but I'll have a better idea if it is the hardware when I connect it > to the production server which is also running Fedora 11. > > Thanks all for the assistence - see Kern's comments here: > > http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg12861.html Just a follow up on this for the archives. Story to this point: HP MSL2024 autochanger on HP parallel SCSI HBA was failing with drive error, "ERR=Device or resource busy.", when installed on Fedora 11 Core2 Duo based machine. Switched HBA and library to a Fedora 8 Core i7 box and all went well - same Bacula version and configs. Moved HBA and library to final production box - Fedora 11 Core i7 and the same problem re-occured. Replacing the Fedora kernel 2.6.30.8-64.fc11.x86_64 with a stock 2.6.32.3 has fixed it. I did not have time to work out exactly where in the kernel the problem lies. Regards, Richard -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't find the tape changer
Dan Langille wrote:
> Dan Langille wrote:
>
>>I'm helping a client with a Linux system. I see the tape drive, but
>>cannot find the tape changer. Clues please.
>>
>> From dmesg:
>
>
> Also:
>
> Linux version 2.6.9-78.0.8.plus.c4smp (mockbu...@builder10.centos.org)
> (gcc version 3.4.6 20060404 (Red Hat 3.4.6-10)) #1 SMP Thu Nov 27
> 19:19:34 EST 2008
>
> And there is no /dev/changer*
/dev/sg6 should be it from what you have shown.
I have an HP attached here:
Host: scsi10 Channel: 00 Id: 04 Lun: 00
Vendor: HP Model: Ultrium 4-SCSI Rev: B56W
Type: Sequential-AccessANSI SCSI revision: 05
Host: scsi10 Channel: 00 Id: 04 Lun: 01
Vendor: HP Model: MSL G3 SeriesRev: 4.70
Type: Medium Changer ANSI SCSI revision: 05
ioc0: LSI53C1020A A1: Capabilities={Initiator,Target}
alloc irq_desc for 37 on node -1
alloc kstat_irqs on node -1
mptspi :03:08.0: irq 37 for MSI/MSI-X
mptbase: ioc0: PCI-MSI enabled
scsi10 : ioc0: LSI53C1020A A1, FwRev=01032700h, Ports=1, MaxQ=255, IRQ=37
ALSA sound/pci/hda/hda_intel.c:698: azx_get_response timeout, switching
to polling mode: last cmd=0x002f0d00
scsi: waiting for bus probes to complete ...
scsi 10:0:4:0: Sequential-Access HP Ultrium 4-SCSI B56W PQ: 0
ANSI: 5
scsi target10:0:4: Beginning Domain Validation
scsi target10:0:4: Ending Domain Validation
scsi target10:0:4: FAST-160 WIDE SCSI 320.0 MB/s DT IU RTI PCOMP (6.25
ns, offset 64)
scsi 10:0:4:1: Medium ChangerHP MSL G3 Series4.70 PQ: 0
ANSI: 5
scsi 10:0:4:0: Attached scsi generic sg10 type 1
scsi 10:0:4:1: Attached scsi generic sg11 type 8
SCSI Media Changer driver v0.25
ch0: type #1 (mt): 0x0+1 [medium transport]
ch0: type #2 (st): 0x3e9+24 [storage]
ch0: type #3 (ie): 0x0+0 [import/export]
ch0: type #4 (dt): 0x1+1 [data transfer]
st: Version 20081215, fixed bufsize 32768, s/g segs 256
ch0: dt 0x1: ID 4, LUN 0, name: HP Ultrium 4-SCSI B56W
ch0: INITIALIZE ELEMENT STATUS, may take some time ...
Drive is /dev/nst0 and changer is /dev/sg11.
Regards,
Richard
--
Throughout its 18-year history, RSA Conference consistently attracts the
world's best and brightest in the field, creating opportunities for Conference
attendees to learn about information security's most important issues through
interactions with peers, luminaries and emerging and established companies.
http://p.sf.net/sfu/rsaconf-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
Brian Debelius wrote: > > Humor me if you will. Go back to default. Make sure your tape drive is > set to variable blocks using mt -f /dev/nst0 setblk 0, then load a tape, > and use tapeinfo -f /dev/nst0 to verify it is set to zero. Now comment > out the Maximum Block Size from the sd. Test it with btape. Rewind it > with mt, weof with mt, rewind it with mt. Start the SD. Label your tape > in bconsole. Thanks for the followup, but after finding the thread referenced below yesterday, I switch the SCSI HBA and library into another box (different motherboard) and it is humming along fine using the same config files. Granted this box is running Fedora 8, not Fedora 11 as the previous box was, but I'll have a better idea if it is the hardware when I connect it to the production server which is also running Fedora 11. Thanks all for the assistence - see Kern's comments here: http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg12861.html Regards, Richard -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
John Drescher wrote: > Have you tried to stop bacula-sd and then execute the mtx-changer > script directly from the shell? You will probably have to look at the > code for the parameters. Hi John, Yes, I have successfully been able to do this a number of times and also run through the "btape test" including the "auto" test without problem. I have beeen able to dd directly to the tape also. Loading 12 tapes and running "label barcodes", it has successfully labeled the first 3 or 4 and then failed with the "ERR=Device or resource busy" on all the rest. So something is inconsistent somewhere. Unfortunately I cannot run the HP LTT test utility as it is not compatible with Fedora 11. Regards, Richard -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
Brian Debelius wrote:
> Try turning on debug in mtx-changer. Modify the wait_for_drive()
> function to add another debug statement to confirm that the device is
> ready, and that the function did not just time out.
>
> wait_for_drive() {
> i=0
> while [ $i -le 300 ]; do # Wait max 300 seconds
> if mt -f $1 status 2>&1 | grep "${ready}" >/dev/null 2>&1; then
> -->> debug "Device $1 - READY!"
> break
> fi
> debug "Device $1 - not ready, retrying..."
> sleep 1
> i=`expr $i + 1`
> done
> }
Thanks Brian, I added this and it seems to indicate things are working
OK without adding any sleep, so I need to keep looking.
The following is the sequence as I attempt to label a tape after having
deleted the Volume record, manually rewound the tape and done an "mt -f
/dev/nst0 weof" and placed it back in Slot 1.
Start bacula.
Do a "status" on the SD:
Device status:
Autochanger "HP_MSL2024" with devices:
"Drive-1" (/dev/nst0)
Device "Drive-1" (/dev/nst0) is not open.
Drive 0 status unknown.
Do an "automount off"
Do a "label":
Connecting to Storage daemon HP_MSL2024 at library1.sauce.co.nz:9103 ...
Sending label command for Volume "GQJ800L4" Slot 1 ...
3301 Issuing autochanger "loaded? drive 0" command.
3302 Autochanger "loaded? drive 0", result: nothing loaded.
3304 Issuing autochanger "load slot 1, drive 0" command.
3305 Autochanger "load slot 1, drive 0", status is OK.
block.c:1010 Read error on fd=5 at file:blk 0:0 on device "Drive-1"
(/dev/nst0). ERR=Device or resource busy.
3000 OK label. VolBytes=1024 DVD=0 Volume="GQJ800L4" Device="Drive-1"
(/dev/nst0)
Catalog record for Volume "GQJ800L4", Slot 1 successfully created.
Do not forget to mount the drive!!!
Tailing the mtx.log showed the "Device /dev/nst0 - READY!" up at the
same time as "3305" above then there was a pause of a few seconds,
presumably as the tape threads up and then the "Read error"
At this point another "status" on the SD:
Device status:
Autochanger "HP_MSL2024" with devices:
"Drive-1" (/dev/nst0)
Device "Drive-1" (/dev/nst0) is not open.
Slot 1 is loaded in drive 0.
I run "mt -f /dev/nst0 status" at this point with bacula still running:
SCSI 2 tape drive:
File number=1, block number=0, partition=0.
Tape block size 0 bytes. Density code 0x46 (LTO-4).
Soft error count since last status=0
General status bits on (8101):
EOF ONLINE IM_REP_EN
Do a "mount" and after about 20 seconds:
block.c:1010 Read error on fd=5 at file:blk 0:0 on device "Drive-1"
(/dev/nst0). ERR=Device or resource busy.
3902 Cannot mount Volume on Storage Device "Drive-1" (/dev/nst0) because:
Requested Volume "" on "Drive-1" (/dev/nst0) is not a Bacula labeled
Volume, because: ERR=block.c:1010 Read error on fd=5 at file:blk 0:0 on
device "Drive-1" (/dev/nst0). ERR=Device or resource busy.
3905 Device "Drive-1" (/dev/nst0) open but no Bacula volume is mounted.
If this is not a blank tape, try unmounting and remounting the Volume.
Do a "status" on SD:
Device status:
Autochanger "HP_MSL2024" with devices:
"Drive-1" (/dev/nst0)
Device "Drive-1" (/dev/nst0) open but no Bacula volume is currently mounted.
Slot 1 is loaded in drive 0.
Total Bytes Read=0 Blocks Read=0 Bytes/block=0
Positioned at File=0 Block=0
Do an "mt -f /dev/nst0 status":
/dev/nst0: Device or resource busy
Which is fair, as bacula now has the device open.
So I really do not know what the drive's problem is during the "label" -
why is it busy?
Regards,
Richard
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
ext-daniel.haw...@nokia.com wrote: > Hi Richard, > >> >> Anyone else running this library I can compare notes with? >> > > Not anymore :) Used to use an SAS LTO3 based MSL2024 on a project I worked > at a while back. TBH it *just worked* and worked well too. Would recommend > one to anyone that needed an autochanger of this size. Was quick and worked. > What more do you need :) > > Have attached the salient directives from my notes below, hope they're of > use. Was using a relatively old Bacula version back then (not sure which > maybe 1.38 or early v2), but the important bits haven't changed much, so > should be valid. Have also added the mtx-changer I was using. Can't recall if > I changed this from the default shipped one either, but... Thanks Dan. I found a couple of others running the same library, drive and SCSI card as I am who said the same as you - it just worked. So I'm thinking I may have a hardware issue or kernel/mtx issues (am running Fedora 11 2.6.30.10-105.fc11.x86_64 and mtx-1.3.12-3.fc11.x86_64). Regards, Richard -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
Richard Scobie wrote: > >> >> You probably need to add a wait in the mtx-changer script just after >> the load. This wait will make sure the tape is in the drive and has >> completed the loading process. For some systems the script does not >> wait long enough for the tape drive to finish. >> >> John > > Thanks John. I already have a 30 second wait in there but will try > extending it further. > > I have also run the "sleep test" script from the manual and it runs it OK. And increasing this to 60 seconds has not improved things. Anyone else running this library I can compare notes with? Regards, Richard -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
> > You probably need to add a wait in the mtx-changer script just after > the load. This wait will make sure the tape is in the drive and has > completed the loading process. For some systems the script does not > wait long enough for the tape drive to finish. > > John Thanks John. I already have a 30 second wait in there but will try extending it further. I have also run the "sleep test" script from the manual and it runs it OK. Regards, Richard -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."
I have an MSL2024 library I have been battling to get running for the
last couple of days and am about out of ideas. It is the parallel SCSI
attached LTO-4 version, connected to an HP LSI based HBA.
I have bacula configured and it passes the mtx-changer test commands
recommended in the manual and also passes all the "btape test" tests,
including the "auto test".
However, operationally after starting out, something appears to not
release /dev/nst0 and everything fails beyond this point.
Below is an example where from bconsole I issued "automount off" then
the "label" command:
Connecting to Storage daemon HP_MSL2024 at library1.sauce.co.nz:9103 ...
Sending label command for Volume "GQJ800L4" Slot 1 ...
3301 Issuing autochanger "loaded? drive 0" command.
3302 Autochanger "loaded? drive 0", result: nothing loaded.
3304 Issuing autochanger "load slot 1, drive 0" command.
3305 Autochanger "load slot 1, drive 0", status is OK.
block.c:1010 Read error on fd=5 at file:blk 0:0 on device "Drive-1"
(/dev/nst0). ERR=Device or resource busy.
3000 OK label. VolBytes=1024 DVD=0 Volume="GQJ800L4" Device="Drive-1"
(/dev/nst0)
Catalog record for Volume "GQJ800L4", Slot 1 successfully created.
Do not forget to mount the drive!!!
Another example, after resetting everything, loading 12 blank tapes and
issuing "label barcodes", it labelled the first 2 tapes OK, then every
subsequent one included the error:
block.c:1010 Read error on fd=5 at file:blk 0:0 on device "Drive-1"
(/dev/nst0). ERR=Device or resource busy.
I am almost sure it is not a bacula issue as I have just stopped bacula
and run btape:
btape -c bacula-sd.conf /dev/nst0
Tape block granularity is 1024 bytes.
btape: butil.c:285 Using device: "/dev/nst0" for writing.
07-Jan 10:03 btape JobId 0: 3301 Issuing autochanger "loaded? drive 0"
command.
07-Jan 10:03 btape JobId 0: 3302 Autochanger "loaded? drive 0", result
is Slot 1.
btape: btape.c:383 open device "Drive-1" (/dev/nst0): OK
*readlabel
07-Jan 10:03 btape JobId 0: Error: block.c:1010 Read error on fd=3 at
file:blk 0:0 on device "Drive-1" (/dev/nst0). ERR=Device or resource busy.
btape: btape.c:432 Volume has no label.
Volume Label:
Id: **error**VerNo : 0
VolName :
PrevVolName :
VolFile : 0
LabelType : Unknown 0
LabelSize : 0
PoolName :
MediaType :
PoolType :
HostName :
Date label written: -4712-01-01 at 00:00
Here is the relevant director conf entry:
# Definition of tape storage device
Storage {
Name = HP_MSL2024
Address = library1.sauce.co.nz
SDPort = 9103
Password = "deliberately munged" # password for Storage daemon
Device = HP_MSL2024 # must be same as Device in
Storage daemon
Media Type = LTO-4 # must be same as MediaType in
Storage daemon
Autochanger = yes # enable for autochanger device
}
Storage daemon conf:
Autochanger {
Name = HP_MSL2024
Device = Drive-1
Changer Command = "/etc/bacula/mtx-changer %c %o %S %a %d"
Changer Device = /dev/sg9
}
Device {
Name = Drive-1
Drive Index = 0
Media Type = LTO-4
Archive Device = /dev/nst0
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Maximum block size = 262144
Maximum File Size = 5GB
AutoChanger = yes
Alert Command = "sh -c 'smartctl -H -l error %c'"
}
The library itself is configured "automatic, random" (the default) and I
have also tried Manual, random.
Any help much appreciated.
Regards,
Richard
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO3 tape capacity lower than expected
Brian Debelius wrote: > That would be 16M. Isn't the SD hard limited to 1M? > "The maximun size-in-bytes possible is 2,000,000" From the SD Configuration Maximum block size directive. Regards, Richard -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-3 getting the lead out.
Brian Debelius wrote: > Shamless bump. Does anyone have any insight into this? > > Thanks > brian- The difference between the dd tests and bacula backups is that catalog writes are occuring in the latter. Perhaps you have a database bottleneck? Is the database stored on the RAID also? Regards, Richard -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi Volume Archives
Bob Hetzel wrote: > 1) Bacula is indeed able to seek within a tape. If you're having trouble > with this functionality you need to look at the storage daemon options at Thanks Bob, I had misinterpreted something I read earlier. > > 2) If you pick a file that's on one of the other 9 tapes in your example it > should be fine. The big problem will be if you need files on that bad > tape. In that case you won't be able to get it. So here's an example... > Day one, full backup winds up using 9 full tapes and part of a 10th tape. > Day two, that 10th tape is appended to, but then breaks. In this case, > you'll probably be able to restore anything except the files on that last > tape. I believe bacula restores the files in the order they were written, > so any kind of restore you do that invovles tape 9 and tape 10 will get all > the tape 9 stuff just fine but then you'll need to cancel it because you > won't be able to give it tape 10. However, the tape 9 files will already > be written and canceling the restore does not delete them. Continuing the above example, if tape 6 was damaged, I'd be able to recover tapes 7 to 10? Also my original intent in posing the "10 LTO4 tape" example, was whether or not Bacula needed to read all previous tapes in a multi archive set, in order to restore files residing on a given tape. It would appear that this is not the case and it would go directly to the tape the files are stored on. Regards, Richard -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multi Volume Archives
If a tape is damaged in a multi volume archive, is it possible to recover all the data from the rest of the set? I understand Bacula is not currently able to seek within a tape in order to recover a file - the tape must be read sequentially. In a multi volume archive, does it need to read through all 10 LTO4 tapes in order to recover files from the 10th tape? Regards, Richard -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
