Re: [Bacula-users] Configuring Director Storage on different nodes
Thanks everyone for the response help. I found a bug in my file daemons config file. Tweaked it it worked :) ~Amit From: amitpard...@hotmail.com To: chandran...@gmail.com Date: Wed, 6 May 2009 17:15:04 + CC: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Configuring Director Storage on different nodes Please find my conf. files attached along with this mail. Thanks, Amit Date: Wed, 6 May 2009 18:08:23 +0530 Subject: Re: [Bacula-users] Configuring Director Storage on different nodes From: chandran...@gmail.com To: amitpard...@hotmail.com CC: bacula-users@lists.sourceforge.net Could you please post the config files of the director, fd and sd? About the performance, I did a benchmark on CentOS 5.0 a few days back and things were not much different as long as fd and sd were on different machines. Though my data size reflected my typical use case of backing up about 10G of data. Regards Chandranshu 2009/5/6 Amitsingh Pardesi amitpard...@hotmail.com Hi, I want to configure Director Storage daemon of Bacula System 3.0.0 on two different nodes (same Linux flavor, CentOS 5.2 to be precise). I have tried with both Director Storage on same machine. It works fine. Now I want to move the storage daemon away from the Director. Is it possible to get the same performance or are there any problems (not documented) that could occur. I have tried to configure it following the steps specified in the Users guide. I am able to fetch the status of each storage daemon. But am not able to start any job. While starting the job, it fails to connect to Storage Daemon hence could not get the volume details. When checked the staus of the storage daemon, its status is OK. Could some one please help me in configuring this scenario or give me any pointer to look at. Thanks, PassionateDeveloper Get easy photo sharing with Windows Live™ Photos. Drag n’ drop -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users Get easy photo sharing with Windows Live™ Photos. Drag n’ drop _ Drag n’ drop—Get easy photo sharing with Windows Live™ Photos. http://www.microsoft.com/india/windows/windowslive/photos.aspx-- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup plan for critique
2009/5/4 Zhengquan Zhang zhang.zhengq...@gmail.com Hello bacula community, I am a newbie to bacula and backup but I have decided to use it for our backup scheme:) we will backup two servers to a backup server. I have got a few questions that I have not figured out the answer. 1.why does bacula use db as backend? why add additional this level of complexity to the backup? This is not something you have to know about to be able to use Bacula. The database is used to store all information about the backups which have been made including all files and their metadata. A database is the most efficient way to store that data. For small installations a sqlite database is sufficient which hardly needs any setup. Read the documentation about it. 2. the folders I would like to backup are monk /home 79G /etc /srv/bitten 2G /srv/www 23G /srv/pub 32G /srv/svnrepos 2G /srv/trac 1.5G /var 2G total 160G ccl /home 19G // everyone's public_html and .maildir directory /home/httpd 43G /etc /usr1 83G //including mailman and postgresql database /var 8G /Public 115G /usr/local/cvsroot 3G total 200G I have got two 1T drive for raid1. so I have 1T space. considering the size of my drive, what would be a reasonable back scheme? How frequently should I do the full backup and how frequently should I do the incremental backup? The backup strategy depends on the importance of the data or certain parts of the data, the way the data is used (does it change a lot, how important are those changes, etc) and more things. Your collection of personal photo's need a different backup strategy than bank records or configuration settings etc. What you can do is determine is what it would cost you if you lost x amount of hours or days of data and compare that to what it would cost to back that up every x amount of hours/days. Also, how long would you like to keep backups of the data. Every month for the last year? Every year for 5 years? I for example create a full backup every month and keep the last 6 months, and I create a incremental backup every day for which I keep the last 35 or so. In short, there's no best backup strategy which works for everyone. You need to take a look at your specific situation and see what's best for you. Concidering you have 360G of data, 1T of backup is not that much. It will just fit 2 full backups and some incrementals and/or differentials. I would certainly get some more space for the backup. With the current price of a 1Tb hardisk, avbailable space should not be a limitting factor in determining your backup strategy. 3. How large would the db grow if for example I do a full backup of the above contents? Does bacula compress the contents? Compared to the data being backed up, the size of the database isn't that large. The data itsself can be compressed. How bacula stores the db contents depends on the database used (sqlite, mysql or postgres) and it isn't that important when initially setting up the backup because of the relatively small size. Thanks for any suggestions and I am open to reading documents. Reading is good :) -- Zhengquan I hope this helps a bit, Cheers, Maarten -- Register Now Save for Velocity, the Web Performance Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuring Director Storage on different nodes
James Harper wrote: Hi, I want to configure Director Storage daemon of Bacula System 3.0.0 on two different nodes (same Linux flavor, CentOS 5.2 to be precise). Performance should be the same. I do it on a Xen system where the sd is on Dom0 for performance reasons, but the director and the catalog is on a DomU for better flexibility (eg snapshot to test an upgrade etc). Just curious. What performance problems keep you from running SD in a domU? I have been experimenting with running SD in a PV domU, but haven't decided if it makes sense. Not for performance reasons, but because I have the daemons on a 2-node cluster using heartbeat for failover. For Dir it works great. For SD, there are issues. SD auto fails over and maintains the same IP, etc. The primary issue is that failover still causes a running backup job to fail because the SD-FD TCP session is broken and the daemons don't attempt to reconnect. Also, after failing because the TCP session is broken, there is no way currently to re-run failed jobs. I expect future versions of Bacula will address those two issues, and Xen 3.4 brings virtual SCSI and SATA devices to domUs. It will be very convenient to run SD in a domU, even given the problem that the backup device(s) can only be attached to one dom0 at a time and may have to be manually moved. When I first set it up, there wasn't the ability to pass through a SCSI tape drive from Dom0 to DomU so it just plain wouldn't work anyway. If your SD is on DomU, then fd-sd data from an external machine has to: . be received in the Dom0 physical interface . go onto the Dom0 bridge . go onto the Dom0 network backend device for the DomU . go onto the DomU network frontend device . be processed by the sd . go onto the DomU scsi frontend device . go onto the Dom0 scsi backend device . go to the Dom0 physical scsi device Where as if it's on the Dom0, the data only has to: . be received in the Dom0 physcial interface . go onto the Dom0 bridge . be processed by the sd . go to the Dom0 physcial scsi device I have never measured the impact, but there will be one and my guess is that it won't be insignificant. I'll defer to anyone who has actually measured it though :) James -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] (no subject)
Hi, Is it possible to install only 'bextract' on a node? I have couple of Volumes created through Bacula. The Director Storage daemons are down out. What I am left with is only the volumes created during backup. Can I restore the data from these volumes using 'bextract'? I don't have any machine with Bacula Director installed. Also I could not find a way to install only 'bextract' on the required machine to restore from the available Volumes. Please let me know if it is possible to do so. ~PassionateDeveloper _ Live Search extreme As India feels the heat of poll season, get all the info you need on the MSN News Aggregator http://news.in.msn.com/National/indiaelections2009/aggregator/default.aspx-- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Installing only 'bextract' on a machine.
Hi, Is it possible to install only 'bextract' on a node? I have couple of Volumes created through Bacula. The Director Storage daemons are down out. What I am left with is only the volumes created during backup. Can I restore the data from these volumes using 'bextract'? I don't have any machine with Bacula Director installed. Also I could not find a way to install only 'bextract' on the required machine to restore from the available Volumes. Please let me know if it is possible to do so. ~PassionateDeveloper _ Planning the weekend ? Here’s what is happening in your town. http://msn.asklaila.com/events/-- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Unwarranted promotion to full
With Bacula 2.4.4, adding an exclusion to a file set causes an incremental backup to be promoted to full. Is this kind of thing fixed in 3.x? -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unwarranted promotion to full
On Thu, May 07, 2009 at 05:18:45AM -0400, Mike Ruskai wrote: With Bacula 2.4.4, adding an exclusion to a file set causes an incremental backup to be promoted to full. Is this kind of thing fixed in 3.x? Do you know about the 'Ignore FileSet Changes' option? -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unwarranted promotion to full
On 05/07/2009 05:38, Graham Keeling wrote: On Thu, May 07, 2009 at 05:18:45AM -0400, Mike Ruskai wrote: With Bacula 2.4.4, adding an exclusion to a file set causes an incremental backup to be promoted to full. Is this kind of thing fixed in 3.x? Do you know about the 'Ignore FileSet Changes' option? I do now, thanks. Of course, I don't know if it actually works. After cancelling the superfluous full backup and adding that directive, Bacula still insists on doing a full backup. This despite the fact that there are two valid full backups in the catalog still. -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Installing only 'bextract' on a machine.
Hello, 07.05.2009 09:53, Passionate Developer wrote: Hi, Is it possible to install only 'bextract' on a node? The easiest way might be to install from a package suitable to your operating system. You need the SD, which includes bextract. Otherwise, you'll have to install from source, i.e. ./configure make at least. Obviously, you won't need the client or console programs, but for the SD programs to build you do need the database development packages. It might even be possible to only build bextract, but if you knew how to find ot the reuired steps from the Makefile you wouldn't have asked :-) I have couple of Volumes created through Bacula. The Director Storage daemons are down out. What I am left with is only the volumes created during backup. Can I restore the data from these volumes using 'bextract'? Yes. I don't have any machine with Bacula Director installed. You need the SD. Also I could not find a way to install only 'bextract' on the required machine to restore from the available Volumes. Why can't you use the packages that are available through the bacula.org site? Please let me know if it is possible to do so. It is... basically, as easy as installing Bacula :-) Arno ~PassionateDeveloper MSN Battles We pitch one stalwart against the other and give you the power. Who will you vote for? Share photos while you chat with Windows Live Messenger. http://battles.in.msn.com/ -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unwarranted promotion to full
Hi, 07.05.2009 12:20, Mike Ruskai wrote: On 05/07/2009 05:38, Graham Keeling wrote: On Thu, May 07, 2009 at 05:18:45AM -0400, Mike Ruskai wrote: With Bacula 2.4.4, adding an exclusion to a file set causes an incremental backup to be promoted to full. Is this kind of thing fixed in 3.x? Do you know about the 'Ignore FileSet Changes' option? I do now, thanks. Of course, I don't know if it actually works. It does - at least that's my experience. After cancelling the superfluous full backup and adding that directive, Bacula still insists on doing a full backup. That's because the change to Ignore ... is considered a file set change, that takes place *before* the setting becomes valid. This despite the fact that there are two valid full backups in the catalog still. You could always tweak the catalog so that the latest full backup and all backups based on it look like they were made with the new file set. If you're comfortable with using a database tool like psql or mysql, and you know what you do, that's a safe thing. Which still implies you should make sure you have a valid catalog dump :-) Arno -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Installing only 'bextract' on a machine.
Date: Thu, 7 May 2009 12:28:35 +0200 From: a...@its-lehmann.de To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Installing only 'bextract' on a machine. Hello, 07.05.2009 09:53, Passionate Developer wrote: Hi, Is it possible to install only 'bextract' on a node? The easiest way might be to install from a package suitable to your operating system. You need the SD, which includes bextract. Otherwise, you'll have to install from source, i.e. ./configure make at least. [PD] Configure make will build all the components, Director, Storage File Daemon. Is it not possible to build just SD? Obviously, you won't need the client or console programs, but for the SD programs to build you do need the database development packages. [PD] So, in case I have Director Storage on 2 different machines, the database development package should be on the machine having SD? It might even be possible to only build bextract, but if you knew how to find ot the reuired steps from the Makefile you wouldn't have asked :-) Makefiles have always been a weak point of mine :-) I try to avoid learning more about it, but have to always go and look into it :-( now. I have couple of Volumes created through Bacula. The Director Storage daemons are down out. What I am left with is only the volumes created during backup. Can I restore the data from these volumes using 'bextract'? Yes. [PD] We can extract only if database is in place. Correct? What if nothing is in place. I mean, is it possible to restore the data to a new client using just the bextract binary the Volumes created during backup. I don't have any machine with Bacula Director installed. You need the SD. Also I could not find a way to install only 'bextract' on the required machine to restore from the available Volumes. Why can't you use the packages that are available through the bacula.org site? [PD]I am considering a case where Bacula crashes I am left with nothing but the volumes that were created during backups and 'bextract' binary. The database has also corrupted, so have to re-build the database too, which won't be possible. I cannot just copy the 'bextract' binary to some other machine try to recover the data. But I want to do exactly that. Its a kind of bare metal recovery from the available volumes. I am not aware if it is possible. Please let me know if it is possible to do so. It is... basically, as easy as installing Bacula :-) Arno ~PassionateDeveloper MSN Battles We pitch one stalwart against the other and give you the power. Who will you vote for? Share photos while you chat with Windows Live Messenger. http://battles.in.msn.com/ -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users _ Planning the weekend ? Here’s what is happening in your town. http://msn.asklaila.com/events/-- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net
Re: [Bacula-users] Unwarranted promotion to full
On Thu, May 07, 2009 at 12:44:17PM +0200, Arno Lehmann wrote: Hi, 07.05.2009 12:20, Mike Ruskai wrote: On 05/07/2009 05:38, Graham Keeling wrote: On Thu, May 07, 2009 at 05:18:45AM -0400, Mike Ruskai wrote: With Bacula 2.4.4, adding an exclusion to a file set causes an incremental backup to be promoted to full. Is this kind of thing fixed in 3.x? Do you know about the 'Ignore FileSet Changes' option? I do now, thanks. Of course, I don't know if it actually works. It does - at least that's my experience. After cancelling the superfluous full backup and adding that directive, Bacula still insists on doing a full backup. That's because the change to Ignore ... is considered a file set change, that takes place *before* the setting becomes valid. It seems to me that, with the 'accurate' backup feature, 'Ignore FileSet Changes' becomes redundant. Is it true to say that? -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] RunAfterJob with vars to release the tape
Hi All, I'm setting up a Bacula server on top of a LVM-based storage Samba Server. (Debian Lenny/Bacula 3.0.1 from sources/ x86_64 machine / LTO3 Tape) The RunBeforeJob script create the LVM snapshots of the LVs that I want to backup, then mounts it and Bacula do the rest. That's fine. The Schedule makes one Full backup on Sunday and Incremental from Monday to Friday. The problem i have found relates with the release of the tape. The Full backup must release the tape after the job is finished but the Incremental must use the same tape for all the 5 days and the RunAfterJob script doesn't works if I release the tape without querying what type of backup i'm making. It's possible to know what type of backup i'm making from the RunAfterJob to release or not the tape depending of the type of the backup?. I'm stuck with this from now... any ideas? Best regards.. Javier -- _ Francisco Javier Funes Nieto [esen...@gmail.com] CANONIGOS Servicios Informáticos para PYMES. Cl. Cruz 2, 1º Oficina 7 Tlf: 958.536759 / 661134556 Fax: 958.521354 GRANADA - 18002 -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100)
Hi ! Yes, doing that at the moment. It takes a long time to reset all my tapes, erase them, and start some tests on them it takes days ... More to come soon ... By the way, what is the best way to erase a tape ? I tried a dd if=/dev/zero of=/dev/st0 but I had to stop it after 24h (maybe I should use bigger block size to increase speed ?) mt -f /dev/st0 erase gives me some error : Input/Ouput error after a few seconds... Le 05.05.2009 14:12, Win Htin a écrit : Did you erase the tapes before re-running the backups? I would recommend first to completely erase the tape(s), run btape to make sure everything is working fine and then start testing the actual backups. Capture the output while running btape and go through it line by line to make sure you don't have even a single error. BTW, I forgot to mention I'm running Bacula version 2.2.6 on RHEL4 and 2.4.3 on RHEL5.2. HTH, Win Message: 7 Date: Mon, 04 May 2009 13:13:45 +0200 From: yvany...@skywalker.is-a-chef.com Subject: Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100) To: bacula-users@lists.sourceforge.net Message-ID:49fecde9.8050...@skywalker.is-a-chef.com Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi, thank you for the advices. We have very similar configurations, and I'm sure I'm not too far from the solution. I tried to use your settings in the storage daemon config file, and the mt options as well, than I didn't try so far. But, as soon as I put those settings, I have another error Hardware End of Medium = No # defaut is Yes Fast Forward Space File = No# This line required if above which is : 3-May 02:20 setmseblx0007-sd JobId 170: Error: Unable to position to end of data on device IBMLTO4 (/dev/nst0): ERR=dev.c:1354 ioctl MTFSF error on IBMLTO4 (/dev/nst0). ERR=Input/output error. Strange that it works for you then ... I issued all the mt commands you wrote. Tapeinfo gives me the samed infos as you have, but it's MTFSF error or MTEOM ... Regards Yvan Broccard -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup plan for critique
On Thu, May 07, 2009 at 09:14:19AM +0200, Maarten Hoogveld wrote: 2009/5/4 Zhengquan Zhang zhang.zhengq...@gmail.com Hello bacula community, I am a newbie to bacula and backup but I have decided to use it for our backup scheme:) we will backup two servers to a backup server. I have got a few questions that I have not figured out the answer. 1.why does bacula use db as backend? why add additional this level of complexity to the backup? This is not something you have to know about to be able to use Bacula. The database is used to store all information about the backups which have been made including all files and their metadata. A database is the most efficient way to store that data. For small installations a sqlite database is sufficient which hardly needs any setup. Read the documentation about it. Thanks a lot Maarten, your reply definetely helped me a lot. Regards, -- Zhengquan -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100)
Hi !
I had a try this morning with the btape fill again, after erasing my
tapes and relabeling them. The test was successfull.
Starting a few jobs at the moment to see if things improve...
A strange thing I noticed ... which is the correct storage device
parameter "RandomAccess" or "Random Access" (= no, for tapes) ... maybe
it's that ?
Le 06.05.2009 19:18, Hayden Katzenellenbogen a crit:
Yvan,
I see that you are running a TL2000 have you run the btape fill test on
your system. If you have did you get any errors?
I seem to be getting the following one.
05-May 15:17 btape: Fatal Error at dev.c:1705 because:
dev.c:1704 Attempt to WEOF on non-appendable Volume
Thanks
H
-Original Message-
From: yvan [mailto:y...@skywalker.is-a-chef.com]
Sent: Monday, May 04, 2009 4:14 AM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM
TS3100)
Hi,
thank you for the advices. We have very similar configurations, and I'm
sure I'm not too far from the solution. I tried to use your settings in
the storage daemon config file, and the "mt" options as well, than I
didn't try so far.
But, as soon as I put those settings, I have another error
Hardware End of Medium = No # defaut is Yes
Fast Forward Space File = No# This line required if above
which is :
3-May 02:20 setmseblx0007-sd JobId 170: Error: Unable to position to end
of data on device "IBMLTO4" (/dev/nst0): ERR=dev.c:1354 ioctl MTFSF
error on "IBMLTO4" (/dev/nst0). ERR=Input/output error.
Strange that it works for you then ... I issued all the "mt" commands
you wrote. Tapeinfo gives me the samed infos as you have, but it's MTFSF
error or MTEOM ...
Regards
Yvan Broccard
I also had very similar problems when I first started testing Bacula.
Now,
I have both TS3100 TS3200 models running without any issues on
RedHat 4 and 5 servers. My configurations are:
Autochanger {
Name = TS3200_1_DRV1
Device = LTO4_1
Changer Device = /dev/sg7 # This is mapped to the
AutoLoader
Changer Command = "/etc/bacula/config/mtx-changer %c %o %S %a
%d"
}
Device {
Name = LTO4_1
Drive Index = 0
Media Type = LTO4
Archive Device = /dev/nst0 # Device nstX created
automatically by st daemon.
AutoChanger = yes
AutomaticMount = yes;# when device opened, read it
AlwaysOpen = yes; # Default value yes
RemovableMedia = yes;
RandomAccess = no;
Requires Mount = no;
Maximum Open Wait = 300 # Default value
Maximum Rewind Wait = 300 # Default value
Maximum Changer Wait = 120 # default is 120 secs
Maximum Job Spool Size = 2G # default is unlimited
Spool Directory = "/export/shared/spool"
Label Type = IBM
Check Labels = yes
LabelMedia = no;
Hardware End of Medium = No # defaut is Yes
Fast Forward Space File = No# This line required if above
HEOM is set to "No"
BSF at EOM = no # Default is no
Two EOF = no
Volume Poll Interval = 300 # Poll the drive to seek the
status
}
I also changed the LTO4 tape drives' parameters with the "mt" command.
1. mt -f /dev/st0 stsetoptions
2. mt -f /dev/st0 compression
3. mt -f /dev/st0 stsetoptions buffer-writes
4. mt -f /dev/st0 stsetoptions async-write
5. mt -f /dev/st0 stsetoptions fast-eod
6. mt -f /dev/st0 stsetoptions two-fms
7. tapeinfo -f /dev/sg2
Product Type: Tape Drive
Vendor ID: 'IBM '
Product ID: 'ULT3580-TD4 '
Revision: '77B1'
Attached Changer: No
SerialNumber: '1310016341'
MinBlock:1
MaxBlock:16777215
SCSI ID: 2
SCSI LUN: 0
Ready: yes
BufferedMode: yes
Medium Type: 0x48
Density Code: 0x46
BlockSize: 0
DataCompEnabled: yes
DataCompCapable: yes
DataDeCompEnabled: yes
CompType: 0x1
DeCompType: 0x1
Block Position: 7920778
HTH
Cheers,
Win
--
Register Now Save for Velocity, the Web Performance Operations
Conference from O'Reilly Media. Velocity features a full day of
expert-led, hands-on workshops and two days of sessions from industry
leaders in dedicated Performance Operations tracks. Use code vel09scf
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
production scanning environment may not be a perfect world - but thanks to
Kodak,
Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100)
On Thu, May 7, 2009 at 9:30 AM, John Drescher dresche...@gmail.com wrote: On Thu, May 7, 2009 at 9:14 AM, yvan y...@skywalker.is-a-chef.com wrote: Hi ! Yes, doing that at the moment. It takes a long time to reset all my tapes, erase them, and start some tests on them it takes days ... More to come soon ... By the way, what is the best way to erase a tape ? I tried a dd if=/dev/zero of=/dev/st0 but I had to stop it after 24h (maybe I should use bigger block size to increase speed ?) mt -f /dev/st0 erase gives me some error : Input/Ouput error after a few seconds... mt -f /dev/nst0 rewind mt -f /dev/nst0 weof John -- John M. Drescher -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unwarranted promotion to full
On 05/07/2009 06:44, Arno Lehmann wrote: You could always tweak the catalog so that the latest full backup and all backups based on it look like they were made with the new file set. If you're comfortable with using a database tool like psql or mysql, and you know what you do, that's a safe thing. Which still implies you should make sure you have a valid catalog dump :-) Arno I'm using MySQL, and have the then most recent Bacula databases at any given time (a DB dump is run daily, with the lowest priority, so all jobs finish before it does). I've no fear of SQL, so I'd appreciate a pointer on which columns in which tables are relevant. -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is that ok using Bacula to write on DVDs?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, years ago I did use DVD's for backups. However, I used DVD RAMs which you can use like a HDD. There are 2 problems with this: 1) it is SLOW 2) you run into problems if you need more than 1 DVD - From a technical viewpoint you can solve (2) with some autochanger scripts like: - show message that DVD is full - eject it - wait for a new DVD - then continue Well, unless you are in charge of the backup you will never get other people to reliably change DVD's. Once you need 4-5 DVD's you are busy with checking DVD for most of the day. The solution was to get a 1 TB USB drive (for bit more than 100 USD). Cheers, Bernd On Wed, 06 May 2009 06:14:27 + bacula-users-requ...@lists.sourceforge.net wrote: Message: 18 Date: Tue, 05 May 2009 13:15:39 -0600 From: alexan...@nautae.eti.br Subject: Re: [Bacula-users] Is that ok using Bacula to write on DVDs? To: Bruno Friedmann br...@ioda-net.ch Cc: bacula-users@lists.sourceforge.net Message-ID: 20090505131539.676210t4zeggq...@www.nautae.eti.br Content-Type: text/plain; charset=UTF-8; DelSp=Yes;format=flowed I can only subscribe to John comment recommandation. You certainly would have a better experience with pool on disk even on removable usb disk There's not so expensive this days. Ok, I gave up of doing DVD writing by Bacula. I'll use disk volumes and burn the DVD after that. I'm not confident about using removable usb disk because it's not a safe made media. Of course DVD too, but I think DVDs are more reliable than usb disk, there isn't electricity to read the data. What do you think? If you don't have a tape device and need something reliable, what solution would you use? []'s Alexander - -- Bernd Plagge - プラゲ ベェアント First Choice Internet Ltd., Tokyo - ファースト・チョイス・インターネット(有) -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) iEYEARECAAYFAkoC/tgACgkQpYU8M8PbPV6FzACgiJgDGdl5uN06hqgn3LIi+C9m EHQAoJSxTKKyOyz44QxlEusAFljDP4D5 =fJ+M -END PGP SIGNATURE- -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Network error with FD during Backup
I have a problem with 1 client. It is a solaris zone. I don't have issues with the other zones on the same server, so I can't believe it's a hardware error or firewall problem. (The client is running in a DMZ-zone) I also have used Heartbeat Interval = 60 seconds for dir, sd and fd, but the problem stays. I am using Bacula 2.4.3 on centos 5.2. 07-May 17:09 itshas-sv11-dir JobId 4846: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer 07-May 17:09 itshas-sv11-dir JobId 4846: Fatal error: No Job status returned from FD. 07-May 17:09 itshas-sv11-dir JobId 4846: Error: Bacula itshas-sv11-dir 2.4.3 (10Oct08): 07-May-2009 17:09:45 Build OS: x86_64-unknown-linux-gnu redhat JobId: 4846 Job:BCK-smtpserver.2009-05-07_16.51.03 Backup Level: Full Client: smtpserver-fd 2.4.3 (10Oct08) i386-pc-solaris2.10,solaris,5.10 FileSet:smtpserver-fs 2008-11-20 22:30:00 Pool: aca-manual (From Job resource) Storage:lto4drive (From Job resource) Scheduled time: 07-May-2009 16:51:26 Start time: 07-May-2009 16:51:31 End time: 07-May-2009 17:09:45 Elapsed time: 18 mins 14 secs Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS:no Storage Encryption: no Volume name(s): Test Volume Session Id: 1 Volume Session Time:1241707867 Last Volume Bytes: 15,121,354,752 (15.12 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: Error SD termination status: Error Termination:*** Backup Error *** -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is that ok using Bacula to write on DVDs?
On Wed, 06 May 2009 12:16:49 -0600, alexan...@nautae.eti.br said: DVDs are likely less reliable than any form of external disk. a Are you sure about that? a I'm not using DVD-RW, just DVD-R. Ah, I didn't realize that. I had been assuming that you were rewriting existing disks. DVD-R's are much better for longevity (I believe) than DVD-RWs. That being said, the recently shown life expectancy of a DVD-R is somewhere on the order of 5 years. [Though I don't know what percentage of failure they're using to define that timing mark] You might consider re-reading the disk, at least, immediately after burning and comparing the checksum of the volume to the checksum written to the disk to ensure their the same. That'd provide a lot more confidence. a DVDs are made to mass data distribution. USB data sticks are made just a to move data from a place to another. Well, I was assuming a hard drive and not a USB stick. In theory, I'd actually trust solid state drives better (like USB drives) more than disks or DVDs because there are less moving parts. -- In the bathtub of history the truth is harder to hold than the soap, and much more difficult to find. -- Terry Pratchett -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100)
Yvan, Could you paste a copy of your bacula-sd.conf. The device and auto changer sections. I have found that if I load the tape into the drive then run the fill test it will not give the WEOF error, but when it loads the second tape it will give the WEOF error. If I have any other tape in the drive before I start and btape loads tape one for the fill test I get the WEOF error on both the first and second tape. The btape test runs 100% including the append test. Here is a snippet of the last fill test I ran. I had already loaded tape 1 into the drive before start. I also did an erase on both tapes using John's two mt commands. Also would it make a difference that I am running this on Ubuntu 8.0.4 LTS and using a fiber channel drive? H r...@archive:~/bacula/etc# ../bin/btape -c bacula-sd.conf /dev/nst0 Tape block granularity is 1024 bytes. btape: butil.c:285 Using device: /dev/nst0 for writing. 05-May 15:40 btape JobId 0: 3301 Issuing autochanger loaded? drive 0 command. 05-May 15:40 btape JobId 0: 3302 Autochanger loaded? drive 0, result is Slot 1. btape: btape.c:383 open device Drive-1 (/dev/nst0): OK *fill This command simulates Bacula writing to a tape. It requires either one or two blank tapes, which it will label and write. If you have an autochanger configured, it will use the tapes that are in slots 1 and 2, otherwise, you will be prompted to insert the tapes when necessary. It will print a status approximately every 322 MB, and write an EOF every 3.2 GB. If you have selected the simple test option, after writing the first tape it will rewind it and re-read the last block written. If you have selected the multiple tape test, when the first tape fills, it will ask for a second, and after writing a few more blocks, it will stop. Then it will begin re-reading the two tapes. This may take a long time -- hours! ... Do you want to run the simplified test (s) with one tape or the complete multiple tape (m) test: (s/m) m Multiple tape test selected. Wrote Volume label for volume TestVolume1. Wrote Start of Session label. 15:44:05 Begin writing Bacula records to first tape ... Wrote blk_block=5000, dev_blk_num=4999 VolBytes=322,495,488 rate=80623.9 KB/s Wrote blk_block=1, dev_blk_num= VolBytes=645,055,488 rate=92150.8 KB/s Wrote blk_block=15000, dev_blk_num=14999 VolBytes=967,615,488 rate=96761.5 KB/s Wrote blk_block=2, dev_blk_num=4499 VolBytes=1,290,175,488 rate=86011.7 KB/s Wrote blk_block=25000, dev_blk_num=9499 VolBytes=1,612,735,488 rate=76796.9 KB/s Wrote blk_block=3, dev_blk_num=14499 VolBytes=1,935,295,488 rate=80637.3 KB/s Wrote blk_block=13055000, dev_blk_num=15500 VolBytes=842,204,095,488 rate=70625.1 KB/s 19:02:52 Flush block, write EOF Wrote blk_block=1306, dev_blk_num=4000 VolBytes=842,526,655,488 rate=70598.9 KB/s Wrote blk_block=13065000, dev_blk_num=9000 VolBytes=842,849,215,488 rate=70608.1 KB/s Wrote blk_block=1307, dev_blk_num=14000 VolBytes=843,171,775,488 rate=70611.5 KB/s Wrote blk_block=13075000, dev_blk_num=3500 VolBytes=843,494,335,488 rate=70603.0 KB/s Wrote blk_block=1308, dev_blk_num=8500 VolBytes=843,816,895,488 rate=70612.3 KB/s 05-May 19:03 btape JobId 0: End of Volume TestVolume1 at 1226:13010 on device Drive-1 (/dev/nst0). Write of 64512 bytes got -1. 05-May 19:03 btape JobId 0: Re-read of last block succeeded. btape: btape.c:2360 Last block at: 1226:13009 this_dev_block_num=13010 btape: btape.c:2394 End of tape 1226:0. VolumeCapacity=844,107,844,608. Write rate = 70595.3 KB/s 05-May 19:03 btape JobId 0: End of medium on Volume TestVolume1 Bytes=844,107,844,608 Blocks=13,084,509 at 05-May-2009 19:03. 05-May 19:03 btape JobId 0: 3307 Issuing autochanger unload slot 1, drive 0 command. 05-May 19:04 btape JobId 0: 3301 Issuing autochanger loaded? drive 0 command. 05-May 19:04 btape JobId 0: 3302 Autochanger loaded? drive 0, result: nothing loaded. 05-May 19:04 btape JobId 0: 3304 Issuing autochanger load slot 2, drive 0 command. 05-May 19:04 btape JobId 0: 3305 Autochanger load slot 2, drive 0, status is OK. 05-May 19:04 btape: Fatal Error at dev.c:1705 because: dev.c:1704 Attempt to WEOF on non-appendable Volume Wrote Volume label for volume TestVolume2. 05-May 19:04 btape JobId 0: Wrote label to prelabeled Volume TestVolume2 on device Drive-1 (/dev/nst0) 05-May 19:04 btape JobId 0: New volume TestVolume2 mounted on device Drive-1 (/dev/nst0) at 05-May-2009 19:04. Done writing 0 records ... Wrote End of Session label. Wrote state file last_block_num1=13009 last_block_num2=11 19:04:42 Done filling tapes at 0:13. Now beginning re-read of first tape ... 05-May 19:04 btape JobId 0: 3307 Issuing autochanger unload slot 2, drive 0 command. 05-May 19:05 btape JobId 0: 3304 Issuing autochanger load slot 1, drive 0 command. 05-May 19:05 btape JobId 0: 3305 Autochanger load slot 1, drive 0, status is OK. 05-May 19:05 btape JobId 0: Ready to read from volume TestVolume1 on device Drive-1 (/dev/nst0).
Re: [Bacula-users] Is that ok using Bacula to write on DVDs?
Wes Hardaker wrote: On Wed, 06 May 2009 12:16:49 -0600, alexan...@nautae.eti.br said: DVDs are likely less reliable than any form of external disk. a Are you sure about that? a I'm not using DVD-RW, just DVD-R. Ah, I didn't realize that. I had been assuming that you were rewriting existing disks. DVD-R's are much better for longevity (I believe) than DVD-RWs. That being said, the recently shown life expectancy of a DVD-R is somewhere on the order of 5 years. [Though I don't know what percentage of failure they're using to define that timing mark] I believe this is actually very old data going back to the earlier CD days. It wasn't so much research-based but empirical; they found that stains had formed within the material itself and the plastic had developed cracks (similar to aircraft windows). These problems are actually supposed to have been resolved with improved media. Still, 5 years is probably a good number to go with unless we have better data. In theory, I'd actually trust solid state drives better (like USB drives) more than disks or DVDs because there are less moving parts. In theory. USB sticks actually can wear out pretty fast. An individual flash memory cell only survives approximately 100,000 write cycles, which is not a lot if you think about it. Solid state disks are more reliable because they use redundancy and are able to detect and replace failed memory cells. That's why I would probably trust a DVD more than solid-state. Ultimately, though, all media fails. Tapes wear out, too. -- Kevin Keane Owner The NetTech Find the Uncommon: Expert Solutions for a Network You Never Have to Think About Office: 866-642-7116 http://www.4nettech.com This e-mail and attachments, if any, may contain confidential and/or proprietary information. Please be advised that the unauthorized use or disclosure of the information is strictly prohibited. The information herein is intended only for use by the intended recipient(s) named above. If you have received this transmission in error, please notify the sender immediately and permanently delete the e-mail and any copies, printouts or attachments thereof. -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is that ok using Bacula to write on DVDs?
In theory. USB sticks actually can wear out pretty fast. An individual flash memory cell only survives approximately 100,000 write cycles, which is not a lot if you think about it. Solid state disks are more reliable because they use redundancy and are able to detect and replace failed memory cells. All current USB sticks should have wear leveling and between 100,000 to 1,000,000 writes per cell. Depending on the size this may mean 5 years or more of continuous writing to burn it out since the interface is limited at less than 40 MB/s. John -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100)
If mtx is working from command line, cut and paste the following
perl script, changing parameters where necessary. That will help you
erase the tapes. Also using dd command is not a good thing. Make
sure Bacula processes are not running while you run this script.
HTH.
Win
start of script
-
#!/usr/bin/perl
use warnings;
$changer_device = /dev/sg7; # Define your changer device
$tape_device = /dev/nst0; # Define your tape device
$tempfile = /tmp/changer_slots.$$;# Create a temporary file to
keep the slots index
$settle_time = 10;# Time to allow the tape to
settle in drive
# -- Make sure nothing is loaded in the tape device --
`mtx -f $changer_device unload`;
# -- Get the slot number(s) where tapes are actually loaded and store
in tempfile --
`mtx -f $changer_device status|grep :VolumeTag=|awk \'{print
\$3}\'|cut -d: -f1 $tempfile`;
# -- Read through the tempfile for each tape loaded in respective
slot and erase it --
open (SLOTS, $tempfile) || die Cannot open file: $!;
while (SLOTS) {
print Loading tape from slot $_...\n;
`mtx -f $changer_device load $_`;
print Letting tape drive settle for $settle_time seconds...\n;
`sleep $settle_time`;
print Rewinding tape ...\n;
`mt -f $tape_device rewind`;
print Writing EOF to tape ...\n;
`mt -f $tape_device weof`;
print Rewinding tape ...\n;
`mt -f $tape_device rewind`;
print Unloading tape ...\n;
`mtx -f $changer_device unload $_`;
print Done erasing tape in slot $_ !\n--\n;
}
close (SLOTS);
unlink $tempfile;
- end of script
-
On Thu, May 7, 2009 at 12:44 PM, Hayden Katzenellenbogen
hay...@nextlevelinternet.com wrote:
Yvan,
Could you paste a copy of your bacula-sd.conf. The device and auto changer
sections.
I have found that if I load the tape into the drive then run the fill test it
will not give the WEOF error, but when it loads the second tape it will give
the WEOF error.
If I have any other tape in the drive before I start and btape loads tape one
for the fill test I get the WEOF error on both the first and second tape.
The btape test runs 100% including the append test. Here is a snippet of the
last fill test I ran. I had already loaded tape 1 into the drive before
start. I also did an erase on both tapes using John's two mt commands.
Also would it make a difference that I am running this on Ubuntu 8.0.4 LTS
and using a fiber channel drive?
H
r...@archive:~/bacula/etc# ../bin/btape -c bacula-sd.conf /dev/nst0
Tape block granularity is 1024 bytes.
btape: butil.c:285 Using device: /dev/nst0 for writing.
05-May 15:40 btape JobId 0: 3301 Issuing autochanger loaded? drive 0
command.
05-May 15:40 btape JobId 0: 3302 Autochanger loaded? drive 0, result is
Slot 1.
btape: btape.c:383 open device Drive-1 (/dev/nst0): OK
*fill
This command simulates Bacula writing to a tape.
It requires either one or two blank tapes, which it
will label and write.
If you have an autochanger configured, it will use
the tapes that are in slots 1 and 2, otherwise, you will
be prompted to insert the tapes when necessary.
It will print a status approximately
every 322 MB, and write an EOF every 3.2 GB. If you have
selected the simple test option, after writing the first tape
it will rewind it and re-read the last block written.
If you have selected the multiple tape test, when the first tape
fills, it will ask for a second, and after writing a few more
blocks, it will stop. Then it will begin re-reading the
two tapes.
This may take a long time -- hours! ...
Do you want to run the simplified test (s) with one tape
or the complete multiple tape (m) test: (s/m) m
Multiple tape test selected.
Wrote Volume label for volume TestVolume1.
Wrote Start of Session label.
15:44:05 Begin writing Bacula records to first tape ...
Wrote blk_block=5000, dev_blk_num=4999 VolBytes=322,495,488 rate=80623.9 KB/s
Wrote blk_block=1, dev_blk_num= VolBytes=645,055,488 rate=92150.8 KB/s
Wrote blk_block=15000, dev_blk_num=14999 VolBytes=967,615,488 rate=96761.5
KB/s
Wrote blk_block=2, dev_blk_num=4499 VolBytes=1,290,175,488 rate=86011.7
KB/s
Wrote blk_block=25000, dev_blk_num=9499 VolBytes=1,612,735,488 rate=76796.9
KB/s
Wrote blk_block=3, dev_blk_num=14499 VolBytes=1,935,295,488 rate=80637.3
KB/s
Wrote blk_block=13055000, dev_blk_num=15500 VolBytes=842,204,095,488
rate=70625.1 KB/s
19:02:52 Flush block, write EOF
Wrote blk_block=1306, dev_blk_num=4000 VolBytes=842,526,655,488
rate=70598.9 KB/s
Wrote blk_block=13065000, dev_blk_num=9000 VolBytes=842,849,215,488
rate=70608.1 KB/s
Wrote blk_block=1307, dev_blk_num=14000
Re: [Bacula-users] Is that ok using Bacula to write on DVDs?
reliable because they use redundancy and are able to detect and replace failed memory cells. That's why I would probably trust a DVD more than solid-state. Ultimately, though, all media fails. Tapes wear out, too. I don't know about solid-state devices. But I think if I can make a safe write on a DVD-R (comparing the checksum) probably I won't have to worry about the media for one or two years. Using a disk... If something is wrong with the electronic device, my read after two years can destroy everything in one single step. Of course If I have a laser problem on DVD device... but have you ever noticed about a laser problem that had destroyed an - already - written DVD media when you just want to - read - data? I think DVDs is really reliable to keep data readable (one or two years, wherever), but not to write. And disks is more reliable to write and not to read. Of course what I'm saying is about a - crash - at the restore moment, not a misunderstood byte or something. Normally I have to scratch a DVD-R on the wall or write wrong data to destroy my day at a restore moment. If I use a disk... I think it will always be a stressed restore moment. DVD-R just seems to be like a piece of paper, extremely fragile, but extremely simple. But, of course, I'm not a specialist, I don't know if a solid-state is more simple than a burned piece of plastic. I'm really enjoying this discussion. I hope I'm not insisting on a redundant discussion. Sorry if it's the case. []'s Alexander Brazil - Rio de Janeiro This message was sent using IMP, the Internet Messaging Program. -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unwarranted promotion to full
Hi, 07.05.2009 15:01, Mike Ruskai wrote: On 05/07/2009 06:44, Arno Lehmann wrote: You could always tweak the catalog so that the latest full backup and all backups based on it look like they were made with the new file set. If you're comfortable with using a database tool like psql or mysql, and you know what you do, that's a safe thing. Which still implies you should make sure you have a valid catalog dump :-) Arno I'm using MySQL, and have the then most recent Bacula databases at any given time (a DB dump is run daily, with the lowest priority, so all jobs finish before it does). I've no fear of SQL, so I'd appreciate a pointer on which columns in which tables are relevant. Sure... see this: mysql SELECT Job.Job AS Job,Job.Name AS JName,Job.FileSetId AS FileSetId,FileSet.FileSet AS FSName,FileSet.MD5 AS FSMD5,FileSet.CreateTime AS FSCreated FROM Job,FileSet WHERE Job.FileSetId=FileSet.FileSetId AND Job.Name=Demo1 GROUP BY FSMD5; +--+---+---+--++-+ | Job | JName | FileSetId | FSName | FSMD5 | FSCreated | +--+---+---+--++-+ | Demo1.2009-04-29_16.00.00.35 | Demo1 | 9 | Demo1Set | EG+Gq8+j45+1L7JF7B/EZC | 2009-04-29 11:57:46 | | Demo1.2009-04-20_22.45.00.08 | Demo1 | 2 | Demo1Set | hy/ID6/JBj+428d/PVIOlC | 2009-03-19 12:10:46 | +--+---+---+--++-+ 2 rows in set (0.02 sec) You notice I changed the file set once. The FileSetId row is the one you're interested in. You can look up the known IDs in the FileSet Table: mysql SELECT * FROM FileSet WHERE FileSet=Demo1Set; +---+--++-+ | FileSetId | FileSet | MD5| CreateTime | +---+--++-+ | 2 | Demo1Set | hy/ID6/JBj+428d/PVIOlC | 2009-03-19 12:10:46 | | 9 | Demo1Set | EG+Gq8+j45+1L7JF7B/EZC | 2009-04-29 11:57:46 | +---+--++-+ 2 rows in set (0.00 sec) These are the two file sets Bacula knows under that name. So it's only looking up the latest jobs(s) using the old file set Id mysql SELECT EndTime FROM Job WHERE FileSetId=2 AND Level=F and Name=Demo1 ORDER BY EndTime DESC LIMIT 1; +-+ | EndTime | +-+ | 2009-04-28 22:05:14 | +-+ 1 row in set (0.01 sec) and changing those to refer to the new FileSet. Something like 'UPDATE Job SET FileSetId=9 WHERE Name=Demo1 AND EndTime='2009-04-28 22:05:14'; and Bacula would find previous jobs with the right file set, so no updates are needed. Good enough? Arno -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100)
Win,
I blanked all my tapes. Ran the btape fill test again. Got the same error.
Do you want to run the simplified test (s) with one tape
or the complete multiple tape (m) test: (s/m) m
Multiple tape test selected.
07-May 14:02 btape JobId 0: 3307 Issuing autochanger unload slot 3, drive 0
command.
07-May 14:03 btape JobId 0: 3304 Issuing autochanger load slot 1, drive 0
command.
07-May 14:04 btape JobId 0: 3305 Autochanger load slot 1, drive 0, status is
OK.
07-May 14:04 btape: Fatal Error at dev.c:1705 because:
dev.c:1704 Attempt to WEOF on non-appendable Volume
Wrote Volume label for volume TestVolume1.
Wrote Start of Session label.
14:04:09 Begin writing Bacula records to first tape ...
Wrote blk_block=5000, dev_blk_num=4999 VolBytes=322,495,488 rate=80623.9 KB/s
Wrote blk_block=1, dev_blk_num= VolBytes=645,055,488 rate=92150.8 KB/s
Also is there an easy way to exit the fill test without pressing ctrl-c.
I do not understand why does the btape test run 100% but the fill test fails?
Thanks for all the help
H
-Original Message-
From: Win Htin [mailto:win.h...@gmail.com]
Sent: Thursday, May 07, 2009 1:23 PM
To: Hayden Katzenellenbogen
Cc: yvan; bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Tape MTEOM error with Dell TL2000 (IBM TS3100)
If mtx is working from command line, cut and paste the following
perl script, changing parameters where necessary. That will help you
erase the tapes. Also using dd command is not a good thing. Make
sure Bacula processes are not running while you run this script.
HTH.
Win
start of script
-
#!/usr/bin/perl
use warnings;
$changer_device = /dev/sg7; # Define your changer device
$tape_device = /dev/nst0; # Define your tape device
$tempfile = /tmp/changer_slots.$$;# Create a temporary file to
keep the slots index
$settle_time = 10;# Time to allow the tape to
settle in drive
# -- Make sure nothing is loaded in the tape device --
`mtx -f $changer_device unload`;
# -- Get the slot number(s) where tapes are actually loaded and store
in tempfile --
`mtx -f $changer_device status|grep :VolumeTag=|awk \'{print
\$3}\'|cut -d: -f1 $tempfile`;
# -- Read through the tempfile for each tape loaded in respective
slot and erase it --
open (SLOTS, $tempfile) || die Cannot open file: $!;
while (SLOTS) {
print Loading tape from slot $_...\n;
`mtx -f $changer_device load $_`;
print Letting tape drive settle for $settle_time seconds...\n;
`sleep $settle_time`;
print Rewinding tape ...\n;
`mt -f $tape_device rewind`;
print Writing EOF to tape ...\n;
`mt -f $tape_device weof`;
print Rewinding tape ...\n;
`mt -f $tape_device rewind`;
print Unloading tape ...\n;
`mtx -f $changer_device unload $_`;
print Done erasing tape in slot $_ !\n--\n;
}
close (SLOTS);
unlink $tempfile;
- end of script
-
On Thu, May 7, 2009 at 12:44 PM, Hayden Katzenellenbogen
hay...@nextlevelinternet.com wrote:
Yvan,
Could you paste a copy of your bacula-sd.conf. The device and auto changer
sections.
I have found that if I load the tape into the drive then run the fill test it
will not give the WEOF error, but when it loads the second tape it will give
the WEOF error.
If I have any other tape in the drive before I start and btape loads tape one
for the fill test I get the WEOF error on both the first and second tape.
The btape test runs 100% including the append test. Here is a snippet of the
last fill test I ran. I had already loaded tape 1 into the drive before
start. I also did an erase on both tapes using John's two mt commands.
Also would it make a difference that I am running this on Ubuntu 8.0.4 LTS
and using a fiber channel drive?
H
r...@archive:~/bacula/etc# ../bin/btape -c bacula-sd.conf /dev/nst0
Tape block granularity is 1024 bytes.
btape: butil.c:285 Using device: /dev/nst0 for writing.
05-May 15:40 btape JobId 0: 3301 Issuing autochanger loaded? drive 0
command.
05-May 15:40 btape JobId 0: 3302 Autochanger loaded? drive 0, result is
Slot 1.
btape: btape.c:383 open device Drive-1 (/dev/nst0): OK
*fill
This command simulates Bacula writing to a tape.
It requires either one or two blank tapes, which it
will label and write.
If you have an autochanger configured, it will use
the tapes that are in slots 1 and 2, otherwise, you will
be prompted to insert the tapes when necessary.
It will print a status approximately
every 322 MB, and write an EOF every 3.2 GB. If you have
selected the simple test option, after writing the first tape
it will rewind it and re-read the last block written.
If you have selected the multiple tape test, when the
