Re: [Bacula-users] Dell TL1000 IBM3850-HH7
Kern, Thank you for the additional information. I will look deeper into it throughout the next couple of days. The results of my testing with the code indicate another issue, basically the changes just push the issue further down the process. The first 3 test succeed but the 4th one fails differently. I also concur that replacing EIO with EOF/EOT/EOD is just plan dangerous. EIO is an error for a reason :) Be in touch. Jim Richardson -Original Message- From: Kern Sibbald [mailto:k...@sibbald.com] Sent: Monday, March 20, 2017 8:25 AM To: Jim Richardson ; bacula-users@lists.sourceforge.net Cc: Simone Caronni ; Roberts, Ben ; Alan Brown Subject: Re: [Bacula-users] Dell TL1000 IBM3850-HH7 Hello Jim, I just had another thought. Perhaps you have somehow gotten a non-standard ioctl MTSETDRVBUFFER value. This could cause the tape drive to misbehave. There are quite a number of options, and Bacula counts on a certain number of them being correctly set, which is the Linux default. For example, if you have the option MT_ST_SYSV option enabled, Bacula will definitely not work. Also, if the drive has MT_ST_ASYNC_WRITES set, Bacula will also not behave correctly. I know how to set these variables (with an ioctl, documented in "man st"), but I do not know how to find out what they are set to. It is also possible that the tape drive itself, in the firmware has the equivalent to MT_ST_ASYNC_WRITES set. I have seen this for one customer we had, and the only way was for him to modify the firmware setting (I am not sure how he did it). Although it is a good idea for testing, I am not at all comfortable with having an EIO be turned into and EOF or EOT. Best regards, Kern On 03/19/2017 06:02 PM, Jim Richardson wrote: > Team, > > Okay curiosity got the better of me, I did three things. One, built from > latest source on Sourceforge 7.4.7-7 binaries only - tested with same > results. Two, using the Slaanesh repository (thank you Ben) was able to > install version 7.4.7-1 - tested with the same results. Three, I used the > configuration from Alan (thank you) - test with same results. > > At this point I am leaning towards the post from Mariusz Mazur (link below) > from 2013. He is asserting that he is able to use the IBM lin_tape driver > with Bacula by building in support for EOD operations using FSF which end up > with an EIO instead of an EOF. He offers two patches. I am not interested > in the IBM driver if I can get the ST to work. Bacula's code changed > significantly since his patches and my initial debug, notably the calls in > dev.c seem to have moved to tape_dev.c. I may attempt to add a few more Dmsg > at a higher debug to the code reporting on any sense data from the tape > itself to dig into the issue. I am fairly sure from my initial debug of > btape that the EIO instead of an EOF / ENOSPC is the root of the issue. > > Is there anything already in the code that can give insight into the sense > data from the drive without the need for extra code? Or a non-coding option > to get btape to ignore these errors and just complete its job. Then we can > look at the actual tape results to see if, while in error, desired > functionality is obtained? My use case will be one job/tape a day anyway. > The append functionality will only come into play for one offs - which I can > do with mt/tar/etc. > > I am compiling a build that blanketly accepts EIO as EOF to see if that fixes > the issue, if that works then a portion Mariusz's code may be the fix, allow > for an option of EIO at EOF = yes, default of no as it applies this to the > FSF function. > > Be in touch. > > Referenced Link: > http://bacula.10910.n7.nabble.com/No-EIO-support-on-EOD-read-td75874.h > tml > > Jim Richardson > > -Original Message- > From: Kern Sibbald [mailto:k...@sibbald.com] > Sent: Sunday, March 19, 2017 5:13 AM > To: Jim Richardson ; > bacula-users@lists.sourceforge.net > Cc: Simone Caronni > Subject: Re: [Bacula-users] Dell TL1000 IBM3850-HH7 > > Hello Jim, > > What Alan says is interesting. I was aware that there was a recent bug with > btape "fill", but I have been unaware of the kinds of problems you are > seeing. Anyway, your problem worries me as it is possible, though unlikely, > there is some issue with LTO-7 drives. > > Yesterday, I just upgraded from LTO-4 to LTO-5, and btape worked perfectly > for me. > > If I were in your shoes, I would do it just as you say, but if you prefer not > to build the binaries yourself, there are two alternatives: > > 1. Wait a week or two and the community will certainly have RedHat or CentOS > 7.x binaries available. We are just putting the finishing touches on the > download page. > > 2. Ask Simone Caronni, copied on this email, as he is the RedHat/Fedora > packager and he probably already has a recent RedHat 7.4 packaged. The > current Bacula release is 7.4.7. > > Best regards, > > Kern > > > On 03/19/20
Re: [Bacula-users] Pools for Full and Incremental
On Mon, Mar 20, 2017 at 07:23:18AM -0400, Petar Kozić wrote: > Hi, > > I have one question. > > If I use in backup job two different pool > > Full Backup Pool = Full > Incremental Backup Pool = Incremental > > Which pool statement I must use for restore Job ? It does not matter, the restore job will pick appropiate pool once it is clear which volumes are needed for it. I have "Default" set as "Pool" in my confiugration, even though no volumes are assigned to that pool. Misha. -- Vanush "Misha" Paturyan Senior Technical Officer Room 120 Computer Science Department Eolas Bulding Maynooth University Maynooth ext: 4539 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Dell TL1000 IBM3850-HH7
Hello Jim, I just had another thought. Perhaps you have somehow gotten a non-standard ioctl MTSETDRVBUFFER value. This could cause the tape drive to misbehave. There are quite a number of options, and Bacula counts on a certain number of them being correctly set, which is the Linux default. For example, if you have the option MT_ST_SYSV option enabled, Bacula will definitely not work. Also, if the drive has MT_ST_ASYNC_WRITES set, Bacula will also not behave correctly. I know how to set these variables (with an ioctl, documented in "man st"), but I do not know how to find out what they are set to. It is also possible that the tape drive itself, in the firmware has the equivalent to MT_ST_ASYNC_WRITES set. I have seen this for one customer we had, and the only way was for him to modify the firmware setting (I am not sure how he did it). Although it is a good idea for testing, I am not at all comfortable with having an EIO be turned into and EOF or EOT. Best regards, Kern On 03/19/2017 06:02 PM, Jim Richardson wrote: > Team, > > Okay curiosity got the better of me, I did three things. One, built from > latest source on Sourceforge 7.4.7-7 binaries only - tested with same > results. Two, using the Slaanesh repository (thank you Ben) was able to > install version 7.4.7-1 - tested with the same results. Three, I used the > configuration from Alan (thank you) - test with same results. > > At this point I am leaning towards the post from Mariusz Mazur (link below) > from 2013. He is asserting that he is able to use the IBM lin_tape driver > with Bacula by building in support for EOD operations using FSF which end up > with an EIO instead of an EOF. He offers two patches. I am not interested > in the IBM driver if I can get the ST to work. Bacula's code changed > significantly since his patches and my initial debug, notably the calls in > dev.c seem to have moved to tape_dev.c. I may attempt to add a few more Dmsg > at a higher debug to the code reporting on any sense data from the tape > itself to dig into the issue. I am fairly sure from my initial debug of > btape that the EIO instead of an EOF / ENOSPC is the root of the issue. > > Is there anything already in the code that can give insight into the sense > data from the drive without the need for extra code? Or a non-coding option > to get btape to ignore these errors and just complete its job. Then we can > look at the actual tape results to see if, while in error, desired > functionality is obtained? My use case will be one job/tape a day anyway. > The append functionality will only come into play for one offs - which I can > do with mt/tar/etc. > > I am compiling a build that blanketly accepts EIO as EOF to see if that fixes > the issue, if that works then a portion Mariusz's code may be the fix, allow > for an option of EIO at EOF = yes, default of no as it applies this to the > FSF function. > > Be in touch. > > Referenced Link: > http://bacula.10910.n7.nabble.com/No-EIO-support-on-EOD-read-td75874.html > > Jim Richardson > > -Original Message- > From: Kern Sibbald [mailto:k...@sibbald.com] > Sent: Sunday, March 19, 2017 5:13 AM > To: Jim Richardson ; bacula-users@lists.sourceforge.net > Cc: Simone Caronni > Subject: Re: [Bacula-users] Dell TL1000 IBM3850-HH7 > > Hello Jim, > > What Alan says is interesting. I was aware that there was a recent bug with > btape "fill", but I have been unaware of the kinds of problems you are > seeing. Anyway, your problem worries me as it is possible, though unlikely, > there is some issue with LTO-7 drives. > > Yesterday, I just upgraded from LTO-4 to LTO-5, and btape worked perfectly > for me. > > If I were in your shoes, I would do it just as you say, but if you prefer not > to build the binaries yourself, there are two alternatives: > > 1. Wait a week or two and the community will certainly have RedHat or CentOS > 7.x binaries available. We are just putting the finishing touches on the > download page. > > 2. Ask Simone Caronni, copied on this email, as he is the RedHat/Fedora > packager and he probably already has a recent RedHat 7.4 packaged. The > current Bacula release is 7.4.7. > > Best regards, > > Kern > > > On 03/19/2017 12:42 AM, Jim Richardson wrote: >> Alan, >> >> Thank you for joining my inquiry. I will try this config on Monday. As for >> the bug, no and kind of, I read a thread from 2013 that pointed to a fix for >> the FSF calls for EOF/EOT with LTO drives. It includes a few patches and >> questioned their plausibility for inclusion into Bacula stating that it >> would make Bacula compatible with the IBM lin_tape driver. The thread died >> with what seemed like internet trollism. I wanted to avoid building from >> source due to the fact that I know it will tie me to the install forever. >> Never the less, if that is the only way to get this moving forward I will do >> so Monday and will report back with resu
Re: [Bacula-users] Pools for Full and Incremental
Hello Petar
Restore Job is a sample job like JobDefs for restore all jobs.
When you run a restore job bacula will looks for the correct pool.
Is not necessary you be worried about it
Best regards
*Wanderlei Hüttel*
http://www.huttel.com.br
2017-03-20 8:23 GMT-03:00 Petar Kozić :
> Hi,
>
> I have one question.
>
> If I use in backup job two different pool
>
> Full Backup Pool = Full
> Incremental Backup Pool = Incremental
>
> Which pool statement I must use for restore Job ?
>
>
> Job {
> Name = "Restore_server"
> Type = Restore
> Client= client
> FileSet=“myfileset"
> Storage = File1
> Pool = ???
> Messages = Standard
> }
>
>
> Thanks.
>
> *—*
>
> *Petar Kozić*
> System Administrator
>
>
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Pools for Full and Incremental
Hi,
I have one question.
If I use in backup job two different pool
Full Backup Pool = Full
Incremental Backup Pool = Incremental
Which pool statement I must use for restore Job ?
Job {
Name = "Restore_server"
Type = Restore
Client= client
FileSet=“myfileset"
Storage = File1
Pool = ???
Messages = Standard
}
Thanks.
*—*
*Petar Kozić*
System Administrator
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula in the cloud
Hello Daniele, It has been released in the Enterprise addition at the end of February. As I reported in my last status report (see www.bacula.org), I am now backporting the changes from the Enterprise version. All the new Enterprise SD plugins will not be available in the first community version with the backport. I am planning to release the Aligned Volumes plugin first then a couple of months later release the Cloud plugin. I have given a rough date for the backport, but since I am "retired" deadlines are now out the window (i.e. I avoid deadlines). The Oct/Nov time frame is probably reasonable ... Best regards, Kern On 03/20/2017 03:18 AM, Daniele Palumbo wrote: > Hi Kern, > > News about it? > > Thanks, > Daniele > >> Il giorno 18 ott 2016, alle ore 14:13, Kern Sibbald ha >> scritto: >> >> Hello, >> >> Bacula Systems has a White Paper on Bacula Enterprise Edition in the >> cloud, and they have given me permission to publish it. However, as it >> is currently written for Bacula Enterprise customers it needs some >> modification, which I will make over the next week or so then release it. >> >> It discusses a number of different ways that Bacula can work with the >> cloud, so you all might find it very interesting. Obviously one of the >> current limitations for most people (like me) who do not have a big >> budget for high-speed fiber optic Internet connections is the upload >> speed. I have spent a lot of time thinking about this, and I think >> there are a number of very interesting solutions that will become >> available in the near future. >> >> Best regards, >> Kern >> >> On 10/18/2016 01:45 PM, Josh Fisher wrote: >>> On 10/18/2016 3:42 AM, Uwe Schuerkamp wrote: Hello Jason, On Mon, Oct 17, 2016 at 09:37:12PM -0500, Jason Voorhees wrote: > Hello guys: > > Based on your experience, what alternative do we have for backing up > information to the cloud preferably using Bacula? > I wrote a script a while ago that runs as a RunAfterJob element which encrypts (gpg) and copies a full backup of a client (or its disk volume rather) to an S3 bucket using the aws shell client. It's still very rudimentary but it does the job nicely when it comes to keeping a full backup safe (and secure) from a local disaster. I seem to recall "cloud support" (whatever that may mean in today's buzzword bingo) was announced for Bacula 8. >>> I tend to think that will be targeting local cloud storage, for example >>> ownCloud, in enterprise environments. I'm not sure something like S3 is >>> very useful for direct backup storage over the Internet. A 1 TB backup >>> over a 100 Mbps connection would take a minimum of 22+ hours, assuming >>> maximum throughput and that S3 could actually sustain 12.5 MB/s. >>> >>> For S3, copying via a script seems the best way to go. >>> All the best, Uwe >>> -- >>> Check out the vibrant tech community on one of the world's most >>> engaging tech sites, SlashDot.org! http://sdm.link/slashdot >>> ___ >>> Bacula-users mailing list >>> Bacula-users@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/bacula-users >>> >> >> -- >> Check out the vibrant tech community on one of the world's most >> engaging tech sites, SlashDot.org! http://sdm.link/slashdot >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
