Re: [Bacula-users] backup to multiple disks

2013-05-28 Thread Dimitri Maziuk
On 05/28/2013 04:05 PM, Josh Fisher wrote: > ... > The point is to allow multiple jobs to run in parallel, even when all > jobs are writing to the save bacula-dir.conf Device ... Well, it still doesn't make much sense to me, but whatever, clearly it's not what I'm looking for. > For removable d

Re: [Bacula-users] backup to multiple disks

2013-05-28 Thread Josh Fisher
On 5/28/2013 3:09 PM, Dimitri Maziuk wrote: > On 05/28/2013 01:41 PM, Kern Sibbald wrote: >> I am wondering why and how you come up with ideas >> that don't correspond to what Bacula actually does. > Perhaps because all I know about what Bacula actually does is what I > read in the manual. (Don't

Re: [Bacula-users] backup to multiple disks

2013-05-28 Thread Kern Sibbald
Sorry, I am off on vacation now for several weeks. I am sure the list can help you. A Bacula device does not hold Volumes rather it can "mount" (use) every Volume one at a time in the Archive Device directory you specify. The number is limited only by the number of files the filesystem permits a

Re: [Bacula-users] backup to multiple disks

2013-05-28 Thread Dimitri Maziuk
On 05/28/2013 01:41 PM, Kern Sibbald wrote: > I am wondering why and how you come up with ideas > that don't correspond to what Bacula actually does. Perhaps because all I know about what Bacula actually does is what I read in the manual. (Don't get me wrong, it's no worse than the manuals I write

Re: [Bacula-users] backup to multiple disks

2013-05-28 Thread Kern Sibbald
I am wondering why and how you come up with ideas that don't correspond to what Bacula actually does. It is very unfortunate, because it seems that this is causing you lots of problems you should not have. Every Device resource that is referenced by a virtual Autochanger resource in bacula-sd.con

Re: [Bacula-users] backup to multiple disks

2013-05-28 Thread Dimitri Maziuk
On 05/27/2013 03:43 AM, Radosław Korzeniewski wrote: ... If you will use Bacula Autochanger then you can get > automatic Bacula Device selection. That's exactly the problem: "virtual autochanger" as described by Kern automatically selects the first Device and stops there. It doesn't *change* Devi

Re: [Bacula-users] backup to multiple disks

2013-05-27 Thread Dimitri Maziuk
On 05/27/2013 11:42 AM, John Drescher wrote: >>> Your requirements are not common. So, most people on the list tried to >>> entourage a common best practices. >> >> I suspect they soon will be as a cheap 3TB SATA HDD already costs as >> much as 2.5TB LTO-6 tape. > > For that I would still go tape.

Re: [Bacula-users] backup to multiple disks

2013-05-27 Thread John Drescher
>> Your requirements are not common. So, most people on the list tried to >> entourage a common best practices. > > I suspect they soon will be as a cheap 3TB SATA HDD already costs as > much as 2.5TB LTO-6 tape. For that I would still go tape. A LTO tape has bit error rates of 1 bit in 10^17 and

Re: [Bacula-users] backup to multiple disks

2013-05-27 Thread Dimitri Maziuk
On 2013-05-27 03:43, Radosław Korzeniewski wrote: > Your requirements are not common. So, most people on the list tried to > entourage a common best practices. I suspect they soon will be as a cheap 3TB SATA HDD already costs as much as 2.5TB LTO-6 tape. Dimitri --

Re: [Bacula-users] backup to multiple disks

2013-05-27 Thread Radosław Korzeniewski
Hello, 2013/5/24 Dimitri Maziuk > > Frankly, I fail to make any sense of all this: if you have your disks > concatenated into a raid or lvm, why would you then list them in separate > Device sections grouped into an Autochanger? Because one Bacula Device can handle only one Bacula volume at a

Re: [Bacula-users] backup to multiple disks

2013-05-24 Thread Dimitri Maziuk
On 2013-05-24 00:42, Radosław Korzeniewski wrote: > No. This solution was first proposed by me in this thread with a mail > from 3 May 2013 17:04. Then Kern (a week later) was suggested that it is > a good solution too. It will require some kind of RAID or LVM for proper > work. AFAIR You rejected

Re: [Bacula-users] backup to multiple disks

2013-05-23 Thread Radosław Korzeniewski
Hello, 2013/5/24 Dimitri Maziuk > On 05/10/2013 07:31 AM, John Drescher wrote: > >> I am a bit surprised that no one mentioned Bacula's built-in virtual > >> autochanger feature that has been there for years. The syntax for > >> enabling it is a bit of a "kludge" in my opinion, but it is the w

Re: [Bacula-users] backup to multiple disks

2013-05-23 Thread Radosław Korzeniewski
Hello Kern, 2013/5/10 Kern Sibbald > > I am a bit surprised that no one mentioned Bacula's built-in virtual > autochanger feature that has been there for years. The syntax for > enabling it is a bit of a "kludge" in my opinion, but it is the way > that Bacula > Systems is recommending to handl

Re: [Bacula-users] backup to multiple disks

2013-05-23 Thread Dimitri Maziuk
On 05/10/2013 07:31 AM, John Drescher wrote: >> I am a bit surprised that no one mentioned Bacula's built-in virtual >> autochanger feature that has been there for years. The syntax for >> enabling it is a bit of a "kludge" in my opinion, but it is the way that >> Bacula >> Systems is recommendin

Re: [Bacula-users] backup to multiple disks

2013-05-12 Thread Kern Sibbald
Hello, In the context I was using the word "mount", you can replace it with "open". Concerning your other points, I think the best response is simply to try testing and find out what works and what does not work. How Autochangers (whether physical or virtual) work is fairly well documented. Best

Re: [Bacula-users] backup to multiple disks

2013-05-11 Thread Kern Sibbald
Hello Josh, Yes, you got it all exactly right. I am not afraid of complexity, but always start with the simplest concept that I can find. That means less code and more robust code at least in the beginning. Note, if you are reading, Bacula can and does sometimes switch drives. If you are writin

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Kern Sibbald
Yes, Media Type is very important. It must be in the Storage resources on the Director side, and notice that as I mentioned before, on the SD side, Autochanger really just groups a number of Devices. The Media Type must be in each Device, because each one can be different so it is not in the Auto

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Dimitri Maziuk
On 05/10/2013 02:09 AM, Kern Sibbald wrote: > In the bacula-dir.conf file, define the autochanger in > the normal way for a physical tape autochanger library. Does bacula-dir.conf side require "Media Type" and what should that be if does? Or do I omit "Media Type" and have "Autochanger = yes" ins

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Dimitri Maziuk
On 05/10/2013 10:10 AM, Kern Sibbald wrote: > On 05/10/2013 04:12 PM, Martin Simmons wrote: >> Can you indicate where the kludge is please? > Changer Command = "" > and > Changer Device = /dev/null RGHH!!! maybe I should have posted this > 1. Autochanger. > > Can I just omit the "Change

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Josh Fisher
On 5/10/2013 11:10 AM, Kern Sibbald wrote: > On 05/10/2013 04:12 PM, Martin Simmons wrote: > >> Can you indicate where the kludge is please? > Changer Command = "" > and > Changer Device = /dev/null Is this documented anywhere, out of curiosity? I don't think it is general knowledge. > I probabl

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Josh Fisher
On 5/10/2013 3:09 AM, Kern Sibbald wrote: > Hello John, > > vchanger gets the job done as does the "disk-changer" script in > Bacula, from which vchanger was derived (and extended) if > I remember right. The disk-changer script works fine, but we > use it only for "tape" regression testing with ou

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Kern Sibbald
On 05/10/2013 04:12 PM, Martin Simmons wrote: >> On Fri, 10 May 2013 09:09:39 +0200, Kern Sibbald said: >> I am a bit surprised that no one mentioned Bacula's built-in virtual >> autochanger feature that has been there for years. The syntax for >> enabling it is a bit of a "kludge" in my opin

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Martin Simmons
> On Fri, 10 May 2013 09:09:39 +0200, Kern Sibbald said: > > I am a bit surprised that no one mentioned Bacula's built-in virtual > autochanger feature that has been there for years. The syntax for > enabling it is a bit of a "kludge" in my opinion, but it is the way > that Bacula > Systems

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Kern Sibbald
On 05/10/2013 02:31 PM, John Drescher wrote: >> I am a bit surprised that no one mentioned Bacula's built-in virtual >> autochanger feature that has been there for years. The syntax for >> enabling it is a bit of a "kludge" in my opinion, but it is the way that >> Bacula >> Systems is recommendin

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread John Drescher
> I am a bit surprised that no one mentioned Bacula's built-in virtual > autochanger feature that has been there for years. The syntax for > enabling it is a bit of a "kludge" in my opinion, but it is the way that > Bacula > Systems is recommending to handle multiple disk backup. It's been in th

Re: [Bacula-users] backup to multiple disks

2013-05-10 Thread Kern Sibbald
Hello John, vchanger gets the job done as does the "disk-changer" script in Bacula, from which vchanger was derived (and extended) if I remember right. The disk-changer script works fine, but we use it only for "tape" regression testing with our Virtual Tape driver. I am a bit surprised that no

Re: [Bacula-users] backup to multiple disks: SUMMARY

2013-05-06 Thread Dimitri Maziuk
To sum up: Bacula itself is built with the assumption of one device per job (or pool). You can't "just" list multiple devices in the Storage (or Pool or whichever) section and have bacula fill each up in turn. Your options are: 1. Schedule individual jobs to specific disks. You can replace the di

Re: [Bacula-users] backup to multiple disks

2013-05-05 Thread Josh Fisher
On 5/3/2013 4:56 PM, Dimitri Maziuk wrote: > On 05/03/2013 02:53 PM, Josh Fisher wrote: > >> ... What you are >> considering would require a new device assignment each time a new volume >> is needed. While possible, it is way more complex that it appears at >> first glance. > PS. I think the potent

Re: [Bacula-users] backup to multiple disks

2013-05-04 Thread Dimitri Maziuk
On 5/4/2013 5:35 PM, Radosław Korzeniewski wrote: > What should be a purpose of this behavior? I didn't get a point. > > If you have a single tape library then if you get full on one device > then you get full on all devices in that library. No switching will help > in this case. Google for 'tape

Re: [Bacula-users] backup to multiple disks

2013-05-04 Thread Radosław Korzeniewski
Hello, 2013/5/3 Dimitri Maziuk > On 05/03/2013 10:04 AM, Radosław Korzeniewski wrote: > > >> I have a storage server with 12 SATA drives on an HBA. I want to backup > >> to those drives, using file volumes of 50GB or less. The idea is to > >> manually swap the drives as they get full. > >> > > >

Re: [Bacula-users] backup to multiple disks

2013-05-03 Thread John Drescher
On Fri, May 3, 2013 at 4:59 PM, John Drescher wrote: >> Fair enough. So what happens when a new volume is needed and there's no >> room on the current device? -- this is the point where you'd switch to >> the next device in the list and try again until you run out of devices. > > It returns volume

Re: [Bacula-users] backup to multiple disks

2013-05-03 Thread John Drescher
> Fair enough. So what happens when a new volume is needed and there's no > room on the current device? -- this is the point where you'd switch to > the next device in the list and try again until you run out of devices. It returns volume full and asks the user to label the next volume. John ---

Re: [Bacula-users] backup to multiple disks

2013-05-03 Thread Dimitri Maziuk
On 05/03/2013 02:53 PM, Josh Fisher wrote: > ... What you are > considering would require a new device assignment each time a new volume > is needed. While possible, it is way more complex that it appears at > first glance. PS. I think the potentially worse can of worms is when you have multip

Re: [Bacula-users] backup to multiple disks

2013-05-03 Thread Dimitri Maziuk
On 05/03/2013 02:53 PM, Josh Fisher wrote: > > On 5/3/2013 1:37 PM, Dimitri Maziuk wrote: >> Ideally one should be able to specify multiple Device's in the Storage >> and have bacula write to them in turn until all get full. A couple of >> extra "for" loops and another list is basically all it ta

Re: [Bacula-users] backup to multiple disks

2013-05-03 Thread Josh Fisher
On 5/3/2013 1:37 PM, Dimitri Maziuk wrote: > On 05/03/2013 10:04 AM, Radosław Korzeniewski wrote: > >>> I have a storage server with 12 SATA drives on an HBA. I want to backup >>> to those drives, using file volumes of 50GB or less. The idea is to >>> manually swap the drives as they get full. >>>

Re: [Bacula-users] backup to multiple disks

2013-05-03 Thread Dimitri Maziuk
On 05/03/2013 10:04 AM, Radosław Korzeniewski wrote: >> I have a storage server with 12 SATA drives on an HBA. I want to backup >> to those drives, using file volumes of 50GB or less. The idea is to >> manually swap the drives as they get full. >> > > Drop this idea. If you need to move your back

Re: [Bacula-users] backup to multiple disks

2013-05-03 Thread Radosław Korzeniewski
Hello, 2013/5/2 Dimitri Maziuk > Hi everyone, > > this must be a FAQ but neither TFM nor google are being very helpful... > > I have a storage server with 12 SATA drives on an HBA. I want to backup > to those drives, using file volumes of 50GB or less. The idea is to > manually swap the drives a

Re: [Bacula-users] backup to multiple disks

2013-05-02 Thread John Drescher
> ...Also with multiple independent storage devices you would have >> to manage and schedule your jobs to each device instead of sending all >> jobs to an autochanger resource and let bacula handle things. > > That's kinda what I meant "far from optimal", however, it looks like > this lets me write

Re: [Bacula-users] backup to multiple disks

2013-05-02 Thread Dimitri Maziuk
On 05/02/2013 02:44 PM, John Drescher wrote: ... A single job can never use more than > device. No, but I don't have a single job. ;) ...Also with multiple independent storage devices you would have > to manage and schedule your jobs to each device instead of sending all > jobs to an autochange

Re: [Bacula-users] backup to multiple disks

2013-05-02 Thread dweimer
On 05/02/2013 2:44 pm, John Drescher wrote: > Use the bacula vchanger to create a virtual disk autochanger. > > http://sourceforge.net/projects/vchanger/ > > Make each hard disk a virtual magazine with a set of fixed size > volumes. > > Yes, I saw the wiki page, thanks. I can't help thinking th

Re: [Bacula-users] backup to multiple disks

2013-05-02 Thread John Drescher
>> Use the bacula vchanger to create a virtual disk autochanger. >> >> http://sourceforge.net/projects/vchanger/ >> >> Make each hard disk a virtual magazine with a set of fixed size volumes. > > Yes, I saw the wiki page, thanks. I can't help thinking there's gotta be > a simpler way: vchanger is

Re: [Bacula-users] backup to multiple disks

2013-05-02 Thread Dimitri Maziuk
On 05/02/2013 12:59 PM, John Drescher wrote: > Use the bacula vchanger to create a virtual disk autochanger. > > http://sourceforge.net/projects/vchanger/ > > Make each hard disk a virtual magazine with a set of fixed size volumes. Yes, I saw the wiki page, thanks. I can't help thinking there's

Re: [Bacula-users] backup to multiple disks

2013-05-02 Thread John Drescher
On Thu, May 2, 2013 at 1:39 PM, Dimitri Maziuk wrote: > Hi everyone, > > this must be a FAQ but neither TFM nor google are being very helpful... > > I have a storage server with 12 SATA drives on an HBA. I want to backup > to those drives, using file volumes of 50GB or less. The idea is to > manua

[Bacula-users] backup to multiple disks

2013-05-02 Thread Dimitri Maziuk
Hi everyone, this must be a FAQ but neither TFM nor google are being very helpful... I have a storage server with 12 SATA drives on an HBA. I want to backup to those drives, using file volumes of 50GB or less. The idea is to manually swap the drives as they get full. I'm looking for the implemen

Re: [Bacula-users] Backup to multiple disks

2013-01-03 Thread f . staedler
Hi, > Does bacula allow me to backup the 20TB(in full initially) over the > 3TB drives and then do incremental backups swapping the disks as they > get full? while looking through many pages for my own problem i stumbled upon this howto and bookmarked it almost instantly: http://wiki.bacula.org

Re: [Bacula-users] Backup to multiple disks

2013-01-03 Thread John Drescher
On Thu, Jan 3, 2013 at 3:33 PM, Silas Moeckel wrote: > Yes and no you will want to use vchanger it's an add on and works > wonderfully. Pretty much it turn each drive into a virtual magazine. I second the bacula vchanger suggestion. http://sourceforge.net/projects/vchanger/ John -

Re: [Bacula-users] Backup to multiple disks

2013-01-03 Thread Silas Moeckel
Yes and no you will want to use vchanger it's an add on and works wonderfully. Pretty much it turn each drive into a virtual magazine. Silas On 1/3/2013 3:17 PM, amitlal...@gmail.com wrote: > Hi, > > Was looking for some advise as to whether bacula can help me. > > I currently have a 20TB san w

[Bacula-users] Backup to multiple disks

2013-01-03 Thread amitlalani
Hi, Was looking for some advise as to whether bacula can help me. I currently have a 20TB san which needs backing up. I also have a 1U machine with 4 hot swappable disk bays and a bunch of 3TB disks(10+) Does bacula allow me to backup the 20TB(in full initially) over the 3TB drives and then d