[Bacula-users] despooling data
I'm spooling data before it gets written to tape, and I run multiple jobs at the same time. My spool size is smaller than a single tape size, so I have to flush the spool pretty often. Because of this each tape can have a little bit of each job on it. My question is that if I create a spool device that is larger than all my backup data combined, when it comes time to despool the data, will bacula despool each job one at a time, or will it despool the content as it came in, all at once? Basically I'm trying to figure out a way that I can run all my jobs at once, but the content gets written to tape one job at a time to prevent having to use 4 different tapes to do a restore. -- Jesse Keating GameHouse -- Systems Engineer --- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] despooling data
On Monday 22 August 2005 23:07, Jesse Keating wrote: > I'm spooling data before it gets written to tape, and I run multiple > jobs at the same time. My spool size is smaller than a single tape > size, so I have to flush the spool pretty often. Because of this each > tape can have a little bit of each job on it. My question is that if I > create a spool device that is larger than all my backup data combined, > when it comes time to despool the data, will bacula despool each job one > at a time, or will it despool the content as it came in, all at once? > Basically I'm trying to figure out a way that I can run all my jobs at > once, but the content gets written to tape one job at a time to prevent > having to use 4 different tapes to do a restore. Multiple jobs may simultaneously spool, but only one job despools at a time all other jobs that are spooling continue spooling, all other jobs that want to despool wait their turn. -- Best regards, Kern ("> /\ V_V --- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] despooling data
On Tue, 2005-08-23 at 09:30 +0200, Kern Sibbald wrote: > > Multiple jobs may simultaneously spool, but only one job despools at a time > all other jobs that are spooling continue spooling, all other jobs that want > to despool wait their turn. This is only true if the spool is larger than all the jobs combined right? If the spool size is smaller than the sum of all the jobs the despooling will do each job that is in the spool, but the continue spooling from each server, so the data gets mixed. Is this correct? -- Jesse Keating GameHouse -- Systems Engineer --- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] despooling data
On Tuesday 23 August 2005 18:47, Jesse Keating wrote: > On Tue, 2005-08-23 at 09:30 +0200, Kern Sibbald wrote: > > Multiple jobs may simultaneously spool, but only one job despools at a > > time all other jobs that are spooling continue spooling, all other jobs > > that want to despool wait their turn. > > This is only true if the spool is larger than all the jobs combined > right? > If the spool size is smaller than the sum of all the jobs the > despooling will do each job that is in the spool, but the continue > spooling from each server, so the data gets mixed. I can't quite figure out the above sentence. > Is this correct? What I wrote is correct. However, if the spool file fills all the jobs spooling will stop and one will begin despooling (assuming that one is not already despooling). Once the despooling of the first job is done, it will begin spooling again, I'm not sure what happens to the other jobs. I suspect that each of the jobs that got caught with a full spool file will despool one by one, because once they decide to despool they never recheck the spool space, but you would have to look at the code to be sure. -- Best regards, Kern ("> /\ V_V --- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] despooling data
On Tue, 2005-08-23 at 18:59 +0200, Kern Sibbald wrote: > I can't quite figure out the above sentence. Ok, I'll try to rephrase. My current spool size is 60gigs. My tape size is 100gigs uncompressed, and my total backup job size for all my servers is roughly 350gigs. When backups start, all my servers start sending data to the spool at once. This fills the spool quickly and then it despools. It seems in my situation, it will despool everything that had been spooled up to that point, so parts of all the backup jobs running. Because of this, I wind up with each tape having data from 4~5 different jobs on it, but no complete job. The next tape will have another part of that 4~5 different jobs, and so on. > > > Is this correct? > > What I wrote is correct. However, if the spool file fills all the jobs > spooling will stop and one will begin despooling (assuming that one is not > already despooling). Once the despooling of the first job is done, it will > begin spooling again, I'm not sure what happens to the other jobs. I suspect > that each of the jobs that got caught with a full spool file will despool one > by one, because once they decide to despool they never recheck the spool > space, but you would have to look at the code to be sure. Ok, I think you've answered my real question though, if I create a spool size that is say 500gigs, all my jobs can complete before the spool fills up, and then they will despool one at a time so that I can hopefully get complete jobs on single tapes rather than spread across 4 tapes. -- Jesse Keating GameHouse -- Systems Engineer --- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users