Re: [Bacula-users] Question about Priorities and Maximum Concurrent Jobs
John Lockard jlock...@umich.edu writes: But, priority also postpones any jobs of higher priority. If a job, of priority 20 is currently running and you start off several other jobs, with priorities of 10, 20 and 30, then the only jobs which will run concurrently will be the jobs of priority 20. Once all the priority 20 jobs are complete, only then will jobs of other priorities be examined and run. In my example, after all of the P-20 jobs run, the P-10 jobs will run, followed by the P-30 jobs. see the Allow Mixed Priority parameter, this lifts the restriction somewhat. I'd use scheduling to do prioritisation instead, though. a single second or minute is enough. e.g., first schedule all Full jobs to run at 23:00, then all Differential jobs at 23:01, and finally all Incrementals at 23:02. of course they won't actually start at that time, they'll just be put in the queue, but this way you can order the jobs however you like. -- Kjetil T. Homme Redpill Linpro AS - Changing the game -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about Priorities and Maximum Concurrent Jobs
On Sat, Mar 21, 2009 at 05:10:09AM -0700, Kevin Keane wrote: John Lockard wrote: The minimum setting I have on Max Concurrent Jobs is on the Tape Library and that's set to 3. It appears that priority trumps all, unless the priority is the same or better. So, if I have one job that has priority of, say, 10, then any job running on any other tape drive or virtual library will sit and wait till that higher priority job to finish before they'll begin. This also makes priority mostly useless for me as well. I guess it would take care of situations where I'd want one job to finish before a secondary or tertiary job starts, but then I run the risk of another job postponing the 2nd and 3rd job, which wouldn't be my intention I notice in the bacula sample configuration that priority is used to make sure the catalog backup always runs last. In that case, the behavior you describe (any other job postpones the lower-priority one, regardless of storage or pool) is exactly the desired behavior. But, priority also postpones any jobs of higher priority. If a job, of priority 20 is currently running and you start off several other jobs, with priorities of 10, 20 and 30, then the only jobs which will run concurrently will be the jobs of priority 20. Once all the priority 20 jobs are complete, only then will jobs of other priorities be examined and run. In my example, after all of the P-20 jobs run, the P-10 jobs will run, followed by the P-30 jobs. It seems to me that priority is running as described in the manual, but it runs counter to how you would logically expect. If I'm running a P-20 job, and storage devices are available, I would expect that jobs of P-20 would also be able to run, rather than having to wait till *all* of the queued P-20 jobs are finished. -John -- Brain: Pinky, Are you pondering what I'm pondering? Pinky: I think so Brain, but if we get Sam spayed, we won't be able to have puppies, will we? --- John M. Lockard | U of Michigan - School of Information Unix and Security Admin | 1214 SI North - 1075 Beal Ave. jlock...@umich.edu |Ann Arbor, MI 48109-2112 www.umich.edu/~jlockard | 734-615-8776 | 734-647-8045 FAX --- -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about Priorities and Maximum Concurrent Jobs
John Lockard wrote: The minimum setting I have on Max Concurrent Jobs is on the Tape Library and that's set to 3. It appears that priority trumps all, unless the priority is the same or better. So, if I have one job that has priority of, say, 10, then any job running on any other tape drive or virtual library will sit and wait till that higher priority job to finish before they'll begin. This also makes priority mostly useless for me as well. I guess it would take care of situations where I'd want one job to finish before a secondary or tertiary job starts, but then I run the risk of another job postponing the 2nd and 3rd job, which wouldn't be my intention I notice in the bacula sample configuration that priority is used to make sure the catalog backup always runs last. In that case, the behavior you describe (any other job postpones the lower-priority one, regardless of storage or pool) is exactly the desired behavior. -- Kevin Keane Owner The NetTech Find the Uncommon: Expert Solutions for a Network You Never Have to Think About Office: 866-642-7116 http://www.4nettech.com This e-mail and attachments, if any, may contain confidential and/or proprietary information. Please be advised that the unauthorized use or disclosure of the information is strictly prohibited. The information herein is intended only for use by the intended recipient(s) named above. If you have received this transmission in error, please notify the sender immediately and permanently delete the e-mail and any copies, printouts or attachments thereof. -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Question about Priorities and Maximum Concurrent Jobs
Hi All, I have a mix of disk and tape backups. To disk I allow up to 20 jobs run concurrently. On my tape library I have 3 tape drives, so only allow a max of 3 jobs to run concurrently. I run Full backups once a month, Differentials once a week and incrementals most days of the week. I would prefer to give preference to a Full backup over a Diff or Incr and I'd like to give preference to a Diff over an Incr. So... I set: Full backups to have a priority of 30 Differential backups to have a priority of 40 Incremental backups to have a priority of 50 I figured that since I had concurrency setup with my Max Concurrent Jobs setting that this would happen... If there was a fight for a medium, with no other medium currently free, that a Full would have preference to the medium over a Differential which would have preference over an Incremental. What I'm seeing is that if a Full is running on a certain type of storage, only other Fulls will run on that storage. If a full is running on one type of storage, other jobs (Diffs and Incrs) will run on the other types of storage. So, if I have a Full running to disk storage #1, then an Incr will run to disk storage #2, but not #1. For disk storage I mostly understand this. This really becomes a problem for tape storage. I would like to be able to run backups on the other 2 tape drives in my library when a Full backup is running. I have several large, slow servers which take upwards of 36 hours to backup and during this time I can't backup anything of a lower Priority than that system which I'm currently backing up. Do I have to entirely can (forget) the notion of job Priorities except in the cases where I absolutely want a certain job to have exclusive rights to a backup medium? Thanks, in advance for all the help, -John -- We have Enough Youth, How About A Fountain Of Smart? --- John M. Lockard | U of Michigan - School of Information Unix and Security Admin | 1214 SI North - 1075 Beal Ave. jlock...@umich.edu |Ann Arbor, MI 48109-2112 www.umich.edu/~jlockard | 734-615-8776 | 734-647-8045 FAX --- -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about Priorities and Maximum Concurrent Jobs
I stand somewhat corrected. I was wrong in stating that priority of a job on a certain media blocked only jobs on that media. It actually blocks all other lower priority jobs from running no matter whether the lower priority job is on the same media or not. -John On Fri, Mar 20, 2009 at 10:04:48AM -0400, John Lockard wrote: Hi All, I have a mix of disk and tape backups. To disk I allow up to 20 jobs run concurrently. On my tape library I have 3 tape drives, so only allow a max of 3 jobs to run concurrently. I run Full backups once a month, Differentials once a week and incrementals most days of the week. I would prefer to give preference to a Full backup over a Diff or Incr and I'd like to give preference to a Diff over an Incr. So... I set: Full backups to have a priority of 30 Differential backups to have a priority of 40 Incremental backups to have a priority of 50 I figured that since I had concurrency setup with my Max Concurrent Jobs setting that this would happen... If there was a fight for a medium, with no other medium currently free, that a Full would have preference to the medium over a Differential which would have preference over an Incremental. What I'm seeing is that if a Full is running on a certain type of storage, only other Fulls will run on that storage. If a full is running on one type of storage, other jobs (Diffs and Incrs) will run on the other types of storage. So, if I have a Full running to disk storage #1, then an Incr will run to disk storage #2, but not #1. For disk storage I mostly understand this. This really becomes a problem for tape storage. I would like to be able to run backups on the other 2 tape drives in my library when a Full backup is running. I have several large, slow servers which take upwards of 36 hours to backup and during this time I can't backup anything of a lower Priority than that system which I'm currently backing up. Do I have to entirely can (forget) the notion of job Priorities except in the cases where I absolutely want a certain job to have exclusive rights to a backup medium? Thanks, in advance for all the help, -John -- We have Enough Youth, How About A Fountain Of Smart? --- John M. Lockard | U of Michigan - School of Information Unix and Security Admin | 1214 SI North - 1075 Beal Ave. jlock...@umich.edu |Ann Arbor, MI 48109-2112 www.umich.edu/~jlockard | 734-615-8776 | 734-647-8045 FAX --- -- Time and time and time again, you wake up screaming and you wake up dead. - RevCo --- John M. Lockard | U of Michigan - School of Information Unix and Security Admin | 1214 SI North - 1075 Beal Ave. jlock...@umich.edu |Ann Arbor, MI 48109-2112 www.umich.edu/~jlockard | 734-615-8776 | 734-647-8045 FAX --- -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about Priorities and Maximum Concurrent Jobs
I stand somewhat corrected. I was wrong in stating that priority of a job on a certain media blocked only jobs on that media. It actually blocks all other lower priority jobs from running no matter whether the lower priority job is on the same media or not. I find this makes priorities not that useful for me. Have you thought of using concurrency and a small (2 to 5GB) spool file and scrap the priorities. I am unsure why you only want 1 job per tape drive. Are your drives really slow such that 1 client backup will be faster than the tape can handle? John -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Question about Priorities and Maximum Concurrent Jobs
The minimum setting I have on Max Concurrent Jobs is on the Tape Library and that's set to 3. It appears that priority trumps all, unless the priority is the same or better. So, if I have one job that has priority of, say, 10, then any job running on any other tape drive or virtual library will sit and wait till that higher priority job to finish before they'll begin. This also makes priority mostly useless for me as well. I guess it would take care of situations where I'd want one job to finish before a secondary or tertiary job starts, but then I run the risk of another job postponing the 2nd and 3rd job, which wouldn't be my intention. -John On Fri, Mar 20, 2009 at 02:16:03PM -0400, John Drescher wrote: I find this makes priorities not that useful for me. Have you thought of using concurrency and a small (2 to 5GB) spool file and scrap the priorities. I am unsure why you only want 1 job per tape drive. Are your drives really slow such that 1 client backup will be faster than the tape can handle? John -- ACTION: None of the violence you are about to see was simulated. People were actually injured for your entertainment. - SciFi program intro --- John M. Lockard | U of Michigan - School of Information Unix and Security Admin | 1214 SI North - 1075 Beal Ave. jlock...@umich.edu |Ann Arbor, MI 48109-2112 www.umich.edu/~jlockard | 734-615-8776 | 734-647-8045 FAX --- -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
