Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Richard Ems
Hi list again, something seems not be working as I *expect* it to be. Several jobs are waiting and are asking for a reservation, waiting for 12 slots to become free and are at the top of the priority list. Several other jobs with less priority and asking only for 4 slots get backfilled, but shou

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Daniel Gruber
Am 25.05.2012 um 12:35 schrieb Richard Ems: > On 05/25/2012 12:27 PM, Daniel Gruber wrote: >> Exactly, looks like your runtime estimation for your slot4 jobs >> is smaller than for your slot12 jobs. Backfilling must be active >> here. Did you submit both jobs in exactly the same way with >> s_r

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Richard Ems
On 05/25/2012 12:50 PM, William Hay wrote: >> But thinking more on it ... perhaps because the 3 jobs J[123]_4 - >> started on a 12 slots node N1 - got started at different times, the last >> one started could have been started *after* another job J4_12 running on >> 12 slots on node N2. >> So job J

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Richard Ems
On 05/25/2012 12:27 PM, Daniel Gruber wrote: > Exactly, looks like your runtime estimation for your slot4 jobs > is smaller than for your slot12 jobs. Backfilling must be active > here. Did you submit both jobs in exactly the same way with > s_rt? Try to set for your 4slot jobs the runtime higher

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Daniel Gruber
Exactly, looks like your runtime estimation for your slot4 jobs is smaller than for your slot12 jobs. Backfilling must be active here. Did you submit both jobs in exactly the same way with s_rt? Try to set for your 4slot jobs the runtime higher than for your 12slot jobs. Don't trust the defaul

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Richard Ems
On 05/25/2012 12:04 PM, William Hay wrote: > On 25 May 2012 10:31, Daniel Gruber wrote: >> The expected behavior would be that when there is >> never an host with 12 slots free, that your cluster >> will be filled up with 4 slot jobs, even when they have >> lower priorities. The reservation you ga

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Richard Ems
On 05/25/2012 11:51 AM, William Hay wrote: >> We have a group of nodes with 12 slots. >> We submit there parallel jobs requesting 4 or 12 slots. >> We defined 2 PEs allocating 4 or 12 slots and associated to that group >> of nodes in one queue. > What do you mean be PE allocating 4 or 12 slots. Yo

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread William Hay
On 25 May 2012 10:31, Daniel Gruber wrote: > The expected behavior would be that when there is > never an host with 12 slots free, that your cluster > will be filled up with 4 slot jobs, even when they have > lower priorities. The reservation you gave the 12 slot > jobs will be attached at the end

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Richard Ems
On 05/25/2012 11:31 AM, Daniel Gruber wrote: > The expected behavior would be that when there is > never an host with 12 slots free, that your cluster > will be filled up with 4 slot jobs, even when they have > lower priorities. The reservation you gave the 12 slot > jobs will be attached at the e

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread William Hay
On 25 May 2012 10:10, Richard Ems wrote: > Hi list, > > I searched through the mailing list and tried using google, but couldn't > found an answer to my question. > > The (simplified) situation: > > We have a group of nodes with 12 slots. > We submit there parallel jobs requesting 4 or 12 slots. >

Re: [gridengine users] Reservations and parallel environments

2012-05-25 Thread Daniel Gruber
The expected behavior would be that when there is never an host with 12 slots free, that your cluster will be filled up with 4 slot jobs, even when they have lower priorities. The reservation you gave the 12 slot jobs will be attached at the end of that year. Hence I would assume that your 12 slo

[gridengine users] Reservations and parallel environments

2012-05-25 Thread Richard Ems
Hi list, I searched through the mailing list and tried using google, but couldn't found an answer to my question. The (simplified) situation: We have a group of nodes with 12 slots. We submit there parallel jobs requesting 4 or 12 slots. We defined 2 PEs allocating 4 or 12 slots and associated t

Re: [gridengine users] Reservations

2011-04-06 Thread William Hay
Ah well I have a workaround I can implement for the medium term and we seem to have enough large jobs running that the lack of reservations shouldn't cause too much of a woreproblem for now. On 6 April 2011 08:51, Mark Dixon wrote: > On Tue, 5 Apr 2011, William Hay wrote: > ... >> The reservation

Re: [gridengine users] Reservations

2011-04-06 Thread Mark Dixon
On Tue, 5 Apr 2011, William Hay wrote: ... The reservations appear to be fine themselves but checking the schedule file it appears that queued jobs now make reservations after the outage even though they have plenty of time to run before it (I'm making the reservations this early because we hav

Re: [gridengine users] Reservations

2011-04-05 Thread William Hay
On 5 April 2011 11:33, Reuti wrote: > Hi, > > please don't crossposted. I think we have the gridengine.org as a place to > discuss common setups. > > Am 05.04.2011 um 11:56 schrieb William Hay: > >> We're planning an outage on our cluster for the 12th of this month. >> I've added reservations for

Re: [gridengine users] Reservations

2011-04-05 Thread Reuti
Hi, please don't crossposted. I think we have the gridengine.org as a place to discuss common setups. Am 05.04.2011 um 11:56 schrieb William Hay: > We're planning an outage on our cluster for the 12th of this month. > I've added reservations for each of the subclusters to ensure that > nothing

[gridengine users] Reservations

2011-04-05 Thread William Hay
We're planning an outage on our cluster for the 12th of this month. I've added reservations for each of the subclusters to ensure that nothing is running at that time. The command I use is something like qrsub -l mem=4G,job=true -a 04120800 -d 24:0:0 -pe '*-j' 256 where mem is a consumable resou