On 13 December 2011 15:25, Lars van der bijl <[email protected]> wrote: > Hey everyone, > > we have been running our sge for a while now but we implemented a new > technique and I'm having trouble figuring out how to make the grid > help with it. > > I have the following task / dependency structure. > > task1 > > task2_seed_0 = dependent on output of task1 > task2_seed_1 = dependent on output of task1 > task2_seed_2 = dependent on output of task1 > task2_seed_3 = dependent on output of task1 > > joiner = dependent on output of seed tasks. > > all of these are Parallel environments with a range from 1-100 and a batch of > 1 Parallel environments? Do you mean array jobs?
> > now what I would like to happen is that the Grid finishes doing the > first batch of task 1. > then all 4 of the task2 will get there first batch started. > > what's currently happening is that sge tries to schedule and finish > all of task2_seed_0 before moving on to the task2_seed_1. What commands are you using to submit them? > > anyone have a idea on how to get this behaviour? If I'm interpreting you correctly you want want to use something like qsub -N task1 -t 100 script1 qsub -N task2_seed_0 -t 100 -hold_jid_ad task1 script2 qsub -N task2_seed_1 -t 100 -hold_jid_ad task1 script3 qsub -N task2_seed_2 -t 100 -hold_jid_ad task1 script4 qsub -N task2_seed_3 -t 100 -hold_jid_ad task1 script5 qsub -N joiner -t 100 -hold_jid_ad task2_seed_0,task2_seed_1,task2_seed_2,task2_seed_3 script6 Assuming in each case the script contains any other necessary options. > > Lars > _______________________________________________ > users mailing list > [email protected] > https://gridengine.org/mailman/listinfo/users > > _______________________________________________ users mailing list [email protected] https://gridengine.org/mailman/listinfo/users
