Hi all, I'm setting up Maui for the first time (in the hopes of working around a problem I had with pbs_sched <http://www.supercluster.org/pipermail/torqueusers/2013-October/016338.html>).
I would like to be able to submit a job that requests multiple nodes and have it run on multiple nodes regardless of the state of the cluster. The behavior that I am seeing right now (I have tried the MINRESOURCE and MAXBALANCE node allocation policies) is that if there are enough free processors on one node (to satisfy the number of nodes requested multiplied by the number or processors per node) the job is run only on that node. It is only split between nodes when there are not enough processors on any one node to fill the request. This behavior seems reasonable, even desirable, in many situations. However, I have users who would like to test multi-node code so would like a guarantee that their job will be allocated multiple nodes. Is it possible to control this allocation behavior? Thanks in advance, Jack Maui config: # maui.cfg 3.3.1 SERVERHOST drut-dev # primary admin must be first in list ADMIN1 root # Resource Manager Definition RMCFG[DRUT-DEV] TYPE=PBS # Allocation Manager Definition AMCFG[bank] TYPE=NONE # full parameter docs at http://supercluster.org/mauidocs/a.fparameters.html # use the 'schedctl -l' command to display current configuration RMPOLLINTERVAL 00:00:30 SERVERPORT 42559 SERVERMODE NORMAL # Admin: http://supercluster.org/mauidocs/a.esecurity.html LOGFILE maui.log LOGFILEMAXSIZE 10000000 LOGLEVEL 3 # Job Priority: http://supercluster.org/mauidocs/5.1jobprioritization.html QUEUETIMEWEIGHT 1 # FairShare: http://supercluster.org/mauidocs/6.3fairshare.html #FSPOLICY PSDEDICATED #FSDEPTH 7 #FSINTERVAL 86400 #FSDECAY 0.80 # Throttling Policies: http://supercluster.org/mauidocs/6.2throttlingpolicies.html # NONE SPECIFIED # Backfill: http://supercluster.org/mauidocs/8.2backfill.html BACKFILLPOLICY FIRSTFIT RESERVATIONPOLICY CURRENTHIGHEST # Node Allocation: http://supercluster.org/mauidocs/5.2nodeallocation.html #NODEALLOCATIONPOLICY MINRESOURCE NODEALLOCATIONPOLICY MAXBALANCE # QOS: http://supercluster.org/mauidocs/7.3qos.html # QOSCFG[hi] PRIORITY=100 XFTARGET=100 FLAGS=PREEMPTOR:IGNMAXJOB # QOSCFG[low] PRIORITY=-1000 FLAGS=PREEMPTEE # Standing Reservations: http://supercluster.org/mauidocs/7.1.3standingreservations.html # SRSTARTTIME[test] 8:00:00 # SRENDTIME[test] 17:00:00 # SRDAYS[test] MON TUE WED THU FRI # SRTASKCOUNT[test] 20 # SRMAXTIME[test] 0:30:00 # Creds: http://supercluster.org/mauidocs/6.1fairnessoverview.html # USERCFG[DEFAULT] FSTARGET=25.0 # USERCFG[john] PRIORITY=100 FSTARGET=10.0- # GROUPCFG[staff] PRIORITY=1000 QLIST=hi:low QDEF=hi # CLASSCFG[batch] FLAGS=PREEMPTEE # CLASSCFG[interactive] FLAGS=PREEMPTOR torque config: # # Create queues and set their attributes. # # # Create and define queue test # create queue test set queue test queue_type = Execution set queue test resources_default.nodes = 1 set queue test resources_default.walltime = 01:00:00 set queue test enabled = True set queue test started = True # # Create and define queue batch # create queue batch set queue batch queue_type = Execution set queue batch resources_default.nodes = 1 set queue batch resources_default.walltime = 01:00:00 set queue batch enabled = True set queue batch started = True # # Set server attributes. # set server scheduling = True set server acl_hosts = drut-dev-private set server acl_hosts += drut-dev set server managers = r...@drut-dev.physics.unc.edu set server managers += root@drut-dev-private set server operators = r...@drut-dev.physics.unc.edu set server operators += root@drut-dev-private set server default_queue = batch set server log_events = 511 set server mail_from = drut-dev-torq...@physics.unc.edu set server scheduler_iteration = 600 set server node_check_rate = 150 set server tcp_timeout = 300 set server node_pack = True set server job_stat_rate = 45 set server poll_jobs = True set server mom_job_sync = True set server keep_completed = 300 set server next_job_number = 179 set server moab_array_compatible = True _______________________________________________ mauiusers mailing list mauiusers@supercluster.org http://www.supercluster.org/mailman/listinfo/mauiusers
