Try this (typed in editor, not tested!):
#! /usr/bin/perl -w
use strict;
use warnings;
use FindBin;
# Specify the path to the prolog.
my $prolog = '--task-prolog=/gpfsm/YYYY/XXXX.task.prolog';
# Build the path to the SLURM srun command.
my $srun_slurm = "${FindBin::Bin}/srun.slurm";
# Add the prolog option, but abort if the user specifies a prolog option.
my @command = split(/ /, "$srun_slurm $prolog");
foreach (@ARGV) {
if (/^--task-prolog=/) {
print("The --task-prolog option is unsupported at ZZZZ. Please " .
"contact the QQQQ for assistance.\n");
exit(1);
} else {
push(@command, $_);
}
}
system(@command);
On Sep 4, 2014, at 1:21 PM, Matt Thompson <fort...@gmail.com> wrote:
> Jeff,
>
> Here is the script (with a bit of munging for safety's sake):
>
> #! /usr/bin/perl -w
>
> use strict;
> use warnings;
>
> use FindBin;
>
> # Specify the path to the prolog.
> my $prolog = '--task-prolog=/gpfsm/YYYY/XXXX.task.prolog';
>
> # Build the path to the SLURM srun command.
> my $srun_slurm = "${FindBin::Bin}/srun.slurm";
>
> # Add the prolog option, but abort if the user specifies a prolog option.
> my $command = "$srun_slurm $prolog";
> foreach (@ARGV) {
> if (/^--task-prolog=/) {
> print("The --task-prolog option is unsupported at ZZZZ. Please " .
> "contact the QQQQ for assistance.\n");
> exit(1);
> } else {
> $command .= " $_";
> }
> }
> system($command);
>
> Ideas?
>
>
>
> On Thu, Sep 4, 2014 at 10:51 AM, Ralph Castain <r...@open-mpi.org> wrote:
> Still begs the bigger question, though, as others have used script wrappers
> before - and I'm not sure we (OMPI) want to be in the business of dictating
> the scripting language they can use. :-)
>
> Jeff and I will argue that one out
>
>
> On Sep 4, 2014, at 7:38 AM, Jeff Squyres (jsquyres) <jsquy...@cisco.com>
> wrote:
>
>> Ah, if it's perl, it might be easy. It might just be the difference between
>> system("...string...") and system(@argv).
>>
>> Sent from my phone. No type good.
>>
>> On Sep 4, 2014, at 8:35 AM, "Matt Thompson" <fort...@gmail.com> wrote:
>>
>>> Jeff,
>>>
>>> I actually misspoke earlier. It turns out our srun is a *Perl* script
>>> around the SLURM srun. I'll speak with our admins to see if they can
>>> massage the script to not interpret the arguments. If possible, I'll ask
>>> them if I can share the script with you (privately or on the list) and
>>> maybe you can see how it is affecting Open MPI's argument passage.
>>>
>>> Matt
>>>
>>>
>>> On Thu, Sep 4, 2014 at 8:04 AM, Jeff Squyres (jsquyres)
>>> <jsquy...@cisco.com> wrote:
>>> On Sep 3, 2014, at 9:27 AM, Matt Thompson <fort...@gmail.com> wrote:
>>>
>>> > Just saw this, sorry. Our srun is indeed a shell script. It seems to be a
>>> > wrapper around the regular srun that runs a --task-prolog. What it
>>> > does...that's beyond my ken, but I could ask. My guess is that it
>>> > probably does something that helps keep our old PBS scripts running (sets
>>> > $PBS_NODEFILE, say). We used to run PBS but switched to SLURM recently.
>>> > The admins would, of course, prefer all future scripts be SLURM-native
>>> > scripts, but there are a lot of production runs that uses many, many PBS
>>> > scripts. Converting that would need slow, careful QC to make sure any
>>> > "pure SLURM" versions act as expected.
>>>
>>> Ralph and I haven't had a chance to discuss this in detail yet, but I have
>>> thought about this quite a bit.
>>>
>>> What is happening is that one of the $argv OMPI passes is of the form
>>> "foo;bar". Your srun script is interpreting the ";" as the end of the
>>> command the the "bar" as the beginning of a new command, and mayhem ensues.
>>>
>>> Basically, your srun script is violating what should be a very safe
>>> assumption: that the $argv we pass to it will not be interpreted by a
>>> shell. Put differently: your "srun" script behaves differently than
>>> SLURM's "srun" executable. This violates OMPI's expectations of how srun
>>> should behave.
>>>
>>> My $0.02 is that if we "fix" this in OMPI, we're effectively penalizing all
>>> other SLURM installations out there that *don't* violate this assumption
>>> (i.e., all of them). Ralph may disagree with me on this point, BTW -- like
>>> I said, we haven't talked about this in detail since Tuesday. :-)
>>>
>>> So here's my question: is there any chance you can change your "srun"
>>> script to a script language that doesn't recombine $argv? This is a common
>>> problem, actually -- sh/csh/etc. script languages tend to recombine $argv,
>>> but other languages such as perl and python do not (e.g.,
>>> http://stackoverflow.com/questions/6981533/how-to-preserve-single-and-double-quotes-in-shell-script-arguments-without-the-a).
>>>
>>> --
>>> Jeff Squyres
>>> jsquy...@cisco.com
>>> For corporate legal information go to:
>>> http://www.cisco.com/web/about/doing_business/legal/cri/
>>>
>>> _______________________________________________
>>> users mailing list
>>> us...@open-mpi.org
>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
>>> Link to this post:
>>> http://www.open-mpi.org/community/lists/users/2014/09/25263.php
>>>
>>>
>>>
>>> --
>>> "And, isn't sanity really just a one-trick pony anyway? I mean all you
>>> get is one trick: rational thinking. But when you're good and crazy,
>>> oooh, oooh, oooh, the sky is the limit!" -- The Tick
>>>
>>> _______________________________________________
>>> users mailing list
>>> us...@open-mpi.org
>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
>>> Link to this post:
>>> http://www.open-mpi.org/community/lists/users/2014/09/25264.php
>> _______________________________________________
>> users mailing list
>> us...@open-mpi.org
>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
>> Link to this post:
>> http://www.open-mpi.org/community/lists/users/2014/09/25269.php
>
>
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post:
> http://www.open-mpi.org/community/lists/users/2014/09/25270.php
>
>
>
> --
> "And, isn't sanity really just a one-trick pony anyway? I mean all you
> get is one trick: rational thinking. But when you're good and crazy,
> oooh, oooh, oooh, the sky is the limit!" -- The Tick
>
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post:
> http://www.open-mpi.org/community/lists/users/2014/09/25272.php
--
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to:
http://www.cisco.com/web/about/doing_business/legal/cri/
