Re: Multiple processing compiling the same file

2018-01-31 Thread Faré
> I suspect this would be one binary for each permutation of the optimization > settings used times the number of top-level entry points. Right? That > number is > much larger than the number of /tmp directories I need just to automatically > compile before running. > No, use cl-launch/dispatch

Re: Multiple processing compiling the same file

2018-01-31 Thread Jim Newton
> >> For example,what if different hosts want to run the same source code but >> with different optimization settings? >> This is a real possibility, as some of my processes are running with >> profiling (debug 3) and collecting profiling results, >> and others are running super optimized (speed 3

Re: Multiple processing compiling the same file

2018-01-31 Thread Faré
>: Jim Newton > One difficulty about your build-then-deliver suggestion is that my local > machine is running mac-os, and the cluster is > running linux. I don’t think I can build linux executables on my mac. > Your build does not have to be "local": pick one random Linux machine, have it do the

Re: Multiple processing compiling the same file

2018-01-31 Thread Jim Newton
Hi Faré, Thanks for taking the time to understand my comments. I’ve tried to respond to some of your questions below. Sorry if my original post wasn’t explicit enough to give enough explanation for what I’m trying to do. If I run several sbcl processes on different nodes in my compute

Re: Multiple processing compiling the same file

2018-01-30 Thread Robert Goldman
Sorry for the late response. What you have seems like it will work, but couldn't you just as easily use the ASDF output translations configuration facility that is described here: https://common-lisp.net/project/asdf/asdf/Controlling-where-ASDF-saves-compiled-files.html#Controlling-where-ASDF-

Re: Multiple processing compiling the same file

2018-01-30 Thread Robert Goldman
On 23 Jan 2018, at 5:47, Pascal Bourguignon wrote: > On 23 Jan 2018, at 12:00, Jim Newton wrote: If I run several sbcl processes on different nodes in my compute cluster, it might happen that two different runs notice the same file needs to be recompiled (via asdf), and they might try to co

Re: Multiple processing compiling the same file

2018-01-30 Thread Faré
(Sorry for delayed response) >>>: Jim Newton >>> If I run several sbcl processes on different nodes in my compute cluster, >>> it might happen that >>> two different runs notice the same file needs to be recompiled (via asdf), >>> and they might try to compile it at the same time. What is the be

Re: Multiple processing compiling the same file

2018-01-23 Thread Jim Newton
Apparently, this approach seems to work. I’m not sure if it is the best approach. Here is what my code looks like. It creates a directory in /tmp/ and asdf:load-system seems to compile the .fasl files into there. (require :asdf) (require :sb-posix) (let ((home (directory-namestring (user-h

Re: Multiple processing compiling the same file

2018-01-23 Thread Pascal Bourguignon
> On 23 Jan 2018, at 12:00, Jim Newton wrote: > > If I run several sbcl processes on different nodes in my compute cluster, it > might happen that two different runs notice the same file needs to be > recompiled (via asdf), > and they might try to compile it at the same time. What is the bes

Multiple processing compiling the same file

2018-01-23 Thread Jim Newton
If I run several sbcl processes on different nodes in my compute cluster, it might happen that two different runs notice the same file needs to be recompiled (via asdf), and they might try to compile it at the same time. What is the best way to prevent this? I see in the asdf documentation tha