Re: automatic parallelization
In article <[EMAIL PROTECTED]>, Mikhail Teterin <[EMAIL PROTECTED]> wrote: . . . >> I'm fond of Linda > http://www.unixreview.com/documents/s=10125/ur0704l/ >, Parallel >> Python http://www.parallelpython.com/ > only one of several >> initiatives which aspire to exploit multicores, and so on. > >Linda URL does not open... I'll look into Parallel Python, but it is . . . It comes and goes. It seems to have been OK the last several hours. -- http://mail.python.org/mailman/listinfo/python-list
Re: automatic parallelization
Cameron Laird wrote: > There are a LOT more possibilities one might pursue, depending > on the details of Mr. Teterin's intent. The reason I began wondering about this is that I like a particular image-gallery generating tool called `imageindex' (http://www.edwinh.org/imageindex/) Unfortunately, it processes all given pictures sequentionally ignoring my three other cores. The tool is written in Perl, but I would consider rewriting it in Tcl or Python, if the language made it easy to parallelize loops... > I'm fond of Linda http://www.unixreview.com/documents/s=10125/ur0704l/ >, Parallel > Python http://www.parallelpython.com/ > only one of several > initiatives which aspire to exploit multicores, and so on. Linda URL does not open... I'll look into Parallel Python, but it is an "execution server", which is a rather different approach from OpenMP's, which I'm more familiar with. Thanks! -mi -- http://mail.python.org/mailman/listinfo/python-list
Re: automatic parallelization
In article <[EMAIL PROTECTED]>, Michael Schlenker <[EMAIL PROTECTED]> wrote: >Mikhail Teterin schrieb: >> While C/C++ and Fortran have OpenMP (http://www.OpenMP.org/), there is >> nothing comparable in Tcl (nor, as far as I know, in the two other >> scripting languages). >> >> Or is there? I'd like to, for example, have a version of foreach loop, that >> would split the tasks between concurrently executing threads in order to >> scale to the number of available CPUs: > >For CPython you don't get any benefit from extra CPUs even if you tried >(unless the code inside your loop is specially written C code), due to >the GIL. > >For Perl i don't know, their threading model was a bit heavy last time i >looked, but i might be off with that, so maybe its doable in Perl. > >For Tcl you would at least get the benefit of multiple CPUs, but its >more message passing based thread model is probably not the best for >autoparallelization like OpenMP (but you could use the tsv:: api for >shared vars if you want to). > >> >> For example: >> >> pforeach image $images { >> set exif($image) [extract_exif $image] >> } >> >> The script would be the same on a single- and a multi-CPU computer, but >> would automatically take advantage of multiple processors, when possible. > >Its doable in principle, but as with OpenMP you need extra annotations >to make it workable. > >If you have an event style script in Tcl you might be easier able to use >threads, as the thread::send -async api fits very well with the event >based style. . . . There are a LOT more possibilities one might pursue, depending on the details of Mr. Teterin's intent. I'm fond of Linda http://www.unixreview.com/documents/s=10125/ur0704l/ >, Parallel Python http://www.parallelpython.com/ > only one of several initiatives which aspire to exploit multicores, and so on. -- http://mail.python.org/mailman/listinfo/python-list
Re: automatic parallelization
Mikhail Teterin schrieb: > While C/C++ and Fortran have OpenMP (http://www.OpenMP.org/), there is > nothing comparable in Tcl (nor, as far as I know, in the two other > scripting languages). > > Or is there? I'd like to, for example, have a version of foreach loop, that > would split the tasks between concurrently executing threads in order to > scale to the number of available CPUs: For CPython you don't get any benefit from extra CPUs even if you tried (unless the code inside your loop is specially written C code), due to the GIL. For Perl i don't know, their threading model was a bit heavy last time i looked, but i might be off with that, so maybe its doable in Perl. For Tcl you would at least get the benefit of multiple CPUs, but its more message passing based thread model is probably not the best for autoparallelization like OpenMP (but you could use the tsv:: api for shared vars if you want to). > > For example: > > pforeach image $images { > set exif($image) [extract_exif $image] > } > > The script would be the same on a single- and a multi-CPU computer, but > would automatically take advantage of multiple processors, when possible. Its doable in principle, but as with OpenMP you need extra annotations to make it workable. If you have an event style script in Tcl you might be easier able to use threads, as the thread::send -async api fits very well with the event based style. Michael -- http://mail.python.org/mailman/listinfo/python-list