That should involve some deal of networking, I have been thinking along those
lines with my Quantum Chemistry
project, the idea that I had would be to use multiple scripts talking to each
other across multiple cores, yet that
should work for multiple computers as well ...
-Mark
________________________________
From: Maggie X <[email protected]>
To: chm <[email protected]>
Cc: perldl <[email protected]>; pdl-porters <[email protected]>
Sent: Sunday, July 1, 2012 6:18 PM
Subject: Re: [Perldl] [Pdl-porters] Reflections from YAPC
For "big data" we need sparse matrix and maybe even more importantly, the
ability to parallelize across machines. PDL is great if the data can fit in
memory on a single machine. For big data, the assumption should be that the
data will NOT fit in memory and multiple machines are necessary to finish
processing in a reasonable amount of time. I would love to see more work in
that direction, if possible.
Best,
Maggie
On Sat, Jun 30, 2012 at 6:51 PM, chm <[email protected]> wrote:
Hi David-
>
>Thanks for the interesing blog.
>
>I think you've made a lot of good points.
>As far as increasing PDL's popularity, I think
>improving the documentation a la the PDL book
>is important. However, I think the single
>biggest thing we could do is make PDL fully
>support the win32 platform. There are an
>awful lot of folks using windows....
>
>Some things that I would like to see for this summer:
>* finish 64bit index support (working on it :-)
>* finish PDL::Graphics::Gnuplot (still missing win32, I think)
>* better document PDL::Graphics::Prima (chapter in PDL Book?)
>* leverage Strawberry Perl v5.16.0 for PDL
>
>When we have a 1-click install for PDL on win32
>platforms (and the others) with improved docs
>as with the PDL Book, we'll have the potential
>to increase the PDL market share.
>
>--Chris
>
>
>
>On 6/30/2012 1:40 AM, David Mertens wrote:
>
>Greetings all -
>>
>>I just posted a blog entry on blogs.perl.org directed at y'all. :-)
>>
>>http://blogs.perl.org/users/david_mertens/2012/06/adapting-pdl-to-a-big-data-landscape.html
>>
>>Please read, comment, and most importantly respond.
>>
>>Your friendly PDL evangelist,
>>David
>>
>>P.S. irc.perl.org#pdl finally has an official log, with an official
>>website. Check it out at http://irclog.perlgeek.de/pdl/
>>
>
_______________________________________________
>PDL-porters mailing list
>[email protected]
>http://mailman.jach.hawaii.edu/mailman/listinfo/pdl-porters
>
_______________________________________________
Perldl mailing list
[email protected]
http://mailman.jach.hawaii.edu/mailman/listinfo/perldl
_______________________________________________
Perldl mailing list
[email protected]
http://mailman.jach.hawaii.edu/mailman/listinfo/perldl
