For "big data" we need sparse matrix and maybe even more importantly, the ability to parallelize across machines. PDL is great if the data can fit in memory on a single machine. For big data, the assumption should be that the data will NOT fit in memory and multiple machines are necessary to finish processing in a reasonable amount of time. I would love to see more work in that direction, if possible.
Best, Maggie On Sat, Jun 30, 2012 at 6:51 PM, chm <[email protected]> wrote: > Hi David- > > Thanks for the interesing blog. > > I think you've made a lot of good points. > As far as increasing PDL's popularity, I think > improving the documentation a la the PDL book > is important. However, I think the single > biggest thing we could do is make PDL fully > support the win32 platform. There are an > awful lot of folks using windows.... > > Some things that I would like to see for this summer: > * finish 64bit index support (working on it :-) > * finish PDL::Graphics::Gnuplot (still missing win32, I think) > * better document PDL::Graphics::Prima (chapter in PDL Book?) > * leverage Strawberry Perl v5.16.0 for PDL > > When we have a 1-click install for PDL on win32 > platforms (and the others) with improved docs > as with the PDL Book, we'll have the potential > to increase the PDL market share. > > --Chris > > > > On 6/30/2012 1:40 AM, David Mertens wrote: > >> Greetings all - >> >> I just posted a blog entry on blogs.perl.org directed at y'all. :-) >> >> http://blogs.perl.org/users/**david_mertens/2012/06/** >> adapting-pdl-to-a-big-data-**landscape.html<http://blogs.perl.org/users/david_mertens/2012/06/adapting-pdl-to-a-big-data-landscape.html> >> >> Please read, comment, and most importantly respond. >> >> Your friendly PDL evangelist, >> David >> >> P.S. irc.perl.org#pdl finally has an official log, with an official >> website. Check it out at http://irclog.perlgeek.de/pdl/ >> > > ______________________________**_________________ > PDL-porters mailing list > [email protected] > http://mailman.jach.hawaii.**edu/mailman/listinfo/pdl-**porters<http://mailman.jach.hawaii.edu/mailman/listinfo/pdl-porters> >
_______________________________________________ Perldl mailing list [email protected] http://mailman.jach.hawaii.edu/mailman/listinfo/perldl
