On Sun, Jun 20, 2010 at 3:44 PM, P Kishor <[email protected]> wrote:
> On Sun, Jun 20, 2010 at 2:55 PM, P Kishor <[email protected]> wrote: > > I sent this out too soon... > > > > Actually, my computer becomes unresponsive even when reading the > > stored piddle. Are there other IO suggestions that I could use, ones > > that would allow me to work with very large piddles stored on the > > disk? An iterator kinda like a file handle that would read in the > > different parts of the piddle only when needed. > > > Tried PDL::IO::FlexRaw.. wow! That is fast, close to instantaneous, > compared to PDL::IO::Storable. > Also, you should be able to memory-map the file if you're on a linux machine, which will save you from reading the entire piddle into memory. That should give you even faster reads and writes. However, there is a bug in the latest PDL that breaks mmapping. I think I know what's going on but I haven't had a chance to fix it yet. It may be a month or so before I get to it, so let me know if you need it. David -- Sent via my carrier pigeon.
_______________________________________________ Perldl mailing list [email protected] http://mailman.jach.hawaii.edu/mailman/listinfo/perldl
