parallel unzip in progress

2012-04-02 Thread Jay Norwood
I'm working on a parallel unzip. I started with phobos std.zip, but found that to be too monolithic. I needed to separate out the tasks that get the directory entries, create the directory tree, get the compressed data, expand the data and create the uncompressed files on disk. It currently

Re: parallel unzip in progress

2012-04-03 Thread Jay Norwood
On Tuesday, 3 April 2012 at 05:27:08 UTC, Jay Norwood wrote: .. So, to answer my own questions ... I placed the code below in a taskpool parallel foreach loop, where each am is an archive member. It is expanded, and the expanded data is written to a file. The original time info is c

Re: parallel unzip in progress

2012-04-04 Thread dennis luehring
Am 04.04.2012 08:31, schrieb Jay Norwood: On Tuesday, 3 April 2012 at 05:27:08 UTC, Jay Norwood wrote: .. So, to answer my own questions ... I placed the code below in a taskpool parallel foreach loop, where each am is an archive member. It is expanded, and the expanded data is written

Re: parallel unzip in progress

2012-04-04 Thread Jay Norwood
On Wednesday, 4 April 2012 at 07:25:25 UTC, dennis luehring wrote: Am 04.04.2012 08:31, schrieb Jay Norwood: This particular loop is currently excluding restore of times on directory entries, but I suppose I can restore the directory times after all the files have been expanded into the director

Re: parallel unzip in progress

2012-04-04 Thread Jay Norwood
On Wednesday, 4 April 2012 at 07:39:56 UTC, Jay Norwood wrote: On Wednesday, 4 April 2012 at 07:25:25 UTC, dennis luehring I decided to try the option where the data is stored in the zip file uncompressed. Since the folder is just over 2GB, I ran into the stdio File problems with being unabl

Re: parallel unzip in progress

2012-04-07 Thread Jay Norwood
On Wednesday, 4 April 2012 at 19:41:21 UTC, Jay Norwood wrote: > The work-around was to convert all the file operations to use std.stream equivalents, and that worked well, but I see i the bug reports that even that was only working correctly on windows. So I'm on windows, and ok for me, but i