On Tue, 29 Mar 2011, Jay Hacker wrote:

I have a large gzipped tar archive containing many small files; just untarring it takes a lot of time and space. I'd like to be able to process each file in the archive, ideally without untarring the whole thing first, and I'd like to process several files in parallel. Is there a recipe for this with GNU Parallel?

tar xvf big-file.tar.gz | parallel echo "Proc this file {}"

Parallel will start when the first file is untared.

/hans
--
Horsebakken 78, DK-2400 København NV

Reply via email to