On Sun, Feb 22, 2009 at 5:31 PM, Mark Knecht <markkne...@gmail.com> wrote: > The down side is the output file is 10x larger than the input file - > roughly - and my current input files are 40-60MB so the output files > will be 600MB. Not huge but if they grew too much more I might get > beyond what a single file can be on ext3, right? Isn't that 2GB or so?
The maximum file size for ext3 depends on the block size you're using, but I believe with the default settings it is 2TB max, not 2GB. I have personally had files as large as 26GB on ext3 without issues. You could always pipe the whole operation it through gzip/bzip2/lzma or similar if you want the file on disk to be much smaller.