On Mon, Sep 15, 2008 at 8:23 AM, Brian Vargas <[EMAIL PROTECTED]> wrote: > A simple solution is to just load all of the small files into a sequence > file, and process the sequence file instead.
I use this approach too. I make SequenceFiles with key= the file name (Text) value= the contents of the file (BytesWritable) and use BLOCK compression. -Stuart