Re: copying binary files to a SequenceFile

2009-02-05 Thread Rasit OZDAS
Mark,
http://stuartsierra.com/2008/04/24/a-million-little-files/comment-page-1

In this link, there is a tool to create sequence files from tar.gz and
tar.bz2 files.
I don't think that this is a real solution, but at least it means more
free memory and delay of problems (worst solution).

Rasit

2009/2/5 Mark Kerzner markkerz...@gmail.com:
 Hi all,

 I am copying regular binary files to a SequenceFile, and I am using
 BytesWritable, to which I am giving all the byte[] content of the file.
 However, once it hits a file larger than my computer memory, it may have
 problems. Is there a better way?

 Thank you,
 Mark




-- 
M. Raşit ÖZDAŞ


copying binary files to a SequenceFile

2009-02-04 Thread Mark Kerzner
Hi all,

I am copying regular binary files to a SequenceFile, and I am using
BytesWritable, to which I am giving all the byte[] content of the file.
However, once it hits a file larger than my computer memory, it may have
problems. Is there a better way?

Thank you,
Mark