Re: Small File Management

2010-10-27 Thread Fernando Padilla
ck Angeleswrote: HBase might fit the bill. On Tue, Oct 26, 2010 at 12:28 PM, Ananth Sarathy< ananth.t.sara...@gmail.com wrote: I was wondering if there were any projects out there doing a small file management layer on top of Hadoop? I know that HDFS is primarily for map/reduce but I think comp

Re: Small File Management

2010-10-26 Thread Todd Lipcon
ra...@gmail.com > > > wrote: > > > > > I was wondering if there were any projects out there doing a small file > > > management layer on top of Hadoop? I know that HDFS is primarily for > > > map/reduce but I think companies are going to start usin

Re: Small File Management

2010-10-26 Thread Ananth Sarathy
l.com > > wrote: > > > I was wondering if there were any projects out there doing a small file > > management layer on top of Hadoop? I know that HDFS is primarily for > > map/reduce but I think companies are going to start using hdfs clusters > as > > storage in the c

Re: Small File Management

2010-10-26 Thread Ananth Sarathy
, Oct 26, 2010 at 1:07 PM, Patrick Angeles wrote: > HBase might fit the bill. > > On Tue, Oct 26, 2010 at 12:28 PM, Ananth Sarathy < > ananth.t.sara...@gmail.com > > wrote: > > > I was wondering if there were any projects out there doing a small file > > management

Re: Small File Management

2010-10-26 Thread Patrick Angeles
HBase might fit the bill. On Tue, Oct 26, 2010 at 12:28 PM, Ananth Sarathy wrote: > I was wondering if there were any projects out there doing a small file > management layer on top of Hadoop? I know that HDFS is primarily for > map/reduce but I think companies are going to start u

Re: Small File Management

2010-10-26 Thread Allen Wittenauer
On Oct 26, 2010, at 9:28 AM, Ananth Sarathy wrote: > I was wondering if there were any projects out there doing a small file > management layer on top of Hadoop? I know that HDFS is primarily for > map/reduce but I think companies are going to start using hdfs clusters as > storage

Re: Small File Management

2010-10-26 Thread Mark Kerzner
http://stuartsierra.com/2008/04/24/a-million-little-files On Tue, Oct 26, 2010 at 11:28 AM, Ananth Sarathy wrote: > I was wondering if there were any projects out there doing a small file > management layer on top of Hadoop? I know that HDFS is primarily for > map/reduce but I think

Small File Management

2010-10-26 Thread Ananth Sarathy
I was wondering if there were any projects out there doing a small file management layer on top of Hadoop? I know that HDFS is primarily for map/reduce but I think companies are going to start using hdfs clusters as storage in the cloud, and i was wondering if any work had been done on this