SSD support in HDFS

Hi, Is it possible to tell Apache HDFS to store some files on SSD and the rest of the files on spinning disks? So if each on my nodes has 1 SSD and 5 spinning disks, can I configure a directory in HDFS to put all files in that dir on the SSD? I think Intel's Hadoop distribution is working on som

Re: SSD support in HDFS

Hi Lucas, HDFS does not have this capability right now, but there has been some preliminary discussion around adding features to support it. You might want to follow jira issues HDFS-2832 and HDFS-4672 if you'd like to receive notifications about the discussion. https://issues.apache.org/jira/br

Re: SSD support in HDFS

Thanks Chris and Phil. On Tue, Jun 11, 2013 at 1:31 PM, Chris Nauroth wrote: > Hi Lucas, > > HDFS does not have this capability right now, but there has been some > preliminary discussion around adding features to support it. You might > want to follow jira issues HDFS-2832 and HDFS-4672 if you

Re: SSD support in HDFS

I could have sworn there was a thread on this already. (Maybe the HBase list?) Andrew P. kinda nailed it when he talked about the fact that you had to write the replication(s). If you wanted improved performance, why not look at the hybrid drives that have a small SSD buffer and a spinning di

Re: SSD support in HDFS

You can use BTIER in linux.(I don't know its stable or not).With FreeBSD you can use ZFS +L2ARC on SSD. On Thu, Jun 13, 2013 at 6:35 AM, Michael Segel wrote: > I could have sworn there was a thread on this already. (Maybe the HBase > list?) > > Andrew P. kinda nailed it