*Subject:* Re: Need help regarding HDFS-RAID
That's right Andy. 0.22+. We are running a HDFS-RAID code base that is
pretty close to what is available in Apache hdfs trunk.
-dhruba
On Thu, Sep 15, 2011 at 10:08 AM, Andrew Purtell apurt...@apache.orgwrote:
But that is the HDFS RAID
:* Dhruba Borthakur dhr...@gmail.com
*To:* hdfs-user@hadoop.apache.org; Andrew Purtell apurt...@apache.org
*Sent:* Thursday, September 15, 2011 10:14 AM
*Subject:* Re: Need help regarding HDFS-RAID
That's right Andy. 0.22+. We are running a HDFS-RAID code base that is
pretty close to what
Purtell apurt...@apache.org
Cc: hdfs-user@hadoop.apache.org hdfs-user@hadoop.apache.org
Sent: Tuesday, September 20, 2011 2:18 AM
Subject: Re: Need help regarding HDFS-RAID
Hi andy,
we do run a version of HDFS RAID that is backported from Apache trunk to a
0.20 based release. Our code
)
From: Dhruba Borthakur dhr...@gmail.com
To: hdfs-user@hadoop.apache.org; Andrew Purtell apurt...@apache.org
Sent: Tuesday, September 20, 2011 9:49 AM
Subject: Re: Need help regarding HDFS-RAID
Hi Andy,
I will be very grateful to you if you merge and contribute it to Apache
Hadoop
. - Piet Hein (via
Tom White)
From: Dhruba Borthakur dhr...@gmail.com
To: hdfs-user@hadoop.apache.org; Andrew Purtell apurt...@apache.org
Sent: Thursday, September 15, 2011 10:14 AM
Subject: Re: Need help regarding HDFS-RAID
That's right Andy. 0.22+. We
Hi,
We want to use HDFS-RAID in our production cluster. (
http://wiki.apache.org/hadoop/HDFS-RAID)
I am not able to find source/binaries/configs for this in official hadoop
distribution from apache hadoop. (checked in 0.20.1 and 0.20.2).
Can somebody please tell me where can I find that? and
Hey Ajit,
HDFS-RAID was never part of the 0.20 release. It made its debut in the
0.21 release [1]. I know that Facebook uses it (and also did develop
it), but unsure of users beyond Facebook.
While 0.21 overall is not entirely deemed as production-usable yet
(and is in fact, possibly abandoned
Hi,
We were planning to use it for past data archival(instead of moving it to
archival store).
Archiving it in HDFS gives advantage of making it easily available for
processing whenever required.
Is there any archival solution in hadoop ecosystem?
thanks,
Ajit.
On Thu, Sep 15, 2011 at 5:05
We use HDFS RAID in a big way. Data older than 12 days are RAIDED using XOR
encoding (effective replication of 2.5). Data older than a few months are
raided using ReedSolomon (effective observed replication factor of 1.5).
This is running on our 60 PB size cluster for about an year now.
thanks
@hadoop.apache.org
Sent: Thursday, September 15, 2011 10:06 AM
Subject: Re: Need help regarding HDFS-RAID
We use HDFS RAID in a big way. Data older than 12 days are RAIDED using XOR
encoding (effective replication of 2.5). Data older than a few months are
raided using ReedSolomon (effective observed
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
--
*From:* Dhruba Borthakur dhr...@gmail.com
*To:* hdfs-user@hadoop.apache.org
*Sent:* Thursday, September 15, 2011 10:06 AM
*Subject:* Re: Need help regarding HDFS-RAID
We use
)
From: Ajit Ratnaparkhi ajit.ratnapar...@gmail.com
To: hdfs-user@hadoop.apache.org
Cc: Andrew Purtell apurt...@apache.org
Sent: Thursday, September 15, 2011 10:54 AM
Subject: Re: Need help regarding HDFS-RAID
Thanks for the info!
So can I use HDFS-RAID taken from apache hdfs trunk
12 matches
Mail list logo
