In hdfs-site.xml you should specify
dfs.namenode.name.dir
for NameNode stoareg directories or / and
dfs.datanode.data.dir
for DataNode storage
Changing temporary directory location changes the default for storage
directories.
Which should also work. You might want to check the message the NameNode
Nathan,
Great references. There is a good place to put them to:
http://wiki.apache.org/hadoop/HDFS_Publications
GPFS and Lustre papers are not there yet, I believe.
Thanks,
--Konstantin
On Thu, Feb 3, 2011 at 10:48 AM, Nathan Rutman wrote:
>
> On Feb 2, 2011, at 6:42 PM, Konstantin Sh
Thanks for the link Stu.
More details are on limitations are here:
http://www.usenix.org/publications/login/2010-04/openpdfs/shvachko.pdf
I think that Nathan raised an interesting question and his assessment of
HDFS use
cases are generally right.
Some assumptions though are outdated at this point.
ase help me with this
> ?
>
> > Streaming Edits to a Backup Node.
> > -
> >
> > Key: HADOOP-4539
> > URL: https://issues.apache.org/jira/browse/HADOOP-4539
> > Project: Hadoop Common
> > I
Yes HDFS supports aTime only for files. Support for directories would be too
expensive.
Thanks,
--Konstantin
On Thu, Nov 11, 2010 at 12:44 AM, Vivekanand Vellanki wrote:
> Hi,
>
> I was looking at the test cases for HDFS and found the following test
> - org.apache.hadoop.hdfs.TestSetTimes.testTim
(i.e., contacting a data node but the data
node does not have that particular file anymore)?
Thanks,
Harold
--- On Mon, 8/24/09, Konstantin Shvachko wrote:
From: Konstantin Shvachko
Subject: Re: Question about HDFS Architecture
To: hdfs-user@hadoop.apache.org
Date: Monday, August 24, 2009, 9
Harold,
Both answers by Aaron were incorrect.
> Does the client cache this information, or does it always talk to the
namenode first?
Yes, the client caches replica locations received from the name-node.
On open() it receives locations of the first 10 blocks of the file.
In most cases these ar
>> The Hadoop FAQ claims that one can run Hadoop in just the Windows command
prompt.
Which FAQ do you read?
This one
http://wiki.apache.org/hadoop/FAQ#2
says
"Windows requires the installation of Cygwin"
--Konstantin
Aaron Kimball wrote:
Hadoop requires a reasonable cygwin environment. bash,
