Re: Fault Tolerancy in core hadoop and HDFS

2010-03-05 Thread Ravi Phulari
HDFS Architecture talks more about fault tolerance. - http://hadoop.apache.org/common/docs/current/hdfs_design.html Removing core-dev@ & common-dev@ from list. Please post general questions to general@ or comman-user@ . - Ravi On 3/5/10 11:13 AM, "iprafulla" wrote: Hi Everyone, I am re

copyFromLocal problem

2010-03-05 Thread Mag Gam
I just setup a new Hadoop cluster. When I do hadoop dfs -copyFromLocal /tmp/zero zero the file zero is being copied to the current working directory. Its not going to the DFS. Is there a way to fix this? tia

How to send KV pair to a reduce task on a particular machine?

2010-03-05 Thread Yanfeng Zhang
Hi, all The KV pairs (kv1, kv2, kv3 kv4) out from mapper would be partitioned into R parts (e.g. R=2) by a partitioner. For example, kv1 and kv2 are in partition1, while kv3 and kv4 are in partition2, the reducers will get KV pairs from these two partitions, reducer1 get KV pairs from partition1 a

Re: Compilation failed when compile hadoop common release-0.20.2

2010-03-05 Thread Owen O'Malley
On Mar 5, 2010, at 3:47 PM, Gary Yang wrote: Hi, I try to compile hadoop common of the release 0.20.2. Below are the error messages and java and ant versions I am using. Please tell me what I missed. Forrest, which we use to generate the documentation, requires java 5. Therefore, run:

Re: Compilation failed when compile hadoop common release-0.20.2

2010-03-05 Thread Ted Yu
Did you first try 'ant jar' from under /hadoop_src ? On Fri, Mar 5, 2010 at 3:47 PM, Gary Yang wrote: > Hi, > > I try to compile hadoop common of the release 0.20.2. Below are the error > messages and java and ant versions I am using. Please tell me what I missed. > > .. > > [javadoc] Stand

Compilation failed when compile hadoop common release-0.20.2

2010-03-05 Thread Gary Yang
Hi, I try to compile hadoop common of the release 0.20.2. Below are the error messages and java and ant versions I am using. Please tell me what I missed. .. [javadoc] Standard Doclet version 1.6.0_18 [javadoc] Building tree for all the packages and classes... [javadoc] Building index

Re: How to download the source code of hadoop-0.20.2?

2010-03-05 Thread Philip Zeyliger
The source code is in the "regular" tarball. For example, http://mirror.cloudera.com/apache/hadoop/core/hadoop-0.20.2/hadoop-0.20.2.tar.gz On Fri, Mar 5, 2010 at 11:33 AM, Gary Yang wrote: > Hi, > > I would like to download the source code of hadoop-0.20.2. I am at > http://mirrors.devlib.org/a

Re: How to download the source code of hadoop-0.20.2?

2010-03-05 Thread Ted Yu
Download hadoop-0.20.2.tar.gz and expand it. On Fri, Mar 5, 2010 at 11:33 AM, Gary Yang wrote: > Hi, > > I would like to download the source code of hadoop-0.20.2. I am at > http://mirrors.devlib.org/apache/hadoop/core/hadoop-0.20.2/hadoop-0.20.2. > It shows me the "src" directory. However, I am

How to download the source code of hadoop-0.20.2?

2010-03-05 Thread Gary Yang
Hi, I would like to download the source code of hadoop-0.20.2. I am at http://mirrors.devlib.org/apache/hadoop/core/hadoop-0.20.2/hadoop-0.20.2. It shows me the "src" directory. However, I am not able to download the source code there after I clicked the src. Can someone direct me where I can g