RE: Password less ssh from slave to slave
As far as I have seen, password-less ssh is only required from Master to slaves, to start/stop slave services. -Original Message- From: bharath v [mailto:bharathvissapragada1...@gmail.com] Sent: Monday, March 08, 2010 8:47 AM To: core-u...@hadoop.apache.org Subject: Password less ssh from slave to slave Hi all, Do we require a Password less ssh from slave to slave ? Thanks
problem building trunk
I'm having issues building the trunk. I follow steps mentioned at http://wiki.apache.org/hadoop/BuildingHadoopFromSVN And at step ant clean jar jar-test ivy-publish-local I get this error: BUILD FAILED Target ivy-publish-local does not exist in the project hadoop-core. And as far as I can see, this target is not defined in build.xml. I appreciate any help with this.
RE: problem building trunk
Thanks Owen, Now hadoop-common builds, but if I use the same target (mvn-install) when building hdfs, I get this error: ant clean jar jar-test mvn-install ivy-resolve-common: [ivy:resolve] [ivy:resolve] :: problems summary :: [ivy:resolve] WARNINGS [ivy:resolve] module not found: org.apache.hadoop#hadoop-core;0.21.0-alpha-15 [ivy:resolve] apache-snapshot: tried [ivy:resolve] https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.pom [ivy:resolve] -- artifact org.apache.hadoop#hadoop-core;0.21.0-alpha-15!hadoop-core.jar: [ivy:resolve] https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.jar [ivy:resolve] maven2: tried [ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.pom [ivy:resolve] -- artifact org.apache.hadoop#hadoop-core;0.21.0-alpha-15!hadoop-core.jar: [ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.jar [ivy:resolve] :: [ivy:resolve] :: UNRESOLVED DEPENDENCIES :: [ivy:resolve] :: [ivy:resolve] :: org.apache.hadoop#hadoop-core;0.21.0-alpha-15: not found [ivy:resolve] :: [ivy:resolve] [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS BUILD FAILED /root/Hadoop/hadoop-hdfs/build.xml:1362: impossible to resolve dependencies: resolve failed - see output for details -Original Message- From: Owen O'Malley [mailto:omal...@apache.org] Sent: Friday, February 26, 2010 1:44 PM To: Giridharan Kesavan Cc: common-user Subject: Re: problem building trunk On Feb 26, 2010, at 10:22 AM, Massoud Mazar wrote: I'm having issues building the trunk. I follow steps mentioned at http://wiki.apache.org/hadoop/BuildingHadoopFromSVN It is a documentation error. Giri, can you update it with the current targets (ie. mvn-install)? Thanks, Owen
RE: problem building trunk
Thanks. I followed steps at http://wiki.apache.org/hadoop/GitAndHadoop and was able to do a successful build. -Original Message- From: Konstantin Boudnik [mailto:c...@yahoo-inc.com] Sent: Friday, February 26, 2010 2:06 PM To: common-user@hadoop.apache.org Subject: Re: problem building trunk In order to post any artifacts to the central repository one needs to have special access rights. Those are available on to build-masters basically. On Fri, Feb 26, 2010 at 11:01AM, Massoud Mazar wrote: Thanks Owen, Now hadoop-common builds, but if I use the same target (mvn-install) when building hdfs, I get this error: ant clean jar jar-test mvn-install ivy-resolve-common: [ivy:resolve] [ivy:resolve] :: problems summary :: [ivy:resolve] WARNINGS [ivy:resolve] module not found: org.apache.hadoop#hadoop-core;0.21.0-alpha-15 [ivy:resolve] apache-snapshot: tried [ivy:resolve] https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.pom [ivy:resolve] -- artifact org.apache.hadoop#hadoop-core;0.21.0-alpha-15!hadoop-core.jar: [ivy:resolve] https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.jar [ivy:resolve] maven2: tried [ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.pom [ivy:resolve] -- artifact org.apache.hadoop#hadoop-core;0.21.0-alpha-15!hadoop-core.jar: [ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.21.0-alpha-15/hadoop-core-0.21.0-alpha-15.jar [ivy:resolve] :: [ivy:resolve] :: UNRESOLVED DEPENDENCIES :: [ivy:resolve] :: [ivy:resolve] :: org.apache.hadoop#hadoop-core;0.21.0-alpha-15: not found [ivy:resolve] :: [ivy:resolve] [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS BUILD FAILED /root/Hadoop/hadoop-hdfs/build.xml:1362: impossible to resolve dependencies: resolve failed - see output for details -Original Message- From: Owen O'Malley [mailto:omal...@apache.org] Sent: Friday, February 26, 2010 1:44 PM To: Giridharan Kesavan Cc: common-user Subject: Re: problem building trunk On Feb 26, 2010, at 10:22 AM, Massoud Mazar wrote: I'm having issues building the trunk. I follow steps mentioned at http://wiki.apache.org/hadoop/BuildingHadoopFromSVN It is a documentation error. Giri, can you update it with the current targets (ie. mvn-install)? Thanks, Owen
applying MAPREDUCE-318 to 0.20.1
Is there a patch that I can apply to my 0.20.1 cluster that fixes issue reported by Scott Carey: Comment out or delete the line: break; //we have a map from this host in ReduceOutput.java in ReduceCopier.fetchOutputs() - line 1804 in 0.19.2-dev, 1911 on 0.20.1-dev and line 1954 currently on trunk. Thanks