Author: acmurthy
Date: Wed Oct 2 21:08:27 2013
New Revision: 1528626
URL: http://svn.apache.org/r1528626
Log:
MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN.
Contributed by Zhijie Shen.
Modified:
hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
Modified: hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
URL:
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt?rev=1528626&r1=1528625&r2=1528626&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt (original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt Wed Oct 2
21:08:27 2013
@@ -265,6 +265,9 @@ Release 2.1.2 - UNRELEASED
isSplittable(FileSystem, Path) api and ensuring semantic compatibility.
(Robert Kanter via acmurthy)
+ MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN.
+ (Zhijie Shen via acmurthy)
+
Release 2.1.1-beta - 2013-09-23
INCOMPATIBLE CHANGES
Modified:
hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
URL:
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm?rev=1528626&r1=1528625&r2=1528626&view=diff
==============================================================================
---
hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
(original)
+++
hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
Wed Oct 2 21:08:27 2013
@@ -96,12 +96,21 @@ Apache Hadoop MapReduce - Migrating from
* {Malicious}
- For the users who are going to try <<<hadoop-examples-1.x.x.jar>>> on YARN,
- please note that <<<hadoop -jar hadoop-examples-1.x.x.jar>>> will still use
- <<<hadoop-mapreduce-examples-2.x.x.jar>>>, which is installed together with
- other MRv2 jars. By default Hadoop framework jars appear before the users'
- jars in the classpath, such that the classes from the 2.x.x jar will still be
- picked. Users should either remove <<<hadoop-mapreduce-examples-2.x.x.jar>>>
- from the classpath or set <<<HADOOP_USER_CLASSPATH_FIRST=true>>> and
- <<<HADOOP_CLASSPATH=...:hadoop-examples-1.x.x.jar>>> to run their target
- examples jar.
+ For the users who are going to try <<<hadoop-examples-1.x.x.jar>>> on YARN,
+ please note that <<<hadoop -jar hadoop-examples-1.x.x.jar>>> will still use
+ <<<hadoop-mapreduce-examples-2.x.x.jar>>>, which is installed together with
+ other MRv2 jars. By default Hadoop framework jars appear before the users'
+ jars in the classpath, such that the classes from the 2.x.x jar will still be
+ picked. Users should remove <<<hadoop-mapreduce-examples-2.x.x.jar>>>
+ from the classpath of all the nodes in a cluster. Otherwise, users need to
+ set <<<HADOOP_USER_CLASSPATH_FIRST=true>>> and
+ <<<HADOOP_CLASSPATH=...:hadoop-examples-1.x.x.jar>>> to run their target
+ examples jar, and add the following configuration in <<<mapred-site.xml>>> to
+ make the processes in YARN containers pick this jar as well.
+
++---+
+ <property>
+ <name>mapreduce.job.user.classpath.first</name>
+ <value>true</value>
+ </property>
++---+
