Jose Luis Larroque created GIRAPH-1030:
------------------------------------------
Summary: Stop using mapred.job.id (is deprecated). Instead, start
using mapreduce.job.id
Key: GIRAPH-1030
URL: https://issues.apache.org/jira/browse/GIRAPH-1030
Project: Giraph
Issue Type: Improvement
Components: conf and scripts
Affects Versions: 1.1.0
Environment: Ubuntu 14.04 LTS, Hadoop 2.4.0
Reporter: Jose Luis Larroque
Priority: Trivial
When i'm starting a new Giraph Job, there is always a warning about a
deprecated property, and that property is being programmatically set by
GiraphYarnClient class(GiraphYarnClient.java, line 196,
http://grepcode.com/file/repo1.maven.org/maven2/org.apache.giraph/giraph-core/1.1.0/org/apache/giraph/yarn/GiraphYarnClient.java#196).
It is not being taken from a XML config file and it's very confusing for
newbies, because it can't be easily fixed.
It will be nice if the non-deprecated property (mapreduce.job.id) can be used
instead
A brief (and very generic) log with the problem:
15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is:
hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client
15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at
hdnode01/192.168.0.10:8050
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for,
nodeId=hadoop100:51831, nodeAddress hadoop100:8042, nodeRackName /default-rack,
nodeNumContainers 0
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for,
nodeId=hadoop101:40809, nodeAddress hadoop101:8042, nodeRackName /default-rack,
nodeNumContainers 0
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application ID:
application_1440862856801_0001
15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id is deprecated.
Instead, use mapreduce.job.id
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for the
application master
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Environment for AM
:{CLASSPATH=${CLASSPATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*}
...
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
