HADOOP_MAPRED_HOME not found!
hi, when i am trying to execute this command: hadoop job -history ~/1 its giving error like: DEPRECATED: Use of this script to execute mapred command is deprecated. Instead use the mapred command for it. HADOOP_MAPRED_HOME not found! from where can i get HADOOP_MAPRED_HOME? thanks.
Re: HADOOP_MAPRED_HOME not found!
Which version of hadoop are u using? AFAIK the hadoop mapred home is the directory where hadoop is installed or in other words untarred. Thanks Divye Sheth On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: > hi, > > when i am trying to execute this command: > hadoop job -history ~/1 > its giving error like: > DEPRECATED: Use of this script to execute mapred command is deprecated. > Instead use the mapred command for it. > > HADOOP_MAPRED_HOME not found! > > from where can i get HADOOP_MAPRED_HOME? > > thanks. >
Re: HADOOP_MAPRED_HOME not found!
yes, it is there. then why execution of that command throwing such error.
Do i need to change anything in this hadoop file ?
#!/usr/bin/env bash
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# This script runs the hadoop core commands.
bin=`which $0`
bin=`dirname ${bin}`
bin=`cd "$bin" ; pwd`
DEFAULT_LIBEXEC_DIR="$bin"/../libexec
HADOOP_LIBEXEC_DIR=${HADOOP_LIBEXEC_DIR:-$DEFAULT_LIBEXEC_DIR}
. $HADOOP_LIBEXEC_DIR/hadoop-config.sh
function print_usage(){
echo "Usage: hadoop [--config confdir] COMMAND"
echo " where COMMAND is one of:"
echo " fs run a generic filesystem user client"
echo " version print the version"
echo " jar run a jar file"
echo " checknative [-a|-h] check native hadoop and compression
libraries availability"
echo " distcp copy file or directories recursively"
echo " archive -archiveName NAME -p * create a
hadoop archive"
echo " classpathprints the class path needed to get the"
echo " Hadoop jar and the required libraries"
echo " daemonlogget/set the log level for each daemon"
echo " or"
echo " CLASSNAMErun the class named CLASSNAME"
echo ""
echo "Most commands print help when invoked w/o parameters."
}
if [ $# = 0 ]; then
print_usage
exit
fi
COMMAND=$1
case $COMMAND in
# usage flags
--help|-help|-h)
print_usage
exit
;;
#hdfs commands
namenode|secondarynamenode|datanode|dfs|dfsadmin|fsck|balancer|fetchdt|oiv|dfsgroups)
echo "DEPRECATED: Use of this script to execute hdfs command is
deprecated." 1>&2
echo "Instead use the hdfs command for it." 1>&2
echo "" 1>&2
#try to locate hdfs and if present, delegate to it.
shift
if [ -f "${HADOOP_HDFS_HOME}"/bin/hdfs ]; then
exec "${HADOOP_HDFS_HOME}"/bin/hdfs ${COMMAND/dfsgroups/groups} "$@"
elif [ -f "${HADOOP_PREFIX}"/bin/hdfs ]; then
exec "${HADOOP_PREFIX}"/bin/hdfs ${COMMAND/dfsgroups/groups} "$@"
else
echo "HADOOP_HDFS_HOME not found!"
exit 1
fi
;;
#mapred commands for backwards compatibility
pipes|job|queue|mrgroups|mradmin|jobtracker|tasktracker|mrhaadmin|mrzkfc|jobtrackerha)
echo "DEPRECATED: Use of this script to execute mapred command is
deprecated." 1>&2
echo "Instead use the mapred command for it." 1>&2
echo "" 1>&2
#try to locate mapred and if present, delegate to it.
shift
if [ -f "${HADOOP_MAPRED_HOME}"/bin/mapred ]; then
exec "${HADOOP_MAPRED_HOME}"/bin/mapred ${COMMAND/mrgroups/groups}
"$@"
elif [ -f "${HADOOP_PREFIX}"/bin/mapred ]; then
exec "${HADOOP_PREFIX}"/bin/mapred ${COMMAND/mrgroups/groups} "$@"
else
echo "HADOOP_MAPRED_HOME not found!"
exit 1
fi
;;
classpath)
if $cygwin; then
CLASSPATH=`cygpath -p -w "$CLASSPATH"`
fi
echo $CLASSPATH
exit
;;
#core commands
*)
# the core commands
if [ "$COMMAND" = "fs" ] ; then
CLASS=org.apache.hadoop.fs.FsShell
elif [ "$COMMAND" = "version" ] ; then
CLASS=org.apache.hadoop.util.VersionInfo
elif [ "$COMMAND" = "jar" ] ; then
CLASS=org.apache.hadoop.util.RunJar
elif [ "$COMMAND" = "key" ] ; then
CLASS=org.apache.hadoop.crypto.key.KeyShell
elif [ "$COMMAND" = "checknative" ] ; then
CLASS=org.apache.hadoop.util.NativeLibraryChecker
elif [ "$COMMAND" = "distcp" ] ; then
CLASS=org.apache.hadoop.tools.DistCp
CLASSPATH=${CLASSPATH}:${TOOL_PATH}
elif [ "$COMMAND" = "daemonlog" ] ; then
CLASS=org.apache.hadoop.log.LogLevel
elif [ "$COMMAND" = "archive" ]
Re: HADOOP_MAPRED_HOME not found!
it was defined at hadoop-config.sh On Fri, Mar 28, 2014 at 1:19 PM, divye sheth wrote: > Which version of hadoop are u using? AFAIK the hadoop mapred home is the > directory where hadoop is installed or in other words untarred. > > Thanks > Divye Sheth > On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: > >> hi, >> >> when i am trying to execute this command: >> hadoop job -history ~/1 >> its giving error like: >> DEPRECATED: Use of this script to execute mapred command is deprecated. >> Instead use the mapred command for it. >> >> HADOOP_MAPRED_HOME not found! >> >> from where can i get HADOOP_MAPRED_HOME? >> >> thanks. >> >
Re: HADOOP_MAPRED_HOME not found!
Try adding the hadoop bin path to system path. -Rahul Singh On Fri, Mar 28, 2014 at 11:32 AM, Azuryy Yu wrote: > it was defined at hadoop-config.sh > > > > On Fri, Mar 28, 2014 at 1:19 PM, divye sheth wrote: > >> Which version of hadoop are u using? AFAIK the hadoop mapred home is the >> directory where hadoop is installed or in other words untarred. >> >> Thanks >> Divye Sheth >> On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: >> >>> hi, >>> >>> when i am trying to execute this command: >>> hadoop job -history ~/1 >>> its giving error like: >>> DEPRECATED: Use of this script to execute mapred command is deprecated. >>> Instead use the mapred command for it. >>> >>> HADOOP_MAPRED_HOME not found! >>> >>> from where can i get HADOOP_MAPRED_HOME? >>> >>> thanks. >>> >> >
Re: HADOOP_MAPRED_HOME not found!
I believe you are using Hadoop 2. In order to get the mapred working you need to set the HADOOP_MAPRED_HOME path in either your /etc/profile or .bashrc file or you can use the command given below to temporarily set the variable. export HADOOP_MAPRED_HOME=$HADOOP_INSTALL $HADOOP_INSTALL is the location where the hadoop tar ball is extracted. This should work for you. Thanks Divye Sheth On Fri, Mar 28, 2014 at 11:53 AM, Rahul Singh wrote: > Try adding the hadoop bin path to system path. > > > -Rahul Singh > > > On Fri, Mar 28, 2014 at 11:32 AM, Azuryy Yu wrote: > >> it was defined at hadoop-config.sh >> >> >> >> On Fri, Mar 28, 2014 at 1:19 PM, divye sheth wrote: >> >>> Which version of hadoop are u using? AFAIK the hadoop mapred home is the >>> directory where hadoop is installed or in other words untarred. >>> >>> Thanks >>> Divye Sheth >>> On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: >>> >>>> hi, >>>> >>>> when i am trying to execute this command: >>>> hadoop job -history ~/1 >>>> its giving error like: >>>> DEPRECATED: Use of this script to execute mapred command is deprecated. >>>> Instead use the mapred command for it. >>>> >>>> HADOOP_MAPRED_HOME not found! >>>> >>>> from where can i get HADOOP_MAPRED_HOME? >>>> >>>> thanks. >>>> >>> >> >
Re: HADOOP_MAPRED_HOME not found!
we can execute the above command anywhere or do i need to execute it in any particular directory? thanks On Thu, Mar 27, 2014 at 11:41 PM, divye sheth wrote: > I believe you are using Hadoop 2. In order to get the mapred working you > need to set the HADOOP_MAPRED_HOME path in either your /etc/profile or > .bashrc file or you can use the command given below to temporarily set the > variable. > > export HADOOP_MAPRED_HOME=$HADOOP_INSTALL > > $HADOOP_INSTALL is the location where the hadoop tar ball is extracted. > > This should work for you. > > Thanks > Divye Sheth > > > > On Fri, Mar 28, 2014 at 11:53 AM, Rahul Singh > wrote: > >> Try adding the hadoop bin path to system path. >> >> >> -Rahul Singh >> >> >> On Fri, Mar 28, 2014 at 11:32 AM, Azuryy Yu wrote: >> >>> it was defined at hadoop-config.sh >>> >>> >>> >>> On Fri, Mar 28, 2014 at 1:19 PM, divye sheth wrote: >>> >>>> Which version of hadoop are u using? AFAIK the hadoop mapred home is >>>> the directory where hadoop is installed or in other words untarred. >>>> >>>> Thanks >>>> Divye Sheth >>>> On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: >>>> >>>>> hi, >>>>> >>>>> when i am trying to execute this command: >>>>> hadoop job -history ~/1 >>>>> its giving error like: >>>>> DEPRECATED: Use of this script to execute mapred command is deprecated. >>>>> Instead use the mapred command for it. >>>>> >>>>> HADOOP_MAPRED_HOME not found! >>>>> >>>>> from where can i get HADOOP_MAPRED_HOME? >>>>> >>>>> thanks. >>>>> >>>> >>> >> >
Re: HADOOP_MAPRED_HOME not found!
You can execute this command on any machine where you have set the HADOOP_MAPRED_HOME Thanks Divye Sheth On Fri, Mar 28, 2014 at 12:31 PM, Avinash Kujur wrote: > we can execute the above command anywhere or do i need to execute it in > any particular directory? > > thanks > > > On Thu, Mar 27, 2014 at 11:41 PM, divye sheth wrote: > >> I believe you are using Hadoop 2. In order to get the mapred working you >> need to set the HADOOP_MAPRED_HOME path in either your /etc/profile or >> .bashrc file or you can use the command given below to temporarily set the >> variable. >> >> export HADOOP_MAPRED_HOME=$HADOOP_INSTALL >> >> $HADOOP_INSTALL is the location where the hadoop tar ball is extracted. >> >> This should work for you. >> >> Thanks >> Divye Sheth >> >> >> >> On Fri, Mar 28, 2014 at 11:53 AM, Rahul Singh > > wrote: >> >>> Try adding the hadoop bin path to system path. >>> >>> >>> -Rahul Singh >>> >>> >>> On Fri, Mar 28, 2014 at 11:32 AM, Azuryy Yu wrote: >>> >>>> it was defined at hadoop-config.sh >>>> >>>> >>>> >>>> On Fri, Mar 28, 2014 at 1:19 PM, divye sheth wrote: >>>> >>>>> Which version of hadoop are u using? AFAIK the hadoop mapred home is >>>>> the directory where hadoop is installed or in other words untarred. >>>>> >>>>> Thanks >>>>> Divye Sheth >>>>> On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: >>>>> >>>>>> hi, >>>>>> >>>>>> when i am trying to execute this command: >>>>>> hadoop job -history ~/1 >>>>>> its giving error like: >>>>>> DEPRECATED: Use of this script to execute mapred command is >>>>>> deprecated. >>>>>> Instead use the mapred command for it. >>>>>> >>>>>> HADOOP_MAPRED_HOME not found! >>>>>> >>>>>> from where can i get HADOOP_MAPRED_HOME? >>>>>> >>>>>> thanks. >>>>>> >>>>> >>>> >>> >> >
Re: HADOOP_MAPRED_HOME not found!
i am not getting where to set HADOOP_MAPRED_HOME and how to set. thanks On Fri, Mar 28, 2014 at 12:06 AM, divye sheth wrote: > You can execute this command on any machine where you have set the > HADOOP_MAPRED_HOME > > Thanks > Divye Sheth > > > On Fri, Mar 28, 2014 at 12:31 PM, Avinash Kujur wrote: > >> we can execute the above command anywhere or do i need to execute it in >> any particular directory? >> >> thanks >> >> >> On Thu, Mar 27, 2014 at 11:41 PM, divye sheth wrote: >> >>> I believe you are using Hadoop 2. In order to get the mapred working you >>> need to set the HADOOP_MAPRED_HOME path in either your /etc/profile or >>> .bashrc file or you can use the command given below to temporarily set the >>> variable. >>> >>> export HADOOP_MAPRED_HOME=$HADOOP_INSTALL >>> >>> $HADOOP_INSTALL is the location where the hadoop tar ball is extracted. >>> >>> This should work for you. >>> >>> Thanks >>> Divye Sheth >>> >>> >>> >>> On Fri, Mar 28, 2014 at 11:53 AM, Rahul Singh < >>> smart.rahul.i...@gmail.com> wrote: >>> >>>> Try adding the hadoop bin path to system path. >>>> >>>> >>>> -Rahul Singh >>>> >>>> >>>> On Fri, Mar 28, 2014 at 11:32 AM, Azuryy Yu wrote: >>>> >>>>> it was defined at hadoop-config.sh >>>>> >>>>> >>>>> >>>>> On Fri, Mar 28, 2014 at 1:19 PM, divye sheth wrote: >>>>> >>>>>> Which version of hadoop are u using? AFAIK the hadoop mapred home is >>>>>> the directory where hadoop is installed or in other words untarred. >>>>>> >>>>>> Thanks >>>>>> Divye Sheth >>>>>> On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: >>>>>> >>>>>>> hi, >>>>>>> >>>>>>> when i am trying to execute this command: >>>>>>> hadoop job -history ~/1 >>>>>>> its giving error like: >>>>>>> DEPRECATED: Use of this script to execute mapred command is >>>>>>> deprecated. >>>>>>> Instead use the mapred command for it. >>>>>>> >>>>>>> HADOOP_MAPRED_HOME not found! >>>>>>> >>>>>>> from where can i get HADOOP_MAPRED_HOME? >>>>>>> >>>>>>> thanks. >>>>>>> >>>>>> >>>>> >>>> >>> >> >
Re: HADOOP_MAPRED_HOME not found!
Hi Avinash, The export command you can execute on any one machine in the cluster as of now. Once you have executed the export command i.e. export HADOOP_MAPRED_HOME=/path/to/your/hadoop/installation you can then execute the mapred job -list command from that very same machine. Thanks Divye Sheth On Fri, Mar 28, 2014 at 12:57 PM, Avinash Kujur wrote: > i am not getting where to set HADOOP_MAPRED_HOME and how to set. > > thanks > > > On Fri, Mar 28, 2014 at 12:06 AM, divye sheth wrote: > >> You can execute this command on any machine where you have set the >> HADOOP_MAPRED_HOME >> >> Thanks >> Divye Sheth >> >> >> On Fri, Mar 28, 2014 at 12:31 PM, Avinash Kujur wrote: >> >>> we can execute the above command anywhere or do i need to execute it in >>> any particular directory? >>> >>> thanks >>> >>> >>> On Thu, Mar 27, 2014 at 11:41 PM, divye sheth wrote: >>> >>>> I believe you are using Hadoop 2. In order to get the mapred working >>>> you need to set the HADOOP_MAPRED_HOME path in either your /etc/profile or >>>> .bashrc file or you can use the command given below to temporarily set the >>>> variable. >>>> >>>> export HADOOP_MAPRED_HOME=$HADOOP_INSTALL >>>> >>>> $HADOOP_INSTALL is the location where the hadoop tar ball is extracted. >>>> >>>> This should work for you. >>>> >>>> Thanks >>>> Divye Sheth >>>> >>>> >>>> >>>> On Fri, Mar 28, 2014 at 11:53 AM, Rahul Singh < >>>> smart.rahul.i...@gmail.com> wrote: >>>> >>>>> Try adding the hadoop bin path to system path. >>>>> >>>>> >>>>> -Rahul Singh >>>>> >>>>> >>>>> On Fri, Mar 28, 2014 at 11:32 AM, Azuryy Yu wrote: >>>>> >>>>>> it was defined at hadoop-config.sh >>>>>> >>>>>> >>>>>> >>>>>> On Fri, Mar 28, 2014 at 1:19 PM, divye sheth wrote: >>>>>> >>>>>>> Which version of hadoop are u using? AFAIK the hadoop mapred home is >>>>>>> the directory where hadoop is installed or in other words untarred. >>>>>>> >>>>>>> Thanks >>>>>>> Divye Sheth >>>>>>> On Mar 28, 2014 10:43 AM, "Avinash Kujur" wrote: >>>>>>> >>>>>>>> hi, >>>>>>>> >>>>>>>> when i am trying to execute this command: >>>>>>>> hadoop job -history ~/1 >>>>>>>> its giving error like: >>>>>>>> DEPRECATED: Use of this script to execute mapred command is >>>>>>>> deprecated. >>>>>>>> Instead use the mapred command for it. >>>>>>>> >>>>>>>> HADOOP_MAPRED_HOME not found! >>>>>>>> >>>>>>>> from where can i get HADOOP_MAPRED_HOME? >>>>>>>> >>>>>>>> thanks. >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> >
