[ https://issues.apache.org/jira/browse/HADOOP-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109240#comment-17109240 ]
Aki Tanaka commented on HADOOP-17042: ------------------------------------- Thank you, [~aajisaka] > In addition, can we move the script from libexec/hadoop-distcp.sh to >libexec/tools/hadoop-distcp.sh ? This change can be done in a separate jira. I may not have a proper understanding of this, but I think we cannot move libexec/shellprofile.d/hadoop-distcp.sh to libexec/tools/hadoop-distcp.sh. Because it's used when calling hadoop_import_shellprofiles. [https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh#L725] As far as I checked, the libexec/tools/hadoop-distcp.sh file (and other scripts in libexec/tools/) does not exist. We might not use this hadoop_add_to_classpath_tools function now. If so, I think we can remove this hadoop_add_to_classpath_tools method. > Hadoop distcp throws "ERROR: Tools helper > ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found" > --------------------------------------------------------------------------------------------------------- > > Key: HADOOP-17042 > URL: https://issues.apache.org/jira/browse/HADOOP-17042 > Project: Hadoop Common > Issue Type: Improvement > Affects Versions: 3.2.1, 3.1.3 > Reporter: Aki Tanaka > Assignee: Aki Tanaka > Priority: Minor > Attachments: HADOOP-17042.patch > > > On Hadoop 3.x, we see following "ERROR: Tools helper > ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found." message on > the first line of the command output when running Hadoop DistCp. > {code:java} > $ hadoop distcp /path/to/src /user/hadoop/ > ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not > found. > 2020-05-14 17:11:53,173 INFO tools.DistCp: Input Options: > DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false, > ignoreFailures=false, overwrite=false, append=false, useDiff=false, > useRdiff=false, fromSnapshot=null, toSnapshot=null, skipCRC=false, > blocking=true > .. > {code} > This message was added by HADOOP-12857 and it would be an expected behavior. > DistCp calls 'hadoop_add_to_classpath_tools hadoop-distcp' when [it > starts|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-distcp/src/main/shellprofile.d/hadoop-distcp.sh], > and the error is returned because the hadoop-distcp.sh does not exist in the > tools directory. > However, that error message confuses us. Since this is not an user end > configuration issue, I would think it's better to change the log level to > debug (hadoop_debug). -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org