[jira] [Commented] (MAPREDUCE-4739) Some MapReduce tests fail to find winutils.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13481505#comment-13481505 ] Raja Aluri commented on MAPREDUCE-4739: --- +1 Looks Good To Me. But is there anyway we can consider packaging all the windows utilities/binaries into a jar file and use them from the jar file? Is that a practical option? Some MapReduce tests fail to find winutils. --- Key: MAPREDUCE-4739 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4739 Project: Hadoop Map/Reduce Issue Type: Bug Components: build, test Affects Versions: 3.0.0 Reporter: Chris Nauroth Attachments: MAPREDUCE-4739-branch-trunk-win.patch All modules inherit a setting in the Surefire configuration for HADOOP_HOME via the hadoop-project pom.xml. This setting is a relative path used in Shell.java to find winutils when running on Windows. The MapReduce modules have a deeper directory structure, which makes the inherited value of HADOOP_HOME invalid and causes some tests to fail while calling winutils. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4739) Some MapReduce tests fail to find winutils.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13481554#comment-13481554 ] Chris Nauroth commented on MAPREDUCE-4739: -- Thank you, Raja. The implementation inside Hadoop Common needs to call winutils.exe as an external process or hadoop.dll as a dynamically linked library. Unfortunately, I do not think there is any way to package these artifacts in jar files. Some MapReduce tests fail to find winutils. --- Key: MAPREDUCE-4739 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4739 Project: Hadoop Map/Reduce Issue Type: Bug Components: build, test Affects Versions: 3.0.0 Reporter: Chris Nauroth Attachments: MAPREDUCE-4739-branch-trunk-win.patch All modules inherit a setting in the Surefire configuration for HADOOP_HOME via the hadoop-project pom.xml. This setting is a relative path used in Shell.java to find winutils when running on Windows. The MapReduce modules have a deeper directory structure, which makes the inherited value of HADOOP_HOME invalid and causes some tests to fail while calling winutils. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira