Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <
rohithsharm...@huawei.com> wrote:
> There are some issues for compiling Hadoop in win32 platform. Even I am
> facing same issues. I think it is explicitly removed the support.
>
>
>
> But It is possible to compile successfully by tweaking some of the files.
> Follow the below instructions
>
> 1. Apply the patch HADOOP-9922.patch to your 2.6 version
>
> *patch –p1 < HADOOP-9922.patch*
>
> 2. Replace “Release|x64” with “Release|Win32” in
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.sln*
>
> 3. Replace “x64” with “Win32” in
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.vcxproj* and
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *libwinutils.vcxproj*
>
>
>
> If in your machine native compilation does not happen because of cmake not
> installed or any other reason then you will face issue while compiling hdfs
> project. So, for the sake of compiling you can skip native compilation at
> hdfs.
>
> 4. To skip native compilation, add “<skip>${skipTests}</skip>”
> or “<skip>true</skip>” in $HADOOP_HOME
> \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
>
> <configuration>
>
> * <skip>${skipTests}</skip>*
>
> <target>
>
> <mkdir dir="${project.build.directory}/native"/>
>
> Note : there are 2 occurrences, you add at both 2 occurrence
>
>
>
> And compile using “mvn clean install –DskipTests”
>
>
>
> Hope this will help to compile.. enjoy with Hadoop!!!
>
>
>
> Thanks & Regards
>
> Rohith Sharma K S
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com]
> *Sent:* 10 February 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
