Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj ->
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file
"hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching
"hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
(default targets).
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default target) (1) ->
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
(default target) (3) ->
[exec] (Link target) ->
*[exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol _tls_used
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol pTlsCallback
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
: fatal error LNK1120: 2 unresolved externals
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <kiran.kumar...@huawei.com>
wrote:
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:kiran.kumar...@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com
> <venkat.archit...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
