RE: Error with winutils.sln
Hi Venkat,
I checked the log file
Below is the particular error appearing at line 635 in output.txt you attached.
[ERROR] Could not find project to resume reactor build from:
:hadoop-yarn-web-proxy vs [MavenProject: org.apache.hadoop:hadoop-main:2.6.0 @
D:\h\HADOOP~2.0-S\pom.xml, MavenProject: org.apache.hadoop:hadoop-project:2.6.0
@
I did not face this error. I think it’s not related to windows.
From your log I observed that you are using JDK 8. Not sure if this has any
relation to the issue you are facing.
I had compiled with JDK 7.
I have very limited knowledge of YARN.
Any YARN experts can comment on this issue.
Temporarily, may be you can try skipping build of this particular component
(yarn-web-proxy) by commenting it from pom.xml.
Regards,
Kiran
__
This e-mail and its attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed above.
Any use of the information contained herein in any way (including, but not
limited to, total or partial disclosure, reproduction, or dissemination) by
persons other than the intended recipient(s) is prohibited. If you receive this
e-mail in error, please notify the sender by phone or email immediately and
delete it!
__
From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com]
Sent: Friday, February 13, 2015 06:34
To: Kiran Kumar.M.R
Cc: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module move forward.
Now, I am at a stage where the compilation does not complain about any specific
errors in the modules, but instead about some duplicate entries in
hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me know
what is going wrong, so that I can correct, and move forward?
Thanks Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R
kiran.kumar...@huawei.commailto:kiran.kumar...@huawei.com wrote:
I did following changes to make compilation successful
1.
hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2.
hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, /INCLUDE:_tls_used)
105://#pragma comment(linker, /INCLUDE:pTlsCallback)
Regards,
Kiran
__
This e-mail and its attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed above.
Any use of the information contained herein in any way (including, but not
limited to, total or partial disclosure, reproduction, or dissemination) by
persons other than the intended recipient(s) is prohibited. If you receive this
e-mail in error, please notify the sender by phone or email immediately and
delete it!
__
From: Venkat Ramakrishnan
[mailto:venkat.archit...@gmail.commailto:venkat.archit...@gmail.com]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.orgmailto:user@hadoop.apache.org; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file
hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild.
[exec] Touching
hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate.
[exec] Done Building Project
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj
(default targets).
[exec] Done Building Project
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj
(default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj
(default target) (1) -
[exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj
(default target) (3) -
[exec] (Link target) -
[exec] thread_local_storage.obj : error LNK2001: unresolved external
RE: Error with winutils.sln
I did following changes to make compilation successful
1.
hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2.
hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, /INCLUDE:_tls_used)
105://#pragma comment(linker, /INCLUDE:pTlsCallback)
Regards,
Kiran
__
This e-mail and its attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed above.
Any use of the information contained herein in any way (including, but not
limited to, total or partial disclosure, reproduction, or dissemination) by
persons other than the intended recipient(s) is prohibited. If you receive this
e-mail in error, please notify the sender by phone or email immediately and
delete it!
__
From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file
hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild.
[exec] Touching
hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate.
[exec] Done Building Project
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj
(default targets).
[exec] Done Building Project
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj
(default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj
(default target) (1) -
[exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj
(default target) (3) -
[exec] (Link target) -
[exec] thread_local_storage.obj : error LNK2001: unresolved external
symbol _tls_used
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external
symbol pTlsCallback
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
: fatal error LNK1120: 2 unresolved externals
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO]
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS . FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R
kiran.kumar...@huawei.commailto:kiran.kumar...@huawei.com wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__
This e-mail and its attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed above.
Any use of the information contained herein in any way (including, but not
limited to, total or partial disclosure, reproduction, or dissemination) by
persons other than the intended recipient(s) is prohibited. If you receive this
e-mail in error, please notify the sender by phone or email immediately and
delete it!
__
From: Kiran Kumar.M.R
[mailto:kiran.kumar...@huawei.commailto:kiran.kumar...@huawei.com]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.orgmailto:user@hadoop.apache.org
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop
Re: Error with winutils.sln
Hi Kiran, I made much progress on winutils suggestions that you gave, and I have progressed till hadoop-hdfs module. Thank you for your help! I am getting the following error in the hdfs module: [exec] ClCompile: [exec] All outputs are up-to-date. [exec] Lib: [exec] All outputs are up-to-date. [exec] hdfs_static.vcxproj - D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib [exec] FinalizeBuildStatus: [exec] Deleting file hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild. [exec] Touching hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate. [exec] Done Building Project D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj (default targets). [exec] Done Building Project D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj (default targets) -- FAILED. [exec] [exec] Build FAILED. [exec] [exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj (default target) (1) - [exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj (default target) (3) - [exec] (Link target) - *[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]* * [exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]* * [exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]* [exec] [exec] 0 Warning(s) [exec] 3 Error(s) [exec] [exec] Time Elapsed 00:00:40.39 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS . FAILURE [02:27 min] [INFO] Apache Hadoop HttpFS ... SKIPPED Have you seen this? How to resolve this? Thanks, Venkat. On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R kiran.kumar...@huawei.com wrote: cmake is required. While compiling use below command $mvn clean install –Pnative-win –DskipTests -Pnative-win ensures that windows profile is chose to compile native components Regards, Kiran __ This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! __ *From:* Kiran Kumar.M.R [mailto:kiran.kumar...@huawei.com] *Sent:* Tuesday, February 10, 2015 16:38 *To:* user@hadoop.apache.org *Subject:* RE: Error with winutils.sln To be more precise: 1. Replace x64 with Win32 in following files hadoop-common-project\hadoop-common\src\main\native\native.sln hadoop-common-project\hadoop-common\src\main\native\native.vcxproj hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file hadoop-hdfs-project\hadoop-hdfs\pom.xml Regards, Kiran __ This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! __ *From:* Kiran Kumar.M.R *Sent:* Tuesday, February 10, 2015 16:33 *To:* user@hadoop.apache.org *Subject:* RE: Error with winutils.sln Hi, Build files support only x64 (64 bit). You can add 32bit
RE: Error with winutils.sln
To be more precise: 1. Replace x64 with Win32 in following files hadoop-common-project\hadoop-common\src\main\native\native.sln hadoop-common-project\hadoop-common\src\main\native\native.vcxproj hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file hadoop-hdfs-project\hadoop-hdfs\pom.xml Regards, Kiran __ This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! __ From: Kiran Kumar.M.R Sent: Tuesday, February 10, 2015 16:33 To: user@hadoop.apache.org Subject: RE: Error with winutils.sln Hi, Build files support only x64 (64 bit). You can add 32bit build as below 1. You can edit .sln files and replace x64 with Win32 and the compile. 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs) To replace “Visual Studio 10 Win64” with “Visual Studio 10” Regards, Kiran __ This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! __ From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com] Sent: Tuesday, February 10, 2015 16:22 To: user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: Error with winutils.sln Hello, I'm getting the following error while compiling with Windows 7 (32 bit). I have set the Platform as Win32. The error complains about solution configuration being different from winutils.sln: . . . . [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[pluginorg.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05mailto:sun.misc.Launcher$AppClassLoader@647e05] [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -- [DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml] [DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common [DEBUG] (f) classpathScope = runtime [DEBUG] (f) executable = msbuild [DEBUG] (f) longClasspath = false [DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72mailto:org.apache.maven.execution.MavenSession@157dc72 [DEBUG] (f) skip = false [DEBUG] -- end configuration -- [DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml Build started 07-02-2015 09:55:21. Project D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln on node 1 (default targets). D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration Release|Win32 is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform=Any CPU) or leave those
RE: Error with winutils.sln
Download patch from jira : https://issues.apache.org/jira/i#browse/HADOOP-9922
Thanks Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com]
Sent: 10 February 2015 17:06
To: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S
rohithsharm...@huawei.commailto:rohithsharm...@huawei.com wrote:
There are some issues for compiling Hadoop in win32 platform. Even I am facing
same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files.
Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 HADOOP-9922.patch
2.Replace “Release|x64” with “Release|Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not
installed or any other reason then you will face issue while compiling hdfs
project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “skip${skipTests}/skip” or
“skiptrue/skip” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
configuration
skip${skipTests}/skip
target
mkdir dir=${project.build.directory}/native/
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks Regards
Rohith Sharma K S
From: Venkat Ramakrishnan
[mailto:venkat.archit...@gmail.commailto:venkat.archit...@gmail.com]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.orgmailto:user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
plugin realm ClassRealm[pluginorg.codehaus.mojo:exec-maven-plugin:1.2, parent:
sun.misc.Launcher$AppClassLoader@647e05mailto:sun.misc.Launcher$AppClassLoader@647e05]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with
basic configurator --
[DEBUG] (f) arguments =
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
/nologo, /p:Configuration=Release,
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
/p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir =
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session =
org.apache.maven.execution.MavenSession@157dc72mailto:org.apache.maven.execution.MavenSession@157dc72
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
/nologo /p:Configuration=Release
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
/p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration Release|Win32 is
invalid. Please specify a valid solution configuration using the Configuration
and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug
/p:Platform=Any CPU) or leave those properties blank to use the default
solution configuration.
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
(default targets) -- FAILED.
Build FAILED.
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils
RE: Error with winutils.sln
There are some issues for compiling Hadoop in win32 platform. Even I am facing
same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files.
Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 HADOOP-9922.patch
2.Replace “Release|x64” with “Release|Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not
installed or any other reason then you will face issue while compiling hdfs
project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “skip${skipTests}/skip” or
“skiptrue/skip” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
configuration
skip${skipTests}/skip
target
mkdir dir=${project.build.directory}/native/
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
plugin realm ClassRealm[pluginorg.codehaus.mojo:exec-maven-plugin:1.2, parent:
sun.misc.Launcher$AppClassLoader@647e05mailto:sun.misc.Launcher$AppClassLoader@647e05]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with
basic configurator --
[DEBUG] (f) arguments =
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
/nologo, /p:Configuration=Release,
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
/p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir =
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session =
org.apache.maven.execution.MavenSession@157dc72mailto:org.apache.maven.execution.MavenSession@157dc72
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
/nologo /p:Configuration=Release
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
/p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration Release|Win32 is
invalid. Please specify a valid solution configuration using the Configuration
and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug
/p:Platform=Any CPU) or leave those properties blank to use the default
solution configuration.
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
(default targets) -- FAILED.
Build FAILED.
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
(default target) (1) -
(ValidateSolutionConfiguration target) -
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration Release|Win32 is
invalid. Please specify a valid solution configuration using the Configuration
and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug
/p:Platform=Any CPU) or leave those properties blank to use the default
solution configuration.
Re: Error with winutils.sln
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S
rohithsharm...@huawei.com wrote:
There are some issues for compiling Hadoop in win32 platform. Even I am
facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files.
Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
*patch –p1 HADOOP-9922.patch*
2.Replace “Release|x64” with “Release|Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
*winutils.sln*
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
*winutils.vcxproj* and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
*libwinutils.vcxproj*
If in your machine native compilation does not happen because of cmake not
installed or any other reason then you will face issue while compiling hdfs
project. So, for the sake of compiling you can skip native compilation at
hdfs.
4. To skip native compilation, add “skip${skipTests}/skip”
or “skiptrue/skip” in $HADOOP_HOME
\hadoop-hdfs-project\hadoop-hdfs\pom.xml.
configuration
* skip${skipTests}/skip*
target
mkdir dir=${project.build.directory}/native/
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks Regards
Rohith Sharma K S
*From:* Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com]
*Sent:* 10 February 2015 16:22
*To:* user@hadoop.apache.org
*Subject:* Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
plugin realm ClassRealm[pluginorg.codehaus.mojo:exec-maven-plugin:1.2,
parent: sun.misc.Launcher$AppClassLoader@647e05]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
with basic configurator --
[DEBUG] (f) arguments =
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
/nologo, /p:Configuration=Release,
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
/p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir =
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject:
org.apache.hadoop:hadoop-common:2.6.0 @
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
/nologo /p:Configuration=Release
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
/p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration Release|Win32 is
invalid. Please specify a valid solution configuration using the
Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
/p:Configuration=Debug /p:Platform=Any CPU) or leave those properties
blank to use the default solution configuration.
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
(default targets) -- FAILED.
Build FAILED.
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
(default target) (1) -
(ValidateSolutionConfiguration target) -
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration Release|Win32 is
invalid. Please specify a valid solution configuration using the
Configuration and Platform properties
RE: Error with winutils.sln
cmake is required. While compiling use below command $mvn clean install –Pnative-win –DskipTests -Pnative-win ensures that windows profile is chose to compile native components Regards, Kiran __ This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! __ From: Kiran Kumar.M.R [mailto:kiran.kumar...@huawei.com] Sent: Tuesday, February 10, 2015 16:38 To: user@hadoop.apache.org Subject: RE: Error with winutils.sln To be more precise: 1. Replace x64 with Win32 in following files hadoop-common-project\hadoop-common\src\main\native\native.sln hadoop-common-project\hadoop-common\src\main\native\native.vcxproj hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file hadoop-hdfs-project\hadoop-hdfs\pom.xml Regards, Kiran __ This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! __ From: Kiran Kumar.M.R Sent: Tuesday, February 10, 2015 16:33 To: user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: RE: Error with winutils.sln Hi, Build files support only x64 (64 bit). You can add 32bit build as below 1. You can edit .sln files and replace x64 with Win32 and the compile. 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs) To replace “Visual Studio 10 Win64” with “Visual Studio 10” Regards, Kiran __ This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! __ From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com] Sent: Tuesday, February 10, 2015 16:22 To: user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: Error with winutils.sln Hello, I'm getting the following error while compiling with Windows 7 (32 bit). I have set the Platform as Win32. The error complains about solution configuration being different from winutils.sln: . . . . [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[pluginorg.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05mailto:sun.misc.Launcher$AppClassLoader@647e05] [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -- [DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml] [DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common [DEBUG] (f) classpathScope = runtime [DEBUG] (f) executable = msbuild [DEBUG] (f) longClasspath = false [DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml [DEBUG] (f) session
