Re: Help running hadoop example

[Sindhu Hosamane]

May be u should give the complete path of jar file . 
That is absolute path . 

Best Regards,
Sindhu

> On 14.06.2014, at 01:22, Ryan de Vera  wrote:
> 
> Hello everyone,
> 
> I just downloaded Hadoop verision 1.2.1 to my macbook and I am having trouble 
> running the example. I used this tutorial 
> http://wiki.apache.org/hadoop/Running_Hadoop_On_OS_X_10.5_64-bit_(Single-Node_Cluster).
>  I am having trouble running the example.
> 
> When I run
> hadoop-*/bin/hadoop jar hadoop-examples-1.2.1.jar grep input output 
> 'dfs[a-z.]+'
> 
> I get the error that it is not a valid jar. what am I doing wrong?
> 
> Best regards,
> 
> Ryan
> 
> 

Re: Cloudera VM

[Stephen Boesch]

Hi Shashi,
   apologies, I was working on CDH5  enterprise (real deal) today and had
misremembered the settings for the VM

the VM uses */opt/cloudera/parcels/CDH/lib/*[hive|hadoop|hbase]


2014-06-13 22:51 GMT-07:00 Maisnam Ns :

> Hi Stephen,
>
> Your last command ls -lrta /etc/hadoop worked , but when I tried this
> command I could not find hadoop|hive|hbase etc, where are they located, the
> actual hadoop directory
> [cloudera@localhost /]$ ls /usr/lib
> anaconda-runtime  hue java-1.5.0   jvm-exports  rpm
> bonobojavajava-1.6.0   jvm-private  ruby
> ConsoleKitjava-1.3.1  java-1.7.0   locale   sendmail
> cups  java-1.4.0  java-ext lsb  sendmail.postfix
> games java-1.4.1  jvm  mozilla  vmware-tools
> gcc   java-1.4.2  jvm-commmon  python2.6yum-plugins
>
>
> Thanks
> shashi
>
>
> On Sat, Jun 14, 2014 at 10:30 AM, Stephen Boesch 
> wrote:
>
>> Hi Shashidhar,
>>   They are under /etc/[hadoop|hbase|hive|etc]/conf as symlinks   to
>> /usr/lib/[hadoop|hbase|hive|etc]
>>
>> [cloudera@localhost CDH]$ ll -Ld /etc/h*
>>
>> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hadoop-httpfs
>> drwxr-xr-x. 3 root root 4096 Apr  4 10:36 /etc/hal
>> drwxr-xr-x. 3 root root 4096 Jun  8 16:37 /etc/hbase
>> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hbase-solr
>> drwxr-xr-x. 3 root root 4096 Jun  8 16:37 /etc/hive
>> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hive-hcatalog
>> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hive-webhcat
>> -rw-r--r--. 1 root root9 Sep 23  2011 /etc/host.conf
>> -rw-r--r--. 1 root root   46 Apr  4 10:36 /etc/hosts
>> -rw-r--r--. 1 root root  370 Jan 12  2010 /etc/hosts.allow
>> -rw-r--r--. 1 root root  460 Jan 12  2010 /etc/hosts.deny
>> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hue
>>
>>
>> [cloudera@localhost CDH]$ *ls -lrta /etc/hadoop*
>> total 16
>> drwxr-xr-x.   2 root root 4096 Apr  4 11:21 conf.cloudera.hdfs
>> lrwxrwxrwx1 root root   29 Jun  8 16:37 *conf ->
>> /etc/alternatives/hadoop-conf*
>> drwxr-xr-x.   4 root root 4096 Jun  8 16:37 .
>> drwxr-xr-x.   2 cloudera cloudera 4096 Jun  8 19:14 conf.cloudera.yarn
>> drwxr-xr-x. 113 root root 4096 Jun 13 21:57 ..
>>
>>
>>
>>
>> 2014-06-13 21:42 GMT-07:00 Shashidhar Rao :
>>
>> Hi,
>>>
>>> I just installed cloudera vm 5 .x on vmplayer. Can somebody having
>>> experience with cloudera help me in finding where are the *-site.xml files
>>> so that I can configure the various settings.
>>>
>>>
>>>
>>> Thanks
>>> Shashi
>>>
>>
>>
>

Re: Cloudera VM

[Maisnam Ns]

Hi Stephen,

Your last command ls -lrta /etc/hadoop worked , but when I tried this
command I could not find hadoop|hive|hbase etc, where are they located, the
actual hadoop directory
[cloudera@localhost /]$ ls /usr/lib
anaconda-runtime  hue java-1.5.0   jvm-exports  rpm
bonobojavajava-1.6.0   jvm-private  ruby
ConsoleKitjava-1.3.1  java-1.7.0   locale   sendmail
cups  java-1.4.0  java-ext lsb  sendmail.postfix
games java-1.4.1  jvm  mozilla  vmware-tools
gcc   java-1.4.2  jvm-commmon  python2.6yum-plugins


Thanks
shashi


On Sat, Jun 14, 2014 at 10:30 AM, Stephen Boesch  wrote:

> Hi Shashidhar,
>   They are under /etc/[hadoop|hbase|hive|etc]/conf as symlinks   to
> /usr/lib/[hadoop|hbase|hive|etc]
>
> [cloudera@localhost CDH]$ ll -Ld /etc/h*
>
> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hadoop-httpfs
> drwxr-xr-x. 3 root root 4096 Apr  4 10:36 /etc/hal
> drwxr-xr-x. 3 root root 4096 Jun  8 16:37 /etc/hbase
> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hbase-solr
> drwxr-xr-x. 3 root root 4096 Jun  8 16:37 /etc/hive
> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hive-hcatalog
> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hive-webhcat
> -rw-r--r--. 1 root root9 Sep 23  2011 /etc/host.conf
> -rw-r--r--. 1 root root   46 Apr  4 10:36 /etc/hosts
> -rw-r--r--. 1 root root  370 Jan 12  2010 /etc/hosts.allow
> -rw-r--r--. 1 root root  460 Jan 12  2010 /etc/hosts.deny
> drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hue
>
>
> [cloudera@localhost CDH]$ *ls -lrta /etc/hadoop*
> total 16
> drwxr-xr-x.   2 root root 4096 Apr  4 11:21 conf.cloudera.hdfs
> lrwxrwxrwx1 root root   29 Jun  8 16:37 *conf ->
> /etc/alternatives/hadoop-conf*
> drwxr-xr-x.   4 root root 4096 Jun  8 16:37 .
> drwxr-xr-x.   2 cloudera cloudera 4096 Jun  8 19:14 conf.cloudera.yarn
> drwxr-xr-x. 113 root root 4096 Jun 13 21:57 ..
>
>
>
>
> 2014-06-13 21:42 GMT-07:00 Shashidhar Rao :
>
> Hi,
>>
>> I just installed cloudera vm 5 .x on vmplayer. Can somebody having
>> experience with cloudera help me in finding where are the *-site.xml files
>> so that I can configure the various settings.
>>
>>
>>
>> Thanks
>> Shashi
>>
>
>

Re: Cloudera VM

[Stephen Boesch]

Hi Shashidhar,
  They are under /etc/[hadoop|hbase|hive|etc]/conf as symlinks   to
/usr/lib/[hadoop|hbase|hive|etc]

[cloudera@localhost CDH]$ ll -Ld /etc/h*

drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hadoop-httpfs
drwxr-xr-x. 3 root root 4096 Apr  4 10:36 /etc/hal
drwxr-xr-x. 3 root root 4096 Jun  8 16:37 /etc/hbase
drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hbase-solr
drwxr-xr-x. 3 root root 4096 Jun  8 16:37 /etc/hive
drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hive-hcatalog
drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hive-webhcat
-rw-r--r--. 1 root root9 Sep 23  2011 /etc/host.conf
-rw-r--r--. 1 root root   46 Apr  4 10:36 /etc/hosts
-rw-r--r--. 1 root root  370 Jan 12  2010 /etc/hosts.allow
-rw-r--r--. 1 root root  460 Jan 12  2010 /etc/hosts.deny
drwxr-xr-x  2 root root 4096 Jun  8 16:37 /etc/hue


[cloudera@localhost CDH]$ *ls -lrta /etc/hadoop*
total 16
drwxr-xr-x.   2 root root 4096 Apr  4 11:21 conf.cloudera.hdfs
lrwxrwxrwx1 root root   29 Jun  8 16:37 *conf ->
/etc/alternatives/hadoop-conf*
drwxr-xr-x.   4 root root 4096 Jun  8 16:37 .
drwxr-xr-x.   2 cloudera cloudera 4096 Jun  8 19:14 conf.cloudera.yarn
drwxr-xr-x. 113 root root 4096 Jun 13 21:57 ..




2014-06-13 21:42 GMT-07:00 Shashidhar Rao :

> Hi,
>
> I just installed cloudera vm 5 .x on vmplayer. Can somebody having
> experience with cloudera help me in finding where are the *-site.xml files
> so that I can configure the various settings.
>
>
>
> Thanks
> Shashi
>

Cloudera VM

[Shashidhar Rao]

Hi,

I just installed cloudera vm 5 .x on vmplayer. Can somebody having
experience with cloudera help me in finding where are the *-site.xml files
so that I can configure the various settings.



Thanks
Shashi

Help running hadoop example

[Ryan de Vera]

Hello everyone,

I just downloaded Hadoop verision 1.2.1 to my macbook and I am having
trouble running the example. I used this
tutorial 
http://wiki.apache.org/hadoop/Running_Hadoop_On_OS_X_10.5_64-bit_(Single-Node_Cluster)
.
I am having trouble running the example.

When I run
hadoop-*/bin/hadoop jar hadoop-examples-1.2.1.jar grep input output
'dfs[a-z.]+'

I get the error that it is not a valid jar. what am I doing wrong?

Best regards,

Ryan

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

Thanks bo.

Regards,

Nestor


On Fri, Jun 13, 2014 at 5:00 PM, bo yang  wrote:

> Just share my experience. I hit build issue on Windows 8 previously. Then
> I have to use Visual Studio to open the sln file, and build inside Visual
> Studio. After that, I could finish the build of hadoop 2.4.
>
>
> On Fri, Jun 13, 2014 at 2:26 PM, Arpit Agarwal 
> wrote:
>
>> No idea. Can you just try to update the environment in the cmd window to
>> point to the latest .NET and rebuild?
>>
>>
>> On Fri, Jun 13, 2014 at 2:12 PM, Néstor Boscán 
>> wrote:
>>
>>> Thanks for the help
>>>
>>> I have the latest .NET Framework installed. Checking the enviroment
>>> variables Windows SDK is pointing to 3.5. I'm not very knowledgable of
>>> Windows Development. Is there a way to point to .Net 4?
>>>
>>> Regards,
>>>
>>> Nestor
>>>
>>>
>>> On Fri, Jun 13, 2014 at 4:26 PM, Arpit Agarwal >> > wrote:
>>>
 Google search for the error message shows this.


 https://stackoverflow.com/questions/5107757/using-msbuild-with-vs2010-generated-vcxproj-file-as-target-error-msb4066-at

 Tried updating .NET?


 On Fri, Jun 13, 2014 at 12:21 PM, Néstor Boscán 
 wrote:

> Tried to build using 32bit same error.
>
> Regards,
>
> Nestor
>
>
> On Fri, Jun 13, 2014 at 2:41 PM, Néstor Boscán 
> wrote:
>
>> Hi Arpit
>>
>> Yes I'm using the Windows SDK Command Prompt. I only use cygwin for
>> the dependency with make, ssh, etc.
>>
>> Here's the Haddop Common compilation:
>>
>> [INFO]
>> 
>> [INFO] Building Apache Hadoop Common 2.4.0
>> [INFO]
>> 
>> [INFO]
>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-os) @
>> hadoop-common ---
>> [INFO]
>> [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @
>> hadoop-common ---
>> [INFO] Executing tasks
>>
>> main:
>> [INFO] Executed tasks
>> [INFO]
>> [INFO] --- hadoop-maven-plugins:2.4.0:protoc (compile-protoc) @
>> hadoop-common ---
>> [INFO]
>> [INFO] --- hadoop-maven-plugins:2.4.0:version-info (version-info) @
>> hadoop-common ---
>> [WARNING] [svn, info] failed with error code 1
>> [WARNING] [git, branch] failed: java.io.IOException: Cannot run
>> program "git": CreateProcess error=2, The system cannot find the file
>> specified
>> [INFO] SCM: NONE
>> [INFO] Computed MD5: 375b2832a6641759c6eaf6e3e998147
>> [INFO]
>> [INFO] --- maven-resources-plugin:2.2:resources (default-resources) @
>> hadoop-common ---
>> [INFO] Using default encoding to copy filtered resources.
>> [INFO]
>> [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
>> hadoop-common ---
>> [INFO] Compiling 13 source files to
>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes
>> [INFO]
>> [INFO] --- native-maven-plugin:1.0-alpha-7:javah (default) @
>> hadoop-common ---
>> [INFO] cmd.exe /X /C "C:\PROGRA~1\Java\jdk1.6.0_45\bin\javah -d
>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\native\javah
>> -classpath
>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes;C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-annotations\target\hadoop-annotations-2.4.0.jar;C:\PROGRA~1\Java\jdk1.6.0_45\jre\..\lib\tools.jar;C:\Desarrollo\maven\repositorio\com\google\guava\guava\11.0.2\guava-11.0.2.jar;C:\Desarrollo\maven\repositorio\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;C:\Desarrollo\maven\repositorio\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;C:\Desarrollo\maven\repositorio\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;C:\Desarrollo\maven\repositorio\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;C:\Desarrollo\maven\repositorio\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;C:\Desarrollo\maven\repositorio\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Desarrollo\maven\repositorio\commons-net\commons-net\3.1\commons-net-3.1.jar;C:\Desarrollo\maven\repositorio\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;C:\Desarrollo\maven\repositorio\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;C:\Desarrollo\maven\repositorio\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;C:\Desarrollo\maven\reposito

Re: Fwd: Trying to build Hadoop on Windows 8

[bo yang]

Just share my experience. I hit build issue on Windows 8 previously. Then I
have to use Visual Studio to open the sln file, and build inside Visual
Studio. After that, I could finish the build of hadoop 2.4.


On Fri, Jun 13, 2014 at 2:26 PM, Arpit Agarwal 
wrote:

> No idea. Can you just try to update the environment in the cmd window to
> point to the latest .NET and rebuild?
>
>
> On Fri, Jun 13, 2014 at 2:12 PM, Néstor Boscán  wrote:
>
>> Thanks for the help
>>
>> I have the latest .NET Framework installed. Checking the enviroment
>> variables Windows SDK is pointing to 3.5. I'm not very knowledgable of
>> Windows Development. Is there a way to point to .Net 4?
>>
>> Regards,
>>
>> Nestor
>>
>>
>> On Fri, Jun 13, 2014 at 4:26 PM, Arpit Agarwal 
>> wrote:
>>
>>> Google search for the error message shows this.
>>>
>>>
>>> https://stackoverflow.com/questions/5107757/using-msbuild-with-vs2010-generated-vcxproj-file-as-target-error-msb4066-at
>>>
>>> Tried updating .NET?
>>>
>>>
>>> On Fri, Jun 13, 2014 at 12:21 PM, Néstor Boscán 
>>> wrote:
>>>
 Tried to build using 32bit same error.

 Regards,

 Nestor


 On Fri, Jun 13, 2014 at 2:41 PM, Néstor Boscán 
 wrote:

> Hi Arpit
>
> Yes I'm using the Windows SDK Command Prompt. I only use cygwin for
> the dependency with make, ssh, etc.
>
> Here's the Haddop Common compilation:
>
> [INFO]
> 
> [INFO] Building Apache Hadoop Common 2.4.0
> [INFO]
> 
> [INFO]
> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-os) @
> hadoop-common ---
> [INFO]
> [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @
> hadoop-common ---
> [INFO] Executing tasks
>
> main:
> [INFO] Executed tasks
> [INFO]
> [INFO] --- hadoop-maven-plugins:2.4.0:protoc (compile-protoc) @
> hadoop-common ---
> [INFO]
> [INFO] --- hadoop-maven-plugins:2.4.0:version-info (version-info) @
> hadoop-common ---
> [WARNING] [svn, info] failed with error code 1
> [WARNING] [git, branch] failed: java.io.IOException: Cannot run
> program "git": CreateProcess error=2, The system cannot find the file
> specified
> [INFO] SCM: NONE
> [INFO] Computed MD5: 375b2832a6641759c6eaf6e3e998147
> [INFO]
> [INFO] --- maven-resources-plugin:2.2:resources (default-resources) @
> hadoop-common ---
> [INFO] Using default encoding to copy filtered resources.
> [INFO]
> [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
> hadoop-common ---
> [INFO] Compiling 13 source files to
> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes
> [INFO]
> [INFO] --- native-maven-plugin:1.0-alpha-7:javah (default) @
> hadoop-common ---
> [INFO] cmd.exe /X /C "C:\PROGRA~1\Java\jdk1.6.0_45\bin\javah -d
> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\native\javah
> -classpath
> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes;C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-annotations\target\hadoop-annotations-2.4.0.jar;C:\PROGRA~1\Java\jdk1.6.0_45\jre\..\lib\tools.jar;C:\Desarrollo\maven\repositorio\com\google\guava\guava\11.0.2\guava-11.0.2.jar;C:\Desarrollo\maven\repositorio\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;C:\Desarrollo\maven\repositorio\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;C:\Desarrollo\maven\repositorio\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;C:\Desarrollo\maven\repositorio\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;C:\Desarrollo\maven\repositorio\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;C:\Desarrollo\maven\repositorio\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Desarrollo\maven\repositorio\commons-net\commons-net\3.1\commons-net-3.1.jar;C:\Desarrollo\maven\repositorio\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;C:\Desarrollo\maven\repositorio\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;C:\Desarrollo\maven\repositorio\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;C:\Desarrollo\maven\repositorio\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;C:\Desarrollo\maven\repositorio\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;C:\Desarrollo\maven\repositorio\javax\activation\act

Re: Fwd: Trying to build Hadoop on Windows 8

[Arpit Agarwal]

No idea. Can you just try to update the environment in the cmd window to
point to the latest .NET and rebuild?


On Fri, Jun 13, 2014 at 2:12 PM, Néstor Boscán  wrote:

> Thanks for the help
>
> I have the latest .NET Framework installed. Checking the enviroment
> variables Windows SDK is pointing to 3.5. I'm not very knowledgable of
> Windows Development. Is there a way to point to .Net 4?
>
> Regards,
>
> Nestor
>
>
> On Fri, Jun 13, 2014 at 4:26 PM, Arpit Agarwal 
> wrote:
>
>> Google search for the error message shows this.
>>
>>
>> https://stackoverflow.com/questions/5107757/using-msbuild-with-vs2010-generated-vcxproj-file-as-target-error-msb4066-at
>>
>> Tried updating .NET?
>>
>>
>> On Fri, Jun 13, 2014 at 12:21 PM, Néstor Boscán 
>> wrote:
>>
>>> Tried to build using 32bit same error.
>>>
>>> Regards,
>>>
>>> Nestor
>>>
>>>
>>> On Fri, Jun 13, 2014 at 2:41 PM, Néstor Boscán 
>>> wrote:
>>>
 Hi Arpit

 Yes I'm using the Windows SDK Command Prompt. I only use cygwin for the
 dependency with make, ssh, etc.

 Here's the Haddop Common compilation:

 [INFO]
 
 [INFO] Building Apache Hadoop Common 2.4.0
 [INFO]
 
 [INFO]
 [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-os) @
 hadoop-common ---
 [INFO]
 [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @
 hadoop-common ---
 [INFO] Executing tasks

 main:
 [INFO] Executed tasks
 [INFO]
 [INFO] --- hadoop-maven-plugins:2.4.0:protoc (compile-protoc) @
 hadoop-common ---
 [INFO]
 [INFO] --- hadoop-maven-plugins:2.4.0:version-info (version-info) @
 hadoop-common ---
 [WARNING] [svn, info] failed with error code 1
 [WARNING] [git, branch] failed: java.io.IOException: Cannot run program
 "git": CreateProcess error=2, The system cannot find the file specified
 [INFO] SCM: NONE
 [INFO] Computed MD5: 375b2832a6641759c6eaf6e3e998147
 [INFO]
 [INFO] --- maven-resources-plugin:2.2:resources (default-resources) @
 hadoop-common ---
 [INFO] Using default encoding to copy filtered resources.
 [INFO]
 [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
 hadoop-common ---
 [INFO] Compiling 13 source files to
 C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes
 [INFO]
 [INFO] --- native-maven-plugin:1.0-alpha-7:javah (default) @
 hadoop-common ---
 [INFO] cmd.exe /X /C "C:\PROGRA~1\Java\jdk1.6.0_45\bin\javah -d
 C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\native\javah
 -classpath
 C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes;C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-annotations\target\hadoop-annotations-2.4.0.jar;C:\PROGRA~1\Java\jdk1.6.0_45\jre\..\lib\tools.jar;C:\Desarrollo\maven\repositorio\com\google\guava\guava\11.0.2\guava-11.0.2.jar;C:\Desarrollo\maven\repositorio\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;C:\Desarrollo\maven\repositorio\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;C:\Desarrollo\maven\repositorio\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;C:\Desarrollo\maven\repositorio\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;C:\Desarrollo\maven\repositorio\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;C:\Desarrollo\maven\repositorio\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Desarrollo\maven\repositorio\commons-net\commons-net\3.1\commons-net-3.1.jar;C:\Desarrollo\maven\repositorio\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;C:\Desarrollo\maven\repositorio\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;C:\Desarrollo\maven\repositorio\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;C:\Desarrollo\maven\repositorio\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;C:\Desarrollo\maven\repositorio\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;C:\Desarrollo\maven\repositorio\javax\activation\activation\1.1\activation-1.1.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-jaxrs\1.8.8\jackson-jaxrs-1.8.8.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-xc\1.8.8\jackson-xc-1.8.8.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;C:\Desarrollo\maven\repositorio\asm\asm\3.2\asm-3.2.jar;C:\

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

Thanks for the help

I have the latest .NET Framework installed. Checking the enviroment
variables Windows SDK is pointing to 3.5. I'm not very knowledgable of
Windows Development. Is there a way to point to .Net 4?

Regards,

Nestor


On Fri, Jun 13, 2014 at 4:26 PM, Arpit Agarwal 
wrote:

> Google search for the error message shows this.
>
>
> https://stackoverflow.com/questions/5107757/using-msbuild-with-vs2010-generated-vcxproj-file-as-target-error-msb4066-at
>
> Tried updating .NET?
>
>
> On Fri, Jun 13, 2014 at 12:21 PM, Néstor Boscán 
> wrote:
>
>> Tried to build using 32bit same error.
>>
>> Regards,
>>
>> Nestor
>>
>>
>> On Fri, Jun 13, 2014 at 2:41 PM, Néstor Boscán 
>> wrote:
>>
>>> Hi Arpit
>>>
>>> Yes I'm using the Windows SDK Command Prompt. I only use cygwin for the
>>> dependency with make, ssh, etc.
>>>
>>> Here's the Haddop Common compilation:
>>>
>>> [INFO]
>>> 
>>> [INFO] Building Apache Hadoop Common 2.4.0
>>> [INFO]
>>> 
>>> [INFO]
>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-os) @
>>> hadoop-common ---
>>> [INFO]
>>> [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-common
>>> ---
>>> [INFO] Executing tasks
>>>
>>> main:
>>> [INFO] Executed tasks
>>> [INFO]
>>> [INFO] --- hadoop-maven-plugins:2.4.0:protoc (compile-protoc) @
>>> hadoop-common ---
>>> [INFO]
>>> [INFO] --- hadoop-maven-plugins:2.4.0:version-info (version-info) @
>>> hadoop-common ---
>>> [WARNING] [svn, info] failed with error code 1
>>> [WARNING] [git, branch] failed: java.io.IOException: Cannot run program
>>> "git": CreateProcess error=2, The system cannot find the file specified
>>> [INFO] SCM: NONE
>>> [INFO] Computed MD5: 375b2832a6641759c6eaf6e3e998147
>>> [INFO]
>>> [INFO] --- maven-resources-plugin:2.2:resources (default-resources) @
>>> hadoop-common ---
>>> [INFO] Using default encoding to copy filtered resources.
>>> [INFO]
>>> [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
>>> hadoop-common ---
>>> [INFO] Compiling 13 source files to
>>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes
>>> [INFO]
>>> [INFO] --- native-maven-plugin:1.0-alpha-7:javah (default) @
>>> hadoop-common ---
>>> [INFO] cmd.exe /X /C "C:\PROGRA~1\Java\jdk1.6.0_45\bin\javah -d
>>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\native\javah
>>> -classpath
>>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes;C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-annotations\target\hadoop-annotations-2.4.0.jar;C:\PROGRA~1\Java\jdk1.6.0_45\jre\..\lib\tools.jar;C:\Desarrollo\maven\repositorio\com\google\guava\guava\11.0.2\guava-11.0.2.jar;C:\Desarrollo\maven\repositorio\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;C:\Desarrollo\maven\repositorio\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;C:\Desarrollo\maven\repositorio\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;C:\Desarrollo\maven\repositorio\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;C:\Desarrollo\maven\repositorio\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;C:\Desarrollo\maven\repositorio\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Desarrollo\maven\repositorio\commons-net\commons-net\3.1\commons-net-3.1.jar;C:\Desarrollo\maven\repositorio\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;C:\Desarrollo\maven\repositorio\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;C:\Desarrollo\maven\repositorio\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;C:\Desarrollo\maven\repositorio\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;C:\Desarrollo\maven\repositorio\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;C:\Desarrollo\maven\repositorio\javax\activation\activation\1.1\activation-1.1.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-jaxrs\1.8.8\jackson-jaxrs-1.8.8.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-xc\1.8.8\jackson-xc-1.8.8.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;C:\Desarrollo\maven\repositorio\asm\asm\3.2\asm-3.2.jar;C:\Desarrollo\maven\repositorio\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;C:\Desarrollo\maven\repositorio\log4j\log4j\1.2.17\log4j-1.2.17.jar;C:\Desarrollo\maven\repositorio\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;C:\Desarrollo\mave

Re: Fwd: Trying to build Hadoop on Windows 8

[Arpit Agarwal]

Google search for the error message shows this.

https://stackoverflow.com/questions/5107757/using-msbuild-with-vs2010-generated-vcxproj-file-as-target-error-msb4066-at

Tried updating .NET?


On Fri, Jun 13, 2014 at 12:21 PM, Néstor Boscán  wrote:

> Tried to build using 32bit same error.
>
> Regards,
>
> Nestor
>
>
> On Fri, Jun 13, 2014 at 2:41 PM, Néstor Boscán  wrote:
>
>> Hi Arpit
>>
>> Yes I'm using the Windows SDK Command Prompt. I only use cygwin for the
>> dependency with make, ssh, etc.
>>
>> Here's the Haddop Common compilation:
>>
>> [INFO]
>> 
>> [INFO] Building Apache Hadoop Common 2.4.0
>> [INFO]
>> 
>> [INFO]
>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-os) @
>> hadoop-common ---
>> [INFO]
>> [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-common
>> ---
>> [INFO] Executing tasks
>>
>> main:
>> [INFO] Executed tasks
>> [INFO]
>> [INFO] --- hadoop-maven-plugins:2.4.0:protoc (compile-protoc) @
>> hadoop-common ---
>> [INFO]
>> [INFO] --- hadoop-maven-plugins:2.4.0:version-info (version-info) @
>> hadoop-common ---
>> [WARNING] [svn, info] failed with error code 1
>> [WARNING] [git, branch] failed: java.io.IOException: Cannot run program
>> "git": CreateProcess error=2, The system cannot find the file specified
>> [INFO] SCM: NONE
>> [INFO] Computed MD5: 375b2832a6641759c6eaf6e3e998147
>> [INFO]
>> [INFO] --- maven-resources-plugin:2.2:resources (default-resources) @
>> hadoop-common ---
>> [INFO] Using default encoding to copy filtered resources.
>> [INFO]
>> [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
>> hadoop-common ---
>> [INFO] Compiling 13 source files to
>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes
>> [INFO]
>> [INFO] --- native-maven-plugin:1.0-alpha-7:javah (default) @
>> hadoop-common ---
>> [INFO] cmd.exe /X /C "C:\PROGRA~1\Java\jdk1.6.0_45\bin\javah -d
>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\native\javah
>> -classpath
>> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes;C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-annotations\target\hadoop-annotations-2.4.0.jar;C:\PROGRA~1\Java\jdk1.6.0_45\jre\..\lib\tools.jar;C:\Desarrollo\maven\repositorio\com\google\guava\guava\11.0.2\guava-11.0.2.jar;C:\Desarrollo\maven\repositorio\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;C:\Desarrollo\maven\repositorio\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;C:\Desarrollo\maven\repositorio\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;C:\Desarrollo\maven\repositorio\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;C:\Desarrollo\maven\repositorio\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;C:\Desarrollo\maven\repositorio\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Desarrollo\maven\repositorio\commons-net\commons-net\3.1\commons-net-3.1.jar;C:\Desarrollo\maven\repositorio\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;C:\Desarrollo\maven\repositorio\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;C:\Desarrollo\maven\repositorio\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;C:\Desarrollo\maven\repositorio\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;C:\Desarrollo\maven\repositorio\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;C:\Desarrollo\maven\repositorio\javax\activation\activation\1.1\activation-1.1.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-jaxrs\1.8.8\jackson-jaxrs-1.8.8.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-xc\1.8.8\jackson-xc-1.8.8.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;C:\Desarrollo\maven\repositorio\asm\asm\3.2\asm-3.2.jar;C:\Desarrollo\maven\repositorio\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;C:\Desarrollo\maven\repositorio\log4j\log4j\1.2.17\log4j-1.2.17.jar;C:\Desarrollo\maven\repositorio\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;C:\Desarrollo\maven\repositorio\org\apache\httpcomponents\httpclient\4.2.5\httpclient-4.2.5.jar;C:\Desarrollo\maven\repositorio\org\apache\httpcomponents\httpcore\4.2.5\httpcore-4.2.5.jar;C:\Desarrollo\maven\repositorio\com\jamesmurty\utils\java-xmlbuilder\0.4\java-xmlbuilder-0.4.jar;C:\Desarrollo\maven\repositorio\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;C:\Desarrollo\maven\

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

Tried to build using 32bit same error.

Regards,

Nestor


On Fri, Jun 13, 2014 at 2:41 PM, Néstor Boscán  wrote:

> Hi Arpit
>
> Yes I'm using the Windows SDK Command Prompt. I only use cygwin for the
> dependency with make, ssh, etc.
>
> Here's the Haddop Common compilation:
>
> [INFO]
> 
> [INFO] Building Apache Hadoop Common 2.4.0
> [INFO]
> 
> [INFO]
> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-os) @
> hadoop-common ---
> [INFO]
> [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-common
> ---
> [INFO] Executing tasks
>
> main:
> [INFO] Executed tasks
> [INFO]
> [INFO] --- hadoop-maven-plugins:2.4.0:protoc (compile-protoc) @
> hadoop-common ---
> [INFO]
> [INFO] --- hadoop-maven-plugins:2.4.0:version-info (version-info) @
> hadoop-common ---
> [WARNING] [svn, info] failed with error code 1
> [WARNING] [git, branch] failed: java.io.IOException: Cannot run program
> "git": CreateProcess error=2, The system cannot find the file specified
> [INFO] SCM: NONE
> [INFO] Computed MD5: 375b2832a6641759c6eaf6e3e998147
> [INFO]
> [INFO] --- maven-resources-plugin:2.2:resources (default-resources) @
> hadoop-common ---
> [INFO] Using default encoding to copy filtered resources.
> [INFO]
> [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
> hadoop-common ---
> [INFO] Compiling 13 source files to
> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes
> [INFO]
> [INFO] --- native-maven-plugin:1.0-alpha-7:javah (default) @ hadoop-common
> ---
> [INFO] cmd.exe /X /C "C:\PROGRA~1\Java\jdk1.6.0_45\bin\javah -d
> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\native\javah
> -classpath
> C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes;C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-annotations\target\hadoop-annotations-2.4.0.jar;C:\PROGRA~1\Java\jdk1.6.0_45\jre\..\lib\tools.jar;C:\Desarrollo\maven\repositorio\com\google\guava\guava\11.0.2\guava-11.0.2.jar;C:\Desarrollo\maven\repositorio\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;C:\Desarrollo\maven\repositorio\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;C:\Desarrollo\maven\repositorio\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;C:\Desarrollo\maven\repositorio\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;C:\Desarrollo\maven\repositorio\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;C:\Desarrollo\maven\repositorio\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Desarrollo\maven\repositorio\commons-net\commons-net\3.1\commons-net-3.1.jar;C:\Desarrollo\maven\repositorio\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;C:\Desarrollo\maven\repositorio\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;C:\Desarrollo\maven\repositorio\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;C:\Desarrollo\maven\repositorio\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;C:\Desarrollo\maven\repositorio\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;C:\Desarrollo\maven\repositorio\javax\activation\activation\1.1\activation-1.1.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-jaxrs\1.8.8\jackson-jaxrs-1.8.8.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-xc\1.8.8\jackson-xc-1.8.8.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;C:\Desarrollo\maven\repositorio\asm\asm\3.2\asm-3.2.jar;C:\Desarrollo\maven\repositorio\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;C:\Desarrollo\maven\repositorio\log4j\log4j\1.2.17\log4j-1.2.17.jar;C:\Desarrollo\maven\repositorio\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;C:\Desarrollo\maven\repositorio\org\apache\httpcomponents\httpclient\4.2.5\httpclient-4.2.5.jar;C:\Desarrollo\maven\repositorio\org\apache\httpcomponents\httpcore\4.2.5\httpcore-4.2.5.jar;C:\Desarrollo\maven\repositorio\com\jamesmurty\utils\java-xmlbuilder\0.4\java-xmlbuilder-0.4.jar;C:\Desarrollo\maven\repositorio\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;C:\Desarrollo\maven\repositorio\commons-configuration\commons-configuration\1.6\commons-configuration-1.6.jar;C:\Desarrollo\maven\repositorio\commons-digester\commons-digester\1.8\commons-digester-1.8.jar;C:\Desarrollo\maven\repositorio\commons-beanutils\commons-beanutils\1.7.0\commons-beanutils-1.7.0.jar;C:\Desarrollo\maven\repos

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

Hi Arpit

Yes I'm using the Windows SDK Command Prompt. I only use cygwin for the
dependency with make, ssh, etc.

Here's the Haddop Common compilation:

[INFO]

[INFO] Building Apache Hadoop Common 2.4.0
[INFO]

[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-os) @ hadoop-common
---
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:2.4.0:protoc (compile-protoc) @
hadoop-common ---
[INFO]
[INFO] --- hadoop-maven-plugins:2.4.0:version-info (version-info) @
hadoop-common ---
[WARNING] [svn, info] failed with error code 1
[WARNING] [git, branch] failed: java.io.IOException: Cannot run program
"git": CreateProcess error=2, The system cannot find the file specified
[INFO] SCM: NONE
[INFO] Computed MD5: 375b2832a6641759c6eaf6e3e998147
[INFO]
[INFO] --- maven-resources-plugin:2.2:resources (default-resources) @
hadoop-common ---
[INFO] Using default encoding to copy filtered resources.
[INFO]
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
hadoop-common ---
[INFO] Compiling 13 source files to
C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes
[INFO]
[INFO] --- native-maven-plugin:1.0-alpha-7:javah (default) @ hadoop-common
---
[INFO] cmd.exe /X /C "C:\PROGRA~1\Java\jdk1.6.0_45\bin\javah -d
C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\native\javah
-classpath
C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-common\target\classes;C:\Desarrollo\hadoop\hadoop-2.4.0-src\hadoop-common-project\hadoop-annotations\target\hadoop-annotations-2.4.0.jar;C:\PROGRA~1\Java\jdk1.6.0_45\jre\..\lib\tools.jar;C:\Desarrollo\maven\repositorio\com\google\guava\guava\11.0.2\guava-11.0.2.jar;C:\Desarrollo\maven\repositorio\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;C:\Desarrollo\maven\repositorio\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;C:\Desarrollo\maven\repositorio\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;C:\Desarrollo\maven\repositorio\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;C:\Desarrollo\maven\repositorio\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;C:\Desarrollo\maven\repositorio\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Desarrollo\maven\repositorio\commons-net\commons-net\3.1\commons-net-3.1.jar;C:\Desarrollo\maven\repositorio\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;C:\Desarrollo\maven\repositorio\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;C:\Desarrollo\maven\repositorio\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;C:\Desarrollo\maven\repositorio\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;C:\Desarrollo\maven\repositorio\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;C:\Desarrollo\maven\repositorio\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;C:\Desarrollo\maven\repositorio\javax\activation\activation\1.1\activation-1.1.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-jaxrs\1.8.8\jackson-jaxrs-1.8.8.jar;C:\Desarrollo\maven\repositorio\org\codehaus\jackson\jackson-xc\1.8.8\jackson-xc-1.8.8.jar;C:\Desarrollo\maven\repositorio\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;C:\Desarrollo\maven\repositorio\asm\asm\3.2\asm-3.2.jar;C:\Desarrollo\maven\repositorio\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;C:\Desarrollo\maven\repositorio\log4j\log4j\1.2.17\log4j-1.2.17.jar;C:\Desarrollo\maven\repositorio\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;C:\Desarrollo\maven\repositorio\org\apache\httpcomponents\httpclient\4.2.5\httpclient-4.2.5.jar;C:\Desarrollo\maven\repositorio\org\apache\httpcomponents\httpcore\4.2.5\httpcore-4.2.5.jar;C:\Desarrollo\maven\repositorio\com\jamesmurty\utils\java-xmlbuilder\0.4\java-xmlbuilder-0.4.jar;C:\Desarrollo\maven\repositorio\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;C:\Desarrollo\maven\repositorio\commons-configuration\commons-configuration\1.6\commons-configuration-1.6.jar;C:\Desarrollo\maven\repositorio\commons-digester\commons-digester\1.8\commons-digester-1.8.jar;C:\Desarrollo\maven\repositorio\commons-beanutils\commons-beanutils\1.7.0\commons-beanutils-1.7.0.jar;C:\Desarrollo\maven\repositorio\commons-beanutils\commons-beanutils-core\1.8.0\commons-beanutils-core-1.8.0.jar;C:\Desarrollo\maven\repositorio\org\slf4j\slf4j-api\1.7.5\slf4j-api-1.7.5.jar;C:\Desarrollo\maven\repositorio\org\codehaus

Re: Fwd: Trying to build Hadoop on Windows 8

[Arpit Agarwal]

Also in case you are using Cygwin, please don't! You should be building
from the Windows SDK command prompt.

See if this helps - https://wiki.apache.org/hadoop/Hadoop2OnWindows



On Fri, Jun 13, 2014 at 12:06 PM, Arpit Agarwal 
wrote:

> Could you share the complete build output?
>
> Feel free to put it on pastebin or similar if it's a lot of text.
>
>
> On Fri, Jun 13, 2014 at 12:00 PM, Néstor Boscán 
> wrote:
>
>> Hi thanks a lot for the info
>>
>> I started using a Windows 7 PC and I'm using the "Windows SDK Command
>> Prompt" but I'm still getting the same error:
>>
>> [ERROR] Failed to execute goal
>> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
>> project hadoop-common: Command execution failed. Process exited with an
>> error: 1(Exit value: 1) -> [Help 1]
>>
>> I tried with hadoop source 2.2.0, 2.3.0 and 2.4.0 with no success. I
>> checked the BUILDINGS.txt and everything is exactly as the file describes.
>>
>> Regards,
>>
>> Nestor
>>
>>
>> On Fri, Jun 13, 2014 at 2:22 PM, Arpit Agarwal 
>> wrote:
>>
>>> Unfortunately the SDK for Windows 8 does not include command-line build
>>> tools. You can build a binary distribution on Windows 7 using the steps
>>> outlined in BUILDING.txt and it should work on Windows 8.
>>>
>>> If you must build on Windows 8 you can try a couple of things:
>>> - Developer command prompt via Visual Studio Express 2013, if one is
>>> available.
>>> - Use Windows 7 SDK on Windows 8.
>>>
>>> If you do get either of these working updated instructions or patches
>>> would be welcome.
>>>
>>>
>>> On Fri, Jun 13, 2014 at 9:19 AM, Néstor Boscán 
>>> wrote:
>>>
 The error I'm getting is building Apache Hadoop Commons:

 [ERROR] Failed to execute goal
 org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
 project hadoop-common: Command execution failed. Process exited with an
 error: 1(Exit value: 1) -> [Help 1]

 The BUILDING.txt documentation explains that I have to run Windows SDK
 Command Prompt, but, in Windows 8 I can't find that shortcut. I tried
 adding the msbuild folder to the PATH but it doesn't work.

 Regards,

 Néstor


 On Fri, Jun 13, 2014 at 11:42 AM, Néstor Boscán 
 wrote:

> And it looks like Hortonworks is only certified with Windows Server,
> not Windows 8.
>
>
> On Fri, Jun 13, 2014 at 10:57 AM, Néstor Boscán 
> wrote:
>
>> Thanks but I'm trying to stick with the Hadoop installation.
>>
>>
>> On Fri, Jun 13, 2014 at 10:45 AM, Publius  wrote:
>>
>>> maybe just download hortonworks for windows
>>>
>>> Download Hadoop 
>>>  [image: image] 
>>>  Download Hadoop 
>>> Download Apache Hadoop for the enterprise with Hortonworks Data
>>> Platform. Data access, storage, governance, security and operations 
>>> across
>>> Linux and...
>>>  View on hortonworks.com 
>>>  Preview by Yahoo
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> KMG 365
>>>   --
>>>  *From:* Néstor Boscán 
>>> *To:* user@hadoop.apache.org
>>> *Sent:* Friday, June 13, 2014 7:31 AM
>>> *Subject:* Fwd: Trying to build Hadoop on Windows 8
>>>
>>> Hi
>>>
>>> I'm trying to build Hadoop on WIndows 8. I have:
>>>
>>> Java 1.6.0_45 (JAVA_HOME set using old DOS name)
>>> Maven 3.2 (M2_HOME and PATH set)
>>> Protoc 2.5.0 (The 32-bit build that I found, PATH set)
>>> Cygwin 64-bit (PATH set)
>>> Windows SDK
>>>
>>> When I try to run the build I get an error that it cannot build
>>> using the Windows tools. Lookig throught the Internet I found that with
>>> Visual Studio 2010 there is a batch file that sets the Windows SDK
>>> enviroment variables for this but I don't know how to do this if I only 
>>> use
>>> Windows SDK.
>>>
>>> Regards,
>>>
>>> Néstor
>>>
>>>
>>>
>>
>

>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exem

Re: Fwd: Trying to build Hadoop on Windows 8

[Arpit Agarwal]

Could you share the complete build output?

Feel free to put it on pastebin or similar if it's a lot of text.


On Fri, Jun 13, 2014 at 12:00 PM, Néstor Boscán  wrote:

> Hi thanks a lot for the info
>
> I started using a Windows 7 PC and I'm using the "Windows SDK Command
> Prompt" but I'm still getting the same error:
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> I tried with hadoop source 2.2.0, 2.3.0 and 2.4.0 with no success. I
> checked the BUILDINGS.txt and everything is exactly as the file describes.
>
> Regards,
>
> Nestor
>
>
> On Fri, Jun 13, 2014 at 2:22 PM, Arpit Agarwal 
> wrote:
>
>> Unfortunately the SDK for Windows 8 does not include command-line build
>> tools. You can build a binary distribution on Windows 7 using the steps
>> outlined in BUILDING.txt and it should work on Windows 8.
>>
>> If you must build on Windows 8 you can try a couple of things:
>> - Developer command prompt via Visual Studio Express 2013, if one is
>> available.
>> - Use Windows 7 SDK on Windows 8.
>>
>> If you do get either of these working updated instructions or patches
>> would be welcome.
>>
>>
>> On Fri, Jun 13, 2014 at 9:19 AM, Néstor Boscán 
>> wrote:
>>
>>> The error I'm getting is building Apache Hadoop Commons:
>>>
>>> [ERROR] Failed to execute goal
>>> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
>>> project hadoop-common: Command execution failed. Process exited with an
>>> error: 1(Exit value: 1) -> [Help 1]
>>>
>>> The BUILDING.txt documentation explains that I have to run Windows SDK
>>> Command Prompt, but, in Windows 8 I can't find that shortcut. I tried
>>> adding the msbuild folder to the PATH but it doesn't work.
>>>
>>> Regards,
>>>
>>> Néstor
>>>
>>>
>>> On Fri, Jun 13, 2014 at 11:42 AM, Néstor Boscán 
>>> wrote:
>>>
 And it looks like Hortonworks is only certified with Windows Server,
 not Windows 8.


 On Fri, Jun 13, 2014 at 10:57 AM, Néstor Boscán 
 wrote:

> Thanks but I'm trying to stick with the Hadoop installation.
>
>
> On Fri, Jun 13, 2014 at 10:45 AM, Publius  wrote:
>
>> maybe just download hortonworks for windows
>>
>> Download Hadoop 
>>  [image: image] 
>>  Download Hadoop 
>> Download Apache Hadoop for the enterprise with Hortonworks Data
>> Platform. Data access, storage, governance, security and operations 
>> across
>> Linux and...
>>  View on hortonworks.com 
>>  Preview by Yahoo
>>
>>
>>
>>
>>
>>
>>
>>
>> KMG 365
>>   --
>>  *From:* Néstor Boscán 
>> *To:* user@hadoop.apache.org
>> *Sent:* Friday, June 13, 2014 7:31 AM
>> *Subject:* Fwd: Trying to build Hadoop on Windows 8
>>
>> Hi
>>
>> I'm trying to build Hadoop on WIndows 8. I have:
>>
>> Java 1.6.0_45 (JAVA_HOME set using old DOS name)
>> Maven 3.2 (M2_HOME and PATH set)
>> Protoc 2.5.0 (The 32-bit build that I found, PATH set)
>> Cygwin 64-bit (PATH set)
>> Windows SDK
>>
>> When I try to run the build I get an error that it cannot build using
>> the Windows tools. Lookig throught the Internet I found that with Visual
>> Studio 2010 there is a batch file that sets the Windows SDK enviroment
>> variables for this but I don't know how to do this if I only use Windows
>> SDK.
>>
>> Regards,
>>
>> Néstor
>>
>>
>>
>

>>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

Hi thanks a lot for the info

I started using a Windows 7 PC and I'm using the "Windows SDK Command
Prompt" but I'm still getting the same error:

[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
Process exited with an error: 1(Exit value: 1) -> [Help 1]

I tried with hadoop source 2.2.0, 2.3.0 and 2.4.0 with no success. I
checked the BUILDINGS.txt and everything is exactly as the file describes.

Regards,

Nestor


On Fri, Jun 13, 2014 at 2:22 PM, Arpit Agarwal 
wrote:

> Unfortunately the SDK for Windows 8 does not include command-line build
> tools. You can build a binary distribution on Windows 7 using the steps
> outlined in BUILDING.txt and it should work on Windows 8.
>
> If you must build on Windows 8 you can try a couple of things:
> - Developer command prompt via Visual Studio Express 2013, if one is
> available.
> - Use Windows 7 SDK on Windows 8.
>
> If you do get either of these working updated instructions or patches
> would be welcome.
>
>
> On Fri, Jun 13, 2014 at 9:19 AM, Néstor Boscán  wrote:
>
>> The error I'm getting is building Apache Hadoop Commons:
>>
>> [ERROR] Failed to execute goal
>> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
>> project hadoop-common: Command execution failed. Process exited with an
>> error: 1(Exit value: 1) -> [Help 1]
>>
>> The BUILDING.txt documentation explains that I have to run Windows SDK
>> Command Prompt, but, in Windows 8 I can't find that shortcut. I tried
>> adding the msbuild folder to the PATH but it doesn't work.
>>
>> Regards,
>>
>> Néstor
>>
>>
>> On Fri, Jun 13, 2014 at 11:42 AM, Néstor Boscán 
>> wrote:
>>
>>> And it looks like Hortonworks is only certified with Windows Server, not
>>> Windows 8.
>>>
>>>
>>> On Fri, Jun 13, 2014 at 10:57 AM, Néstor Boscán 
>>> wrote:
>>>
 Thanks but I'm trying to stick with the Hadoop installation.


 On Fri, Jun 13, 2014 at 10:45 AM, Publius  wrote:

> maybe just download hortonworks for windows
>
> Download Hadoop 
>  [image: image] 
>  Download Hadoop 
> Download Apache Hadoop for the enterprise with Hortonworks Data
> Platform. Data access, storage, governance, security and operations across
> Linux and...
>  View on hortonworks.com 
>  Preview by Yahoo
>
>
>
>
>
>
>
>
> KMG 365
>   --
>  *From:* Néstor Boscán 
> *To:* user@hadoop.apache.org
> *Sent:* Friday, June 13, 2014 7:31 AM
> *Subject:* Fwd: Trying to build Hadoop on Windows 8
>
> Hi
>
> I'm trying to build Hadoop on WIndows 8. I have:
>
> Java 1.6.0_45 (JAVA_HOME set using old DOS name)
> Maven 3.2 (M2_HOME and PATH set)
> Protoc 2.5.0 (The 32-bit build that I found, PATH set)
> Cygwin 64-bit (PATH set)
> Windows SDK
>
> When I try to run the build I get an error that it cannot build using
> the Windows tools. Lookig throught the Internet I found that with Visual
> Studio 2010 there is a batch file that sets the Windows SDK enviroment
> variables for this but I don't know how to do this if I only use Windows
> SDK.
>
> Regards,
>
> Néstor
>
>
>

>>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Re: Fwd: Trying to build Hadoop on Windows 8

[Arpit Agarwal]

Unfortunately the SDK for Windows 8 does not include command-line build
tools. You can build a binary distribution on Windows 7 using the steps
outlined in BUILDING.txt and it should work on Windows 8.

If you must build on Windows 8 you can try a couple of things:
- Developer command prompt via Visual Studio Express 2013, if one is
available.
- Use Windows 7 SDK on Windows 8.

If you do get either of these working updated instructions or patches would
be welcome.


On Fri, Jun 13, 2014 at 9:19 AM, Néstor Boscán  wrote:

> The error I'm getting is building Apache Hadoop Commons:
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> The BUILDING.txt documentation explains that I have to run Windows SDK
> Command Prompt, but, in Windows 8 I can't find that shortcut. I tried
> adding the msbuild folder to the PATH but it doesn't work.
>
> Regards,
>
> Néstor
>
>
> On Fri, Jun 13, 2014 at 11:42 AM, Néstor Boscán 
> wrote:
>
>> And it looks like Hortonworks is only certified with Windows Server, not
>> Windows 8.
>>
>>
>> On Fri, Jun 13, 2014 at 10:57 AM, Néstor Boscán 
>> wrote:
>>
>>> Thanks but I'm trying to stick with the Hadoop installation.
>>>
>>>
>>> On Fri, Jun 13, 2014 at 10:45 AM, Publius  wrote:
>>>
 maybe just download hortonworks for windows

 Download Hadoop 
  [image: image] 
  Download Hadoop 
 Download Apache Hadoop for the enterprise with Hortonworks Data
 Platform. Data access, storage, governance, security and operations across
 Linux and...
  View on hortonworks.com 
  Preview by Yahoo








 KMG 365
   --
  *From:* Néstor Boscán 
 *To:* user@hadoop.apache.org
 *Sent:* Friday, June 13, 2014 7:31 AM
 *Subject:* Fwd: Trying to build Hadoop on Windows 8

 Hi

 I'm trying to build Hadoop on WIndows 8. I have:

 Java 1.6.0_45 (JAVA_HOME set using old DOS name)
 Maven 3.2 (M2_HOME and PATH set)
 Protoc 2.5.0 (The 32-bit build that I found, PATH set)
 Cygwin 64-bit (PATH set)
 Windows SDK

 When I try to run the build I get an error that it cannot build using
 the Windows tools. Lookig throught the Internet I found that with Visual
 Studio 2010 there is a batch file that sets the Windows SDK enviroment
 variables for this but I don't know how to do this if I only use Windows
 SDK.

 Regards,

 Néstor



>>>
>>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Heartbeat info in AM and NM in Yarn

[Jian He]

NM heartbeats with RM to update container status while AM is periodically
heartbeats with RM to tell RM that AM itself is still alive. AM also use
the same heartbeat call to negotiate resources from RM

Jian


On Fri, Jun 13, 2014 at 10:39 AM, Mohit Anchlia 
wrote:

> It appears that NM and AM both sends the heartbeat to the resource
> manager. It also appears that they send the health information of the
> containers running on the node. I am trying to understand what's the core
> difference between the two?

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Heartbeat info in AM and NM in Yarn

[Mohit Anchlia]

It appears that NM and AM both sends the heartbeat to the resource manager.
It also appears that they send the health information of the containers
running on the node. I am trying to understand what's the core difference
between the two?

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

The error I'm getting is building Apache Hadoop Commons:

[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
Process exited with an error: 1(Exit value: 1) -> [Help 1]

The BUILDING.txt documentation explains that I have to run Windows SDK
Command Prompt, but, in Windows 8 I can't find that shortcut. I tried
adding the msbuild folder to the PATH but it doesn't work.

Regards,

Néstor


On Fri, Jun 13, 2014 at 11:42 AM, Néstor Boscán  wrote:

> And it looks like Hortonworks is only certified with Windows Server, not
> Windows 8.
>
>
> On Fri, Jun 13, 2014 at 10:57 AM, Néstor Boscán 
> wrote:
>
>> Thanks but I'm trying to stick with the Hadoop installation.
>>
>>
>> On Fri, Jun 13, 2014 at 10:45 AM, Publius  wrote:
>>
>>> maybe just download hortonworks for windows
>>>
>>> Download Hadoop 
>>>  [image: image] 
>>>  Download Hadoop 
>>> Download Apache Hadoop for the enterprise with Hortonworks Data
>>> Platform. Data access, storage, governance, security and operations across
>>> Linux and...
>>>  View on hortonworks.com 
>>>  Preview by Yahoo
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> KMG 365
>>>   --
>>>  *From:* Néstor Boscán 
>>> *To:* user@hadoop.apache.org
>>> *Sent:* Friday, June 13, 2014 7:31 AM
>>> *Subject:* Fwd: Trying to build Hadoop on Windows 8
>>>
>>> Hi
>>>
>>> I'm trying to build Hadoop on WIndows 8. I have:
>>>
>>> Java 1.6.0_45 (JAVA_HOME set using old DOS name)
>>> Maven 3.2 (M2_HOME and PATH set)
>>> Protoc 2.5.0 (The 32-bit build that I found, PATH set)
>>> Cygwin 64-bit (PATH set)
>>> Windows SDK
>>>
>>> When I try to run the build I get an error that it cannot build using
>>> the Windows tools. Lookig throught the Internet I found that with Visual
>>> Studio 2010 there is a batch file that sets the Windows SDK enviroment
>>> variables for this but I don't know how to do this if I only use Windows
>>> SDK.
>>>
>>> Regards,
>>>
>>> Néstor
>>>
>>>
>>>
>>
>

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

And it looks like Hortonworks is only certified with Windows Server, not
Windows 8.


On Fri, Jun 13, 2014 at 10:57 AM, Néstor Boscán  wrote:

> Thanks but I'm trying to stick with the Hadoop installation.
>
>
> On Fri, Jun 13, 2014 at 10:45 AM, Publius  wrote:
>
>> maybe just download hortonworks for windows
>>
>> Download Hadoop 
>>  [image: image] 
>>  Download Hadoop 
>> Download Apache Hadoop for the enterprise with Hortonworks Data Platform.
>> Data access, storage, governance, security and operations across Linux
>> and...
>>  View on hortonworks.com 
>>  Preview by Yahoo
>>
>>
>>
>>
>>
>>
>>
>>
>> KMG 365
>>   --
>>  *From:* Néstor Boscán 
>> *To:* user@hadoop.apache.org
>> *Sent:* Friday, June 13, 2014 7:31 AM
>> *Subject:* Fwd: Trying to build Hadoop on Windows 8
>>
>> Hi
>>
>> I'm trying to build Hadoop on WIndows 8. I have:
>>
>> Java 1.6.0_45 (JAVA_HOME set using old DOS name)
>> Maven 3.2 (M2_HOME and PATH set)
>> Protoc 2.5.0 (The 32-bit build that I found, PATH set)
>> Cygwin 64-bit (PATH set)
>> Windows SDK
>>
>> When I try to run the build I get an error that it cannot build using the
>> Windows tools. Lookig throught the Internet I found that with Visual Studio
>> 2010 there is a batch file that sets the Windows SDK enviroment variables
>> for this but I don't know how to do this if I only use Windows SDK.
>>
>> Regards,
>>
>> Néstor
>>
>>
>>
>

Re: Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

Thanks but I'm trying to stick with the Hadoop installation.


On Fri, Jun 13, 2014 at 10:45 AM, Publius  wrote:

> maybe just download hortonworks for windows
>
> Download Hadoop 
>  [image: image] 
>  Download Hadoop 
> Download Apache Hadoop for the enterprise with Hortonworks Data Platform.
> Data access, storage, governance, security and operations across Linux
> and...
>  View on hortonworks.com 
>  Preview by Yahoo
>
>
>
>
>
>
>
>
> KMG 365
>   --
>  *From:* Néstor Boscán 
> *To:* user@hadoop.apache.org
> *Sent:* Friday, June 13, 2014 7:31 AM
> *Subject:* Fwd: Trying to build Hadoop on Windows 8
>
> Hi
>
> I'm trying to build Hadoop on WIndows 8. I have:
>
> Java 1.6.0_45 (JAVA_HOME set using old DOS name)
> Maven 3.2 (M2_HOME and PATH set)
> Protoc 2.5.0 (The 32-bit build that I found, PATH set)
> Cygwin 64-bit (PATH set)
> Windows SDK
>
> When I try to run the build I get an error that it cannot build using the
> Windows tools. Lookig throught the Internet I found that with Visual Studio
> 2010 there is a batch file that sets the Windows SDK enviroment variables
> for this but I don't know how to do this if I only use Windows SDK.
>
> Regards,
>
> Néstor
>
>
>

Re: Enable PseudoAuthenticator | org.apache.hadoop.security.authentication.client.PseudoAuthenticator

[Zhijie Shen]

You can follow the instruction on:
https://hadoop.apache.org/docs/r2.4.0/hadoop-project-dist/hadoop-common/HttpAuthentication.html

- Zhijie


On Fri, Jun 13, 2014 at 8:13 PM, pmanolov 
wrote:

>  Hi guys ,
> How can I enable the PseudoAuthenticator ? I couldn't find anything in the
> authentication. I am trying to connect oozie and hadoop, but it fails so I
> was thinking that I can make it use the PseudoAuthenticator somehow. I
> couldn't find anything in the documentation how does one sets the security
> authenticator.
>
> Regards,
> Peter
>
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Fwd: Trying to build Hadoop on Windows 8

[Publius]

maybe just download hortonworks for windows

Download Hadoop

 
   Download Hadoop
Download Apache Hadoop for the enterprise with Hortonworks Data Platform. Data 
access, storage, governance, security and operations across Linux and...  
View on hortonworks.com Preview by Yahoo  
 
 






KMG 365 



 From: Néstor Boscán 
To: user@hadoop.apache.org 
Sent: Friday, June 13, 2014 7:31 AM
Subject: Fwd: Trying to build Hadoop on Windows 8
 


Hi

I'm trying to build Hadoop on WIndows 8. I have:

Java 1.6.0_45 (JAVA_HOME set using old DOS name)
Maven 3.2 (M2_HOME and PATH set)
Protoc 2.5.0 (The 32-bit build that I found, PATH set)
Cygwin 64-bit (PATH set)
Windows SDK

When I try to run the build I get an error that it cannot build using the 
Windows tools. Lookig throught the Internet I found that with Visual Studio 
2010 there is a batch file that sets the Windows SDK enviroment variables for 
this but I don't know how to do this if I only use Windows SDK.

Regards,

Néstor

Fwd: Trying to build Hadoop on Windows 8

[Néstor Boscán]

Hi

I'm trying to build Hadoop on WIndows 8. I have:

Java 1.6.0_45 (JAVA_HOME set using old DOS name)
Maven 3.2 (M2_HOME and PATH set)
Protoc 2.5.0 (The 32-bit build that I found, PATH set)
Cygwin 64-bit (PATH set)
Windows SDK

When I try to run the build I get an error that it cannot build using the
Windows tools. Lookig throught the Internet I found that with Visual Studio
2010 there is a batch file that sets the Windows SDK enviroment variables
for this but I don't know how to do this if I only use Windows SDK.

Regards,

Néstor

Re: Building hadoop 2.2.1 from source code

[Lukas Drbal]

Fixed after apply patch from
https://issues.apache.org/jira/browse/HADOOP-10110


L.


On Thu, Jun 12, 2014 at 8:58 PM, Lukas Drbal 
wrote:

> Thanks Tomas, but this can't help me now : )
>
> Now i try change my mvn local repo via
>
> export MAVEN_OPTS="-Dmaven.repo.local=`pwd`/../.m2"
>
> mvn clean package -DskipTests produce new error:
>
> [INFO] BUILD FAILURE
> [INFO]
> 
> [INFO] Total time: 2:28.631s
> [INFO] Finished at: Thu Jun 12 20:44:09 CEST 2014
> [INFO] Final Memory: 33M/381M
> [INFO]
> 
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile
> (default-testCompile) on project hadoop-auth: Compilation failure:
> Compilation failure:
> [ERROR]
> /home/lestr/data/git/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[88,11]
> error: cannot access AbstractLifeCycle
> [ERROR] class file for org.mortbay.component.AbstractLifeCycle not found
> [ERROR]
> /home/lestr/data/git/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[96,29]
> error: cannot access LifeCycle
> [ERROR] class file for org.mortbay.component.LifeCycle not found
> [ERROR]
> /home/lestr/data/git/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[98,10]
> error: cannot find symbol
> [ERROR] symbol:   method start()
> [ERROR] location: variable server of type Server
> [ERROR]
> /home/lestr/data/git/hadoop-common/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[104,12]
> error: cannot find symbol
> [ERROR] -> [Help 1]
>
> This make me a little bit crazy : )
>
> L.
>
>
> On Thu, Jun 12, 2014 at 8:40 PM, Tomás Fernández Pena 
> wrote:
>
>>  Hi,
>>
>> If you are able to read Spanish, in
>> https://bitacoras.citius.usc.es/tecnologia/2014/06/05/hadoop-para-64-bits/
>> it's described step by step how to compile Hadoop 2.4 in a CentOS 6.5 64
>> bits.
>>
>> Cheers
>>
>> Tomas
>>
>> En 12/06/14 18:37, Lukas Drbal escribiu:
>>
>> Hi all,
>>
>>  i have a problem with build hadoop from source code. I take git from
>> https://github.com/apache/hadoop-common and branch-2.2.1 and try
>> mvn package -Pdist,native -DskipTests -Dtar but it return a lot errors.
>>
>>  Here is log from mvn
>> https://gist.github.com/anonymous/052b6d45f64be01dab43
>>
>>
>>  My enviroment:
>>
>>  lestr@drbal:~/data/git/hadoop-common [ branch-2.2.1 ] ∑ java -version
>> java version "1.7.0_60"
>> Java(TM) SE Runtime Environment (build 1.7.0_60-b19)
>> Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed mode)
>> lestr@drbal:~/data/git/hadoop-common [ branch-2.2.1 ] ∑ mvn -version
>> Apache Maven 3.0.5
>> Maven home: /usr/share/maven
>> Java version: 1.6.0_45, vendor: Sun Microsystems Inc.
>> Java home: /usr/lib/jvm/java-6-oracle/jre
>> Default locale: en_US, platform encoding: UTF-8
>> OS name: "linux", version: "3.14-1-amd64", arch: "amd64", family: "unix"
>> lestr@drbal:~/data/git/hadoop-common [ branch-2.2.1 ] ∑
>>
>>
>>  I need build native libs for 64bit. Can somebody help me please?
>>
>>  Thanks.
>> --
>>
>>
>> * Lukáš Drbal*
>> Software architect
>>
>> *Socialbakers*
>> Facebook applications and other sweet stuff
>>
>> Facebook Preferred Marketing Developer
>>
>>
>> *+420 739 815 424 **lukas.dr...@socialbakers.com
>> *
>> *www.socialbakers.com *
>>
>>
>>
>
>
> --
>
>
> *Lukáš Drbal*
> Software architect
>
> *Socialbakers*
> Facebook applications and other sweet stuff
>
> Facebook Preferred Marketing Developer
>
>
> *+420 739 815 424**lukas.dr...@socialbakers.com
> *
> *www.socialbakers.com *
>



-- 


*Lukáš Drbal*
Software architect

*Socialbakers*
Facebook applications and other sweet stuff

Facebook Preferred Marketing Developer


*+420 739 815 424**lukas.dr...@socialbakers.com
*
*www.socialbakers.com *

RE: unsubscribe

[Martin, Nick]

Please send email to 
user-unsubscr...@hadoop.apache.org

See http://hadoop.apache.org/mailing_lists.html#User


From: Keyo Jin [mailto:keyao...@gmail.com]
Sent: Friday, June 13, 2014 9:43 AM
To: user@hadoop.apache.org
Subject: unsubscribe

unsubscribe

unsubscribe

[Keyo Jin]

unsubscribe

Enable PseudoAuthenticator | org.apache.hadoop.security.authentication.client.PseudoAuthenticator

[pmanolov]

Hi guys ,
How can I enable the PseudoAuthenticator ? I couldn't find anything in 
the authentication. I am trying to connect oozie and hadoop, but it 
fails so I was thinking that I can make it use the PseudoAuthenticator 
somehow. I couldn't find anything in the documentation how does one sets 
the security authenticator.


Regards,
Peter

Re: what stage dir in yarn framework use for?

[rajesh gosula]

remove from list


On Fri, Jun 13, 2014 at 12:44 PM, Jian He  wrote:

> That's for MapReduce jobs, not for YARN, and for storing things like MR
> job history file, conf.xml.
>
> Jian
>
>
> On Thu, Jun 12, 2014 at 11:47 PM, ch huang  wrote:
>
>> hi,mailist:
>>  i see yarn.app.mapreduce.am.staging-dir in doc ,and
>> i do not know it use for ,and i also want to know if the content in this
>> dir can be clean,
>> and if it can be set auto clean?
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Re: what stage dir in yarn framework use for?

[Jian He]

That's for MapReduce jobs, not for YARN, and for storing things like MR job
history file, conf.xml.

Jian


On Thu, Jun 12, 2014 at 11:47 PM, ch huang  wrote:

> hi,mailist:
>  i see yarn.app.mapreduce.am.staging-dir in doc ,and i
> do not know it use for ,and i also want to know if the content in this dir
> can be clean,
> and if it can be set auto clean?
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.