Compiling the jars for Eclipse map reduce plugin

2014-01-17 Thread Michael
Can someone send the steps for installing the map-reduce plugin out of the jar files in the $HADOOP_HOME/share/hadoop/* directories? I am using the latest version of Eclipse platfrom and hadoop beta release. There is no $HADOOP_HOME/src/contrib directory in this release or other contrib directory

Re: Sorting a csv file

2014-01-17 Thread unmesha sreeveni
are we able to sort multiple columns dynamically as the user suggests? ie user requests to sort col1 and col2 then the user request to sort 3 cols I am not able to find anyof the stuff through googling On Thu, Jan 16, 2014 at 4:03 PM, unmesha sreeveni unmeshab...@gmail.comwrote: yes i did ..

Building Hadoop 2.2.0 On Windows 7 64-bit

2014-01-17 Thread Nirmal Kumar
Hi All, I am trying to build Hadoop 2.2.0 On Windows 7 64-bit env. Can you let me know what else is needed for building Hadoop 2.2.0 On Windows platform? I am getting the following error building *hadoop-common* project: [INFO]

Re: Building Hadoop 2.2.0 On Windows 7 64-bit

2014-01-17 Thread Silvina Caíno Lores
'protoc --version' did not return a version Are you sure that you have Protocol Buffers installed? On 17 January 2014 11:29, Nirmal Kumar nirmal.ku...@impetus.co.in wrote: Hi All, I am trying to build Hadoop 2.2.0 On Windows 7 64-bit env. Can you let me know what else is needed for

RE: How to make AM terminate if client crashes?

2014-01-17 Thread John Lilley
In our application the client is actually one step of many in an application. If the client goes away entirely, that means the entire application has crashed or has been terminated somehow. Our application doesn't checkpoint state at this step, so the step will have to be restarted anyway.

Re: Building Hadoop 2.2.0 On Windows 7 64-bit

2014-01-17 Thread Jian Feng JF She
I have the same the environment,Window 7(64bit) hadoop 2.2 ,yes I have installed the protocbuf previously,and according to the guide, put protoc.exe and libprotobuf.lib,libprotobuf-lite.lib,libprotoc.lib into PATH. run protoc --version will get output libprotoc 2.5.0 Now it seems everything

Re: Building Hadoop 2.2.0 On Windows 7 64-bit

2014-01-17 Thread Dan Sandler
Nirmal/Nikshe, I got Hadoop to build on a Windows 7 64-bit host. I am using the version 2.5.0 of Protocol Buffers. dsandler@dans-t61p7 ~ $ protoc --version libprotoc 2.5.0 As you found, I tried to build protoc from the source, but I experienced the same error, and gave up. I also found it was

RE: How to configure multiple reduce jobs in hadoop 2.2.0

2014-01-17 Thread German Florez-Larrahondo
Yong The simple explanation is that a Java application is not just limited by the heap size. As an example, Tom White’s Hadoop The Definitive Guide, page 323: the job’s own memory also includes native libraries, Java’s permgen space, etc.

Re: DistributedCache is empty

2014-01-17 Thread Vinod Kumar Vavilapalli
What is the version of Hadoop that you are using? +Vinod On Jan 16, 2014, at 2:41 PM, Keith Wiley kwi...@keithwiley.com wrote: My driver is implemented around Tool and so should be wrapping GenericOptionsParser internally. Nevertheless, neither -files nor DistributedCache methods seem to

Merge files

2014-01-17 Thread unmesha sreeveni
How to merge two files using Map-Reduce code . I am aware of -getmerge and cat command.\ Thanks in advance. -- *Thanks Regards* Unmesha Sreeveni U.B