RE: Hadoop YARN Map Reduce Job failing with a Null Pointer Exception.

Hi,Your error stack looks simmilar to the this issue in jira: https://issues.apache.org/jira/browse/MAPREDUCE-5703Maybe worth reading the link as it seemed to be resolved (but not as a patch, more as a development issue) With Regards,Yves Date: Sat, 6 Jun 2015 00:07:01 -0400 Subject: Hadoop YAR

Unable to start namenode : Address already in use

Hi user, I have hadoop with version 2.6.0 on cluster. When I am trying to start dfs I am getting following error : 2015-06-06 14:35:38,042 INFO org.apache.hadoop.http.HttpServer2: HttpServer.start() threw a non Bind IOException java.net.BindException: Port in use: 0.0.0.0:50070 at org.ap

Re: Unable to start namenode : Address already in use

1) Check if by any chance process is still running by using jps -V command. 2) If it is running then kill it by sudo kill -9 3) Execute name node start command again. 4) Go to bottom of the name node log file and post it here. Regards, Chandrash3khar Kotekar Mobile - +91 8600011455

Re: Unable to start namenode : Address already in use

What OS are you using ? Can you try netstat with this command ? netstat -tulpn | grep 50070 On a system where DataNode is running as process 11272, I issued two commands: [root@c12 ~]# netstat -tulpn | grep 11272 tcp0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 11272/java t

build hadoop-2.7.0 with win8.1

hi when i try to Building hadoop-2.7.0-src on Windows,i got a problem i followed the BUILDING.txt,and i have all of this: * Windows System * JDK 1.6+ * Maven 3.0 or later * Findbugs 1.3.9 (if running findbugs) * ProtocolBuffer 2.5.0 * CMake 2.6 or newer * Windows SDK or Visual Studio 2010

Re: build hadoop-2.7.0 with win8.1

Hi vergilchi, The Windows equivalent of the 'native' profile is 'native-win'. You will also need JDK 1.7. From: vergilchi Reply-To: "user@hadoop.apache.org" Date: Saturday, June 6, 2015 at 8:58 AM To: "user@hadoop.apache.org" Subject:

How Shuffle and sorting is done in Map-Reduce

hi, i am trying to understand the underlying algorithm used for shuffle and sort in map-reduce. some say they used external merge sort and quick sort in memory, couldn't find better resource for understanding. any pointers to a published paper or code is greatly helpful Thanks, -Yeshwanth

Re: How Shuffle and sorting is done in Map-Reduce

On Sun, Jun 7, 2015 at 5:17 AM, yeshwanth kumar wrote: > shuffle and sort in map-reduce Hi Yeswanth, I hope below links will be helpful: http://stackoverflow.com/questions/22141631/what-is-the-purpose-of-shuffling-and-sorting-phase-in-the-reducer-in-map-reduce http://hadoop.apache.org/docs/

Re: How Shuffle and sorting is done in Map-Reduce

Hi Adarsh, thanks for the links, those links doesn't have the info about underlying algo's Thanks, -Yeshwanth On Sun, Jun 7, 2015 at 12:07 AM, adarsh deshratnam < adarsh.deshrat...@gmail.com> wrote: > > On Sun, Jun 7, 2015 at 5:17 AM, yeshwanth kumar > wrote: > >> shuffle and sort in map-red

Re: How Shuffle and sorting is done in Map-Reduce

Here is the algo explanation http://theory.stanford.edu/~sergei/papers/soda10-mrc.pdf Thanks, Adarsh D On Sun, Jun 7, 2015 at 11:47 AM, yeshwanth kumar wrote: > underlying algo

Re: How Shuffle and sorting is done in Map-Reduce

thanks that's a good one -Yeshwanth On Sun, Jun 7, 2015 at 1:33 AM, adarsh deshratnam < adarsh.deshrat...@gmail.com> wrote: > Here is the algo explanation > http://theory.stanford.edu/~sergei/papers/soda10-mrc.pdf > > Thanks, > Adarsh D > > > On Sun, Jun 7, 2015 at 11:47 AM, yeshwanth kumar >