Hadoop svn cannot connected.
Hi, http://svn.apache.org/viewcvs.cgi/hadoop/common/trunk/ I cannot open this URL. does that anybody can access it? another, I cannot svn up the new release in branch-2. It always stay in Aug 2014.
Adding datanodes to Hadoop cluster - Will data redistribute?
Dear Hadoop experts, I have a Hadoop cluster of 8 nodes, 6 were added during cluster creation and 2 additional nodes were added later to increase disk and CPU capacity. What i see is that processing is shared amongst all the nodes whereas the storage is reaching capacity on the original 6 nodes whereas the newly added machines have relatively large amount of storage still unoccupied. I was wondering if there is an automated or any way of redistributing data so that all the nodes are equally utilized. I have checked for the configuration parameter - *dfs.datanode.fsdataset.volume.choosing.policy* have options 'Round Robin' or 'Available Space', are there any other configurations which need to be reviewed. Thanks, Manoj
Re: Hadoop Node Failure Detection
Thanks On Fri Feb 06 2015 at 15:11:24 Xuan Gong xg...@hortonworks.com wrote: Hey, Telles: You can simply decrease the NM expiry-interval. The default value is 5 mins. You can config nm.liveness-monitor.expiry-interval-ms (in millisecond)in yarn-site.xml Thanks Xuan Gong From: Telles Nobrega tellesnobr...@gmail.com Reply-To: user@hadoop.apache.org user@hadoop.apache.org Date: Friday, February 6, 2015 at 10:03 AM To: user@hadoop.apache.org user@hadoop.apache.org Subject: Hadoop Node Failure Detection Hi, hadoop takes a while to notice that a node is gone right? I'm using hadoop 2.6.0 and I would like to change this detection time for experience porpuse, which configuration should I change and where? Thanks
Kill one node on map start
Hi, I'm working on a experiment and I need to do something like, start a hadoop job (wordcount, terasort, pi) and let the application organize the distribution of files and before the map actually start working I need to kill a single node of my topology. Is there any automated way that I can do that?
Re: Hadoop svn cannot connected.
Hadoop has moved to git: https://wiki.apache.org/hadoop/GitAndHadoop -- André On Fri, Feb 6, 2015 at 9:13 AM, Azuryy Yu azury...@gmail.com wrote: Hi, http://svn.apache.org/viewcvs.cgi/hadoop/common/trunk/ I cannot open this URL. does that anybody can access it? another, I cannot svn up the new release in branch-2. It always stay in Aug 2014. -- André Kelpe an...@concurrentinc.com http://concurrentinc.com
Re: Hadoop svn cannot connected.
Oh, thanks. On Fri, Feb 6, 2015 at 4:58 PM, Andre Kelpe ake...@concurrentinc.com wrote: Hadoop has moved to git: https://wiki.apache.org/hadoop/GitAndHadoop -- André On Fri, Feb 6, 2015 at 9:13 AM, Azuryy Yu azury...@gmail.com wrote: Hi, http://svn.apache.org/viewcvs.cgi/hadoop/common/trunk/ I cannot open this URL. does that anybody can access it? another, I cannot svn up the new release in branch-2. It always stay in Aug 2014. -- André Kelpe an...@concurrentinc.com http://concurrentinc.com
tutorial to compile YARN 2.6
I want to compile MapReduce of the YARN 2.6. Does anyone have a tutorial on how to compile YARN 2.6? Thanks
Hadoop Node Failure Detection
Hi, hadoop takes a while to notice that a node is gone right? I'm using hadoop 2.6.0 and I would like to change this detection time for experience porpuse, which configuration should I change and where? Thanks
Re: Hadoop Node Failure Detection
Hey, Telles: You can simply decrease the NM expiry-interval. The default value is 5 mins. You can config nm.liveness-monitor.expiry-interval-ms (in millisecond)in yarn-site.xml Thanks Xuan Gong From: Telles Nobrega tellesnobr...@gmail.commailto:tellesnobr...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Date: Friday, February 6, 2015 at 10:03 AM To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: Hadoop Node Failure Detection Hi, hadoop takes a while to notice that a node is gone right? I'm using hadoop 2.6.0 and I would like to change this detection time for experience porpuse, which configuration should I change and where? Thanks
Re: tutorial to compile YARN 2.6
For hadoop 2.6, you need to install protobuf 2.5.0 first. You can use the following command to build (at root of workspace): mvn clean verify -Pdist -Pnative -Dtar Cheers On Fri, Feb 6, 2015 at 8:38 AM, xeonmailinglist xeonmailingl...@gmail.com wrote: I want to compile MapReduce of the YARN 2.6. Does anyone have a tutorial on how to compile YARN 2.6? Thanks
Which classes call the map, combine and reduce functions created by the client?
Hi, In YARN 2.6, which classes call the |map|, |combine| and |reduce| functions created by the client?
Re: Which classes call the map, combine and reduce functions created by the client?
I found it. Thanks anyway. On 06-02-2015 16:17, xeonmailinglist wrote: Hi, In YARN 2.6, which classes call the |map|, |combine| and |reduce| functions created by the client?
