Move to @user alias.
- Original Message -
From: Jun Ping Du j...@vmware.com
To: gene...@hadoop.apache.org
Sent: Wednesday, October 23, 2013 10:03:27 PM
Subject: Re: dynamically resizing Hadoop cluster on AWS?
If only compute node (TaskTracker or NodeManager) in your instance
The current HDFS's default replica placement policy don't fit two biased racks
case very well: assume local rack has more nodes, which means more reducer
slots and more disk capacity, then more reducer tasks will be executed within
local rack. According to replica placement policy, it will put
Hi,
Although you can set datacenter layer on your network topology, it is never
enabled in hadoop as lacking of replica placement and task scheduling support.
There are some work to add layers other than rack and node under HADOOP-8848
but may not suit for your case. Agree with Adam that a
For 3 replicas, the replication sequence is: 1st on local node of Writer, 2nd
on remote rack node of 1st replica, 3rd on same rack of 2nd replica.
There could be some special cases like: disk is full on 1st node, or no node
available for 2nd replica rack, and Hadoop already take care it well.
Hi,
It should be fixed in new version (2.1.0-beta), please refer:
https://issues.apache.org/jira/browse/YARN-646
Thanks,
Junping
- Original Message -
From: ch huang justlo...@gmail.com
To: user@hadoop.apache.org
Sent: Friday, August 23, 2013 10:30:42 AM
Subject: find a doc bug
Hi Lei,
MutableCounterLong is a type of counter which can be increased only (count
number is often large comparing with MutableCounterInt). It is used a lot in
Hadoop metrics system, i.e. DatanodeMetrics.
You can find more details on metrics v2 in Hadoop wiki link (
Hi Sandeep,
I think Apache Oozie is something you are looking for. It provide workflow
management on Hadoop (and Pig, Hive, etc.) jobs and support continuously run
jobs in specific time period. Please refer: http://oozie.apache.org/docs/3.3.2/
for details.
Thanks,
Junping
- Original
I see from the log, the tasktracker try to connect to ipc server:
ubuntu.local/192.168.164.138:9100.
Do you set the correct mapred.job.tracker on slave node also?
Thanks,
Junping
-Original Message-
From: tgh [mailto:guanhua.t...@ia.ac.cn]
Sent: Thursday, February 23, 2012 5:03 PM
To:
Hi Guruprasad,
Do you have the valid IP--hostname setting in /etc/hosts so that
each nodes can be accessed by hostname? I guess the configuration over
public network can work may because it can get hostname resolved by DNS.
Thanks,
Junping
-Original Message-
From: Guruprasad B
