Hi, all
Here is my question: is there a mechanisms that when one container exit
abnormally, yarn will prefer to dispatch the container on other NM?
We have a cluster with 3 NMs(each NM 135g mem) and 1 RM, and we running a job
which start 13 container(= 1 AM + 12 executor containers).
Each NM
I'm looking @ this page: http://hadoop.apache.org/docs/stable/
Is it a typo that Hadoop 2.6.0 is based on 2.4.1?
Thanks.
I was more interested in a way to do it programmatically. Found out it
today that
Configuration conf =newConfiguration();
conf.addResource(newPath("/etc/hadoop/conf/core-site.xml"));
conf.addResource(newPath("/etc/hadoop/conf/hdfs-site.xml"));
String ns = conf.get("fs.defaultFS");
FileSystem fs
I figured out that the default is 50020. Thank Ted.
At 2014-12-09 23:06:37, "Todd" wrote:
I paste the Image below for what I mean, there are two ports out there
(M/R(v2)Master) and DFS Master.
Wonder to know where these two ports come from.
At 2014-12-09 22:59:17, "Ted Yu" wrote:
I paste the Image below for what I mean, there are two ports out there
(M/R(v2)Master) and DFS Master.
Wonder to know where these two ports come from.
At 2014-12-09 22:59:17, "Ted Yu" wrote:
bq. M/R(v2) master port
Did you mean port for resourcemanager ?
Take a look at
./hadoop-yarn-
bq. M/R(v2) master port
Did you mean port for resourcemanager ?
Take a look
at
./hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
where you can find:
yarn.resourcemanager.bind-host
yarn.nodemanager.bind-host
Cheers
On Tue, Dec 9, 2014 at 6:51 AM, Todd wrot
Hi,hadoopers,
I am new to hadoop. I am using Hadoop2.5.2 and Yarn as MR. I would ask the two
ports, M/R(v2) master port and DFS Master port that is to be configured in the
Eclipse hadoop plugin view.
Which properties do these ports correspond to in the hadoop configuration
files,eg, yarn-site.
You can use REST API. Example:
https://issues.apache.org/jira/rest/api/2/search?jql=project%20%3D%20HADOOP
This general@ mailing list is for announcements and project management.
For end-user questions and discussions, please use user@ mailing list.
Regards,
Akira
(12/9/14, 18:22), zfx wrote:
Are you asking about the type for the numberOfRuns variable which you are
declaring as a Java primitive int?
If yes, then you can use IntWritable class in Hadoop to define a integer
variable which will work with M/R
Regards,
Shahab
On Tue, Dec 9, 2014 at 3:47 AM, steven wrote:
> hi,
>
>
> i g
hi,
i got this code which extracts timeframes frome a logfile and does some
calculation on it.
input lines looks like this:
1000,T,0,104,1000,1100,27147,80,80,80,80,81,81,98,98,98,101,137,137,139,177,177,177,173,166,149,134,130,124,119,111,104,92
1000,T,1,743,300,300,4976,492,492,492,492,49
10 matches
Mail list logo
