hanks a lot.
An "EMR node" in this case is an EC2 instance running an AMI which the AWS folk
have configured and install a version of hadoop on.
You can find the EMR AMI for EC2 by searching for AWS157 under AMIs.
Mischa
>
> Cheers
> Ramon
>
> Date: Fri, 19 Jul 2013 1
p-ec2 launch-cluster command
start EMR node or common EC2 instance? Thanks a lot.
CheersRamon
Date: Fri, 19 Jul 2013 16:37:21 +1000
Subject: Re: How does AWS know how many map/reduce slot should be configured to
each EC2 instance?
From: tianyi@facilitatedigital.com
To: user@hadoop.apache.o
:
> % bin/hadoop-ec2 launch-cluster test-cluster 2
>
> The command allows me to start a cluster with required nodes(no more than
> 20, correct me if i were wrong), so here comes to my questions:
>
> 1. How does AWS know how many map/reduce slot should be configured to each
> EC2 in
were wrong), so here comes to my questions:
1. How does AWS know how many map/reduce slot should be configured to each EC2
instance? Is it depends on the EC2 instance type (m1.large, m1.xlarge...)?2.
How it is charged? Nodes number * price per node per hour ?3. Is each node like
a single EC2
I checked my MR admin page running on :50030:jobtracker.jsp this is what
I am learning.
I run 2-core processor, so the admin page told me that my max map/reduce slot
capacity was 14 or so I assume 7 nodes x 2slots.
I did not touch the property of .map.tasks. It seemed that MR set it nicely
"However in production clustes the jvm size is marked final to prevent abuses
that may lead to OOMs."
Not necessarily.
On Nov 1, 2012, at 6:43 AM, Bejoy Ks wrote:
> However in production clustes the jvm size is marked final to prevent abuses
> that may lead to OOMs.
Hi Uddipan,
In my Opinion
Hadoop Jobtracker Interface provides every Details Including
# number of Map slots
# number of Reducer slots
and other Infromation can also be found in Log files generated.
Which can also be explored through the same Interface.
Jobtracker address : Masternode:y
Hi Hadoop Gurus.
What is the good way to know following information in my Hadoop cluster.
# number of Map slots
# number of Reducer slots
JVM Heapsize for Map task
JVM heapsize for reduce task
reuse JVM flag
Thanks and Regards
Uddipan
CAUTION - Disclaimer *
Th
