Hi Brad,
YARN scheduling does take care of data locality. In YARN, tasks are not
assigned based on capacity. Actually certain number of containers are
allocated on every node based on node's capacity. Tasks are executed on
those containers. While scheduling tasks on containers YARN scheduler
As par my experience the MapReduce API is same for both YARN and MRv2.
Applications compiled again YARN should run smoothly on MRv1. Ans the vice
versa is also true.
And in general YARN is pretty stable now.
Regards,
Shekhar
On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar v1san...@us.ibm.com
Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
[image: Inactive hide details for Shekhar Gupta ---04/21/2013 06:06:33
PM---As par my experience the MapReduce API is same for both YAR]Shekhar
Gupta
I am trying to talk to R from Resource Manager. To do that I have to set a
VM argument
-Djava.library.path=/Library/Frameworks/R.framework/Resources/library/rJava/jri/
I have tried to set this argument by adding following line in hadoop-env.sh
export
are MapReduce concepts. So
ResourceManager has no idea about them. MapReduce ApplicationMaster is the
place where you can obtain more such MR specific information.
If it is the later, your question is moot.
HTH,
+Vinod
On Aug 22, 2012, at 6:23 PM, Shekhar Gupta wrote:
In ResourceManager
In ResourceManager, is there any way to findout if the assigned container
is going to execute a mapping task or a reduce task? I can access objects
Container, Application and Request in ResourceManager, can I somehow get
TaskId by using any of these objects?? Please let me know a way.
Thanks.
