Re: In YARN, how does a task tracker knows the address of a job tracker?

2013-11-21 Thread ricky l
h all mapper, reducer tasks as well as the client. > > John > > > > > > *From:* ricky l [mailto:rickylee0...@gmail.com] > *Sent:* Thursday, November 21, 2013 12:36 PM > *To:* user@hadoop.apache.org > *Subject:* Re: In YARN, how does a task tracker knows the address

RE: In YARN, how does a task tracker knows the address of a job tracker?

2013-11-21 Thread John Lilley
s the client. John From: ricky l [mailto:rickylee0...@gmail.com] Sent: Thursday, November 21, 2013 12:36 PM To: user@hadoop.apache.org Subject: Re: In YARN, how does a task tracker knows the address of a job tracker? Thank you for the answer, Omkar. I read the links that were helpful. Though the co

Re: In YARN, how does a task tracker knows the address of a job tracker?

2013-11-21 Thread ricky l
Thank you for the answer, Omkar. I read the links that were helpful. Though the concept of job tracker/task tracker does not exist in the YARN MapReduce, doesn't it use the binary of job/task tracker? I though the application master runs job tracker binary and the containers in the node will run t

Re: In YARN, how does a task tracker knows the address of a job tracker?

2013-11-21 Thread Omkar Joshi
Hi, Starting with YARN there is no notion of job tracker and task tracker. Here is a quick summary JobTracker :- 1) Resource management :- Now done by Resource Manager (it does all scheduling work) 2) Application state management :- managing and launching new map /reduce tasks (done by Application

RE: In YARN, how does a task tracker knows the address of a job tracker?

2013-11-23 Thread John Lilley
s into the hadoop install. As they say, that exercise is left to the reader. john From: ricky l [mailto:rickylee0...@gmail.com] Sent: Thursday, November 21, 2013 3:40 PM To: user@hadoop.apache.org Subject: Re: In YARN, how does a task tracker knows the address of a job tracker? Hi John, thanks