Thanks Arun! It is sometimes hard for me to figure out what is built into YARN
vs what is done by convention.
John
From: Arun C Murthy [mailto:a...@hortonworks.com]
Sent: Monday, September 23, 2013 5:41 PM
To: user@hadoop.apache.org
Subject: Re: Task status query
Yep, typically, the AM should
, September 20, 2013 7:47 AM
To: user@hadoop.apache.org
Subject: Re: Task status query
Right now its MR specific (TaskUmbilicalProtocol) - YARN doesn't have any
reusable items here yet, but there are easy to use RPC libs such as Avro and
Thrift out there that make it easy to do such things once
: Harsh J [mailto:ha...@cloudera.com]
Sent: Friday, September 20, 2013 7:47 AM
To: user@hadoop.apache.org
Subject: Re: Task status query
Right now its MR specific (TaskUmbilicalProtocol) - YARN doesn't have any
reusable items here yet, but there are easy to use RPC libs such as Avro and
Thrift out
: Re: Task status query
Hi John,
YARN tasks can be more than simple executables. In case of MR, for example,
tasks talk to the AM and report their individual progress and counters back to
it, via a specific protocol (over the network), giving the AM more data to
compute an near-accurate global
How does a YARN application master typically query ongoing status (like
percentage completion) of its tasks?
I would like to be able to ultimately relay information to the user like:
100 tasks are scheduled
10 tasks are complete
4 tasks are running and they are (4%, 10%, 50%, 70%) complete
But,
Hi John,
YARN tasks can be more than simple executables. In case of MR, for
example, tasks talk to the AM and report their individual progress and
counters back to it, via a specific protocol (over the network),
giving the AM more data to compute an near-accurate global progress.
On Fri, Sep 20,
