[
https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15817037#comment-15817037
]
Vrushali C commented on YARN-6058:
----------------------------------
In the context of retrieving information from the flow activity table, here is
a suggestion that will help frameworks like Tez:
- In the flow activity table (as well as flow run table), we should also store
the framework type of the flow, for instance, for a job that runs as part of
the Tez workflow, we should add in a column like "type!tez" and value could be
null.
- this will enable queries like which are the most recently run flows which
have framework type of "Tez" on the flow activity table.
One flow can have multiple framework types, for instance, an oozie job can have
pig and then hadoop map reduce. The flow will have three columns "type!oozie",
"type!pig" , "type!mr".
> Support for listing all applications i.e /apps
> ----------------------------------------------
>
> Key: YARN-6058
> URL: https://issues.apache.org/jira/browse/YARN-6058
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelinereader
> Reporter: Rohith Sharma K S
> Assignee: Rohith Sharma K S
> Priority: Critical
> Labels: yarn-5355-merge-blocker
>
> Primary use case for /apps is many execution engines runs on top of YARN
> example, Tez, MR. These engines will have their own UI's which list specific
> type of entities which are published by them Ex: DAG entities.
> But, these UI's do not aware of either userName or flowName or applicationId
> which are submitted by these engines.
> Currently, given that user do not aware of user, flownName, and
> applicationId, then he can not retrieve any entities.
> By supporting /apps with filters, user can list of application with given
> ApplicationType. These applications can be used for retrieving engine
> specific entities like DAG.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
