[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737122#comment-14737122 ]
Sreenath Somarajapuram edited comment on TEZ-2792 at 9/9/15 4:24 PM: --------------------------------------------------------------------- [~hitesh] - '*' -- Sorry that I missed that change by the IDE, will revert the same in patch 2. - minID: -- They are minimized version of complete entity ID. -- Helps to shorten the url length. -- dagMinID = dagIndex -- vertexMinID = vertexIndex -- taskMinID = vertexIndex_taskIndex -- attemptMinID = vertexIndex_taskIndex_attemptNo (vertexIndex_taskIndex = vertexIndex_taskIndex_0 making it shorter in most cases) - Why dagMinID: -- The complete url looks like http://address:8088/proxy/application_1441301219877_0111/ws/v2/tez/tasksInfo?dagMinID=1&taskMinID=0_48,0_49,0_46,0_47,0_44,0_45,0_43,0_42,0_41,0_40,0_39,0_38,0_36,0_37,0_35,0_34,0_33,0_32,0_31,0_30,0_28,0_29,0_27,0_26,0_24 -- dagMinID was added considering applications that might have multiple DAGs. -- Also RM uses the complete application id to proxy to AM. Once there the full dagID is not required. - For getIntegersFromRequest() and getMinIDsFromRequest(), how do you distinguish a request which says give me everything to one which had invalid paramters passed in? -- invalid paramters: Both the function will return null. -- give me everything: Bith the function will give an empty array. - It seems checkAndGetDAGFromRequestMinID() and checkAndGetDAGFromRequest are similar except for the param name? Maybe the 2 can be combined? -- Idea is to replace dagID with dagMinID. The function also will be removed. -- A ticket have been created for the same TEZ-2793 - Making MAX_QUERIED configurable. -- MAX_QUERIED is the default value, the UI can pass a higher limit. -- Have created TEZ-2794 for making it configurable. was (Author: sreenath): [~hitesh] - '*' -- Sorry that I missed that change by the IDE, will revert the same in patch 2. - minID: -- They are minimized version of complete entity ID. -- Helps to shorten the url length. -- dagMinID = dagIndex -- vertexMinID = vertexIndex -- taskMinID = vertexIndex_taskIndex -- attemptMinID = vertexIndex_taskIndex_attemptNo (vertexIndex_taskIndex = vertexIndex_taskIndex_0 making it shorter in most cases) - Why dagMinID: -- The complete url looks like http://address:8088/proxy/application_1441301219877_0111/ws/v2/tez/tasksInfo?dagMinID=1&taskMinID=0_48,0_49,0_46,0_47,0_44,0_45,0_43,0_42,0_41,0_40,0_39,0_38,0_36,0_37,0_35,0_34,0_33,0_32,0_31,0_30,0_28,0_29,0_27,0_26,0_24 -- dagMinID was added considering applications that might have multiple DAGs. -- Also RM uses the complete application id to proxy to AM. Once there the full dagID is not required. - For getIntegersFromRequest() and getMinIDsFromRequest(), how do you distinguish a request which says give me everything to one which had invalid paramters passed in? -- invalid paramters: Both the function will return null. -- give me everything: Bith the function will give an empty array. - It seems checkAndGetDAGFromRequestMinID() and checkAndGetDAGFromRequest are similar except for the param name? Maybe the 2 can be combined? -- Idea is to replace dagID with dagMinID. The function also will be removed. -- A ticket have been created for the same TEZ-2793 - Making MAX_QUERIED configurable. -- MAX_QUERIED is the default value, the UI can pass a higher limit. -- Have created TEZ-2794 for the same. > Add AM web service API for tasks. > --------------------------------- > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI > Reporter: Sreenath Somarajapuram > Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagMinID: dagMinID = dagIndex, (mandatory). > -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. > -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskMinID is passed: All (capped by limit) the specified tasks will be > returned. vertexMinID if present wont be considered. > - IF vertexMinID is passed: All (capped by limit) tasks under the vertices > will be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)