[
https://issues.apache.org/jira/browse/TEZ-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276929#comment-14276929
]
Prakash Ramachandran edited comment on TEZ-1942 at 1/14/15 2:18 PM:
--------------------------------------------------------------------
did some analysis. looks like the results returned is changing based on the
query parameters.
when queried for "get all vertexes for this dag" it returns 1009 (numTasks in
the screenshot)
see screenshot result_with_primary_filter.png
{code}
http://machine:8188/ws/v1/timeline/TEZ_VERTEX_ID?limit=11&primaryFilter=TEZ_DAG_ID%3Adag_1421164610335_0020_1
{code}
when queried for "get for a particular dag" it returns 253
see screenshot result_with_direct_vertex.png
{code}
http://machine:8188/ws/v1/timeline/TEZ_VERTEX_ID/vertex_1421164610335_0020_1_01/
{code}
was (Author: pramachandran):
did some analysis. looks like the results returned is changing based on the
query parameters.
when queried for "get all vertexes for this dag" it returns 1009 (numTasks in
the screenshot)
{code}
http://machine:8188/ws/v1/timeline/TEZ_VERTEX_ID?limit=11&primaryFilter=TEZ_DAG_ID%3Adag_1421164610335_0020_1
{code}
when queried for "get for a particular dag" it returns 253
{code}
http://machine:8188/ws/v1/timeline/TEZ_VERTEX_ID/vertex_1421164610335_0020_1_01/
{code}
> Number of tasks show in Tez UI with auto-reduce parallelism is misleading
> -------------------------------------------------------------------------
>
> Key: TEZ-1942
> URL: https://issues.apache.org/jira/browse/TEZ-1942
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Attachments: Screen Shot 2015-01-14 at 9.18.21 AM.png, Screen Shot
> 2015-01-14 at 9.18.54 AM.png, output.json, result_with_direct_vertex.png,
> result_with_primary_filter.png
>
>
> Ran a simple hive query (with tez) and "--hiveconf
> hive.tez.auto.reducer.parallelism=true" . This internally turns on tez's
> auto reduce parallelism.
> - Job started off with 1009 reduce tasks
> - Tez reduces the number of reducers to 253
> - Job completes successfully, but TEZ UI shows 1009 as the number of reducers
> (and 253 tasks as successful tasks). This can be a little misleading.
> I will attach the screenshots soon.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
