[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct
[
https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968393#comment-15968393
]
Rajesh Balamohan commented on HIVE-16436:
-
[~prasanth_j] - I have not seen negative values in the response times. I tried
with .2 patch and it works fine. I am fine with either of the patches. :)
> Response times in "Task Execution Summary" at the end of the job is not
> correct
> ---
>
> Key: HIVE-16436
> URL: https://issues.apache.org/jira/browse/HIVE-16436
> Project: Hive
> Issue Type: Bug
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-16436.1.patch, HIVE-16436.2.patch
>
>
> "Task execution summary" is printed at the of running a hive query. E.g
> {noformat}
> Task Execution Summary
> --
> VERTICES DURATION(ms) CPU_TIME(ms)GC_TIME(ms) INPUT_RECORDS
> OUTPUT_RECORDS
> --
> Map 1 277869.00 0 0 1,500,000,000
> 1,500,000,000
> Map 2 277868.00 0 0 5,999,989,709
>31,162,299
> Reducer 3 59875.00 0 0 1,531,162,299
> 2,018
> Reducer 4 2436.00 0 0 2,018
> 2
> Reducer 5375.00 0 0 2
> 0
> --
> {noformat}
> Response times reported here for Map-1/Map-2 is not correct. Not sure if
> this is broken due to any other patch. Creating this jira for tracking
> purpose.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct
[
https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968101#comment-15968101
]
Hive QA commented on HIVE-16436:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12863322/HIVE-16436.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 10571 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr]
(batchId=143)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4675/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4675/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4675/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12863322 - PreCommit-HIVE-Build
> Response times in "Task Execution Summary" at the end of the job is not
> correct
> ---
>
> Key: HIVE-16436
> URL: https://issues.apache.org/jira/browse/HIVE-16436
> Project: Hive
> Issue Type: Bug
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-16436.1.patch, HIVE-16436.2.patch
>
>
> "Task execution summary" is printed at the of running a hive query. E.g
> {noformat}
> Task Execution Summary
> --
> VERTICES DURATION(ms) CPU_TIME(ms)GC_TIME(ms) INPUT_RECORDS
> OUTPUT_RECORDS
> --
> Map 1 277869.00 0 0 1,500,000,000
> 1,500,000,000
> Map 2 277868.00 0 0 5,999,989,709
>31,162,299
> Reducer 3 59875.00 0 0 1,531,162,299
> 2,018
> Reducer 4 2436.00 0 0 2,018
> 2
> Reducer 5375.00 0 0 2
> 0
> --
> {noformat}
> Response times reported here for Map-1/Map-2 is not correct. Not sure if
> this is broken due to any other patch. Creating this jira for tracking
> purpose.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct
[
https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967975#comment-15967975
]
Prasanth Jayachandran commented on HIVE-16436:
--
To make sure if .2 works, [~rajesh.balamohan] did you see the end time to be
negative as well? Made a minor change in .2 to make it consistent. If that does
not work, I will commit .1
> Response times in "Task Execution Summary" at the end of the job is not
> correct
> ---
>
> Key: HIVE-16436
> URL: https://issues.apache.org/jira/browse/HIVE-16436
> Project: Hive
> Issue Type: Bug
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-16436.1.patch, HIVE-16436.2.patch
>
>
> "Task execution summary" is printed at the of running a hive query. E.g
> {noformat}
> Task Execution Summary
> --
> VERTICES DURATION(ms) CPU_TIME(ms)GC_TIME(ms) INPUT_RECORDS
> OUTPUT_RECORDS
> --
> Map 1 277869.00 0 0 1,500,000,000
> 1,500,000,000
> Map 2 277868.00 0 0 5,999,989,709
>31,162,299
> Reducer 3 59875.00 0 0 1,531,162,299
> 2,018
> Reducer 4 2436.00 0 0 2,018
> 2
> Reducer 5375.00 0 0 2
> 0
> --
> {noformat}
> Response times reported here for Map-1/Map-2 is not correct. Not sure if
> this is broken due to any other patch. Creating this jira for tracking
> purpose.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct
[
https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967416#comment-15967416
]
Hive QA commented on HIVE-16436:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12863230/HIVE-16436.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 10571 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteDecimalX
(batchId=178)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDate (batchId=178)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDate2 (batchId=178)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4674/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4674/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4674/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12863230 - PreCommit-HIVE-Build
> Response times in "Task Execution Summary" at the end of the job is not
> correct
> ---
>
> Key: HIVE-16436
> URL: https://issues.apache.org/jira/browse/HIVE-16436
> Project: Hive
> Issue Type: Bug
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-16436.1.patch
>
>
> "Task execution summary" is printed at the of running a hive query. E.g
> {noformat}
> Task Execution Summary
> --
> VERTICES DURATION(ms) CPU_TIME(ms)GC_TIME(ms) INPUT_RECORDS
> OUTPUT_RECORDS
> --
> Map 1 277869.00 0 0 1,500,000,000
> 1,500,000,000
> Map 2 277868.00 0 0 5,999,989,709
>31,162,299
> Reducer 3 59875.00 0 0 1,531,162,299
> 2,018
> Reducer 4 2436.00 0 0 2,018
> 2
> Reducer 5375.00 0 0 2
> 0
> --
> {noformat}
> Response times reported here for Map-1/Map-2 is not correct. Not sure if
> this is broken due to any other patch. Creating this jira for tracking
> purpose.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct
[
https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967399#comment-15967399
]
Gopal V commented on HIVE-16436:
Alright, completed == total till the end of the query, causing the perf logger
to get reset the endTime.
+1
> Response times in "Task Execution Summary" at the end of the job is not
> correct
> ---
>
> Key: HIVE-16436
> URL: https://issues.apache.org/jira/browse/HIVE-16436
> Project: Hive
> Issue Type: Bug
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-16436.1.patch
>
>
> "Task execution summary" is printed at the of running a hive query. E.g
> {noformat}
> Task Execution Summary
> --
> VERTICES DURATION(ms) CPU_TIME(ms)GC_TIME(ms) INPUT_RECORDS
> OUTPUT_RECORDS
> --
> Map 1 277869.00 0 0 1,500,000,000
> 1,500,000,000
> Map 2 277868.00 0 0 5,999,989,709
>31,162,299
> Reducer 3 59875.00 0 0 1,531,162,299
> 2,018
> Reducer 4 2436.00 0 0 2,018
> 2
> Reducer 5375.00 0 0 2
> 0
> --
> {noformat}
> Response times reported here for Map-1/Map-2 is not correct. Not sure if
> this is broken due to any other patch. Creating this jira for tracking
> purpose.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct
[
https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967338#comment-15967338
]
Rajesh Balamohan commented on HIVE-16436:
-
{{perfLogger.PerfLogEnd}} was getting invoked for every report causing this
issue.
> Response times in "Task Execution Summary" at the end of the job is not
> correct
> ---
>
> Key: HIVE-16436
> URL: https://issues.apache.org/jira/browse/HIVE-16436
> Project: Hive
> Issue Type: Bug
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-16436.1.patch
>
>
> "Task execution summary" is printed at the of running a hive query. E.g
> {noformat}
> Task Execution Summary
> --
> VERTICES DURATION(ms) CPU_TIME(ms)GC_TIME(ms) INPUT_RECORDS
> OUTPUT_RECORDS
> --
> Map 1 277869.00 0 0 1,500,000,000
> 1,500,000,000
> Map 2 277868.00 0 0 5,999,989,709
>31,162,299
> Reducer 3 59875.00 0 0 1,531,162,299
> 2,018
> Reducer 4 2436.00 0 0 2,018
> 2
> Reducer 5375.00 0 0 2
> 0
> --
> {noformat}
> Response times reported here for Map-1/Map-2 is not correct. Not sure if
> this is broken due to any other patch. Creating this jira for tracking
> purpose.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
