Vihang Karajgaonkar created HIVE-19514:
------------------------------------------

             Summary: Successful test logs should be copied
                 Key: HIVE-19514
                 URL: https://issues.apache.org/jira/browse/HIVE-19514
             Project: Hive
          Issue Type: Sub-task
            Reporter: Vihang Karajgaonkar
            Assignee: Vihang Karajgaonkar


Ptest tries to copy ~20G worth of logs from the worker nodes to the server. The 
total aggregate time spent by all the hosts in copying these files is close to 
15 min in copying files. Most of the times we don't check for the logs. We 
seldom check for logs of successful tests. We should ignore copying successful 
test logs by default to improve runtime.

{noformat}
2018-05-13 16:10:15,243  INFO [TestExecutor] PTest.run:235 Executed 13568 tests
2018-05-13 16:10:15,243  INFO [TestExecutor] PTest.run:237 PERF: ExecutionPhase 
took 71 minutes
2018-05-13 16:10:15,243  INFO [TestExecutor] PTest.run:237 PERF: 
ExecutionPhase.TotalRsyncElapsedTime took 15 minutes
2018-05-13 16:10:15,243  INFO [TestExecutor] PTest.run:237 PERF: PrepPhase took 
5 minutes
2018-05-13 16:10:15,243  INFO [TestExecutor] PTest.run:237 PERF: ReportingPhase 
took 0 minutes
2018-05-13 16:10:15,243  INFO [TestExecutor] PTest.run:237 PERF: TestCheckPhase 
took 0 minutes
2018-05-13 16:10:15,243  INFO [TestExecutor] PTest.run:237 PERF: YetusPhase 
took 0 minutes
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to