[ 
https://issues.apache.org/jira/browse/PIG-4521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517459#comment-14517459
 ] 

Daniel Dai commented on PIG-4521:
---------------------------------

[~rohini], Namit is already using parallel execution. The problem  nightly.conf 
dominates the runtime and other conf all together only takes a minor share of 
runtime, that's why he wants to break nightly.conf. I agree if break into 
logical groups makes more sense, but nightly.conf currently is a misc bag I 
cannot identify a single group of test which can bring nightly.conf 
significantly smaller. Breaking it into lots of files based on test groups 
might be too disruptive. How do you think?

> Divide nightly.conf tests into two test files
> ---------------------------------------------
>
>                 Key: PIG-4521
>                 URL: https://issues.apache.org/jira/browse/PIG-4521
>             Project: Pig
>          Issue Type: Test
>            Reporter: Namit Maheshwari
>         Attachments: PIG-4521.patch
>
>
> Currently Pig e2e tests take a lot of time to execute and complete the run. 
> But most of the tests are in a single test file i.e. nightly.conf
> The idea is to break the nightly.conf file into two, such that each file 
> contains about equal number of tests. This way we can execute the tests on 
> separate clusters and finish the run faster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to