[ https://issues.apache.org/jira/browse/PIG-4521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517459#comment-14517459 ]
Daniel Dai commented on PIG-4521: --------------------------------- [~rohini], Namit is already using parallel execution. The problem nightly.conf dominates the runtime and other conf all together only takes a minor share of runtime, that's why he wants to break nightly.conf. I agree if break into logical groups makes more sense, but nightly.conf currently is a misc bag I cannot identify a single group of test which can bring nightly.conf significantly smaller. Breaking it into lots of files based on test groups might be too disruptive. How do you think? > Divide nightly.conf tests into two test files > --------------------------------------------- > > Key: PIG-4521 > URL: https://issues.apache.org/jira/browse/PIG-4521 > Project: Pig > Issue Type: Test > Reporter: Namit Maheshwari > Attachments: PIG-4521.patch > > > Currently Pig e2e tests take a lot of time to execute and complete the run. > But most of the tests are in a single test file i.e. nightly.conf > The idea is to break the nightly.conf file into two, such that each file > contains about equal number of tests. This way we can execute the tests on > separate clusters and finish the run faster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)