Daniel Dai created PIG-5036: ------------------------------- Summary: Remove biggish from e2e input dataset Key: PIG-5036 URL: https://issues.apache.org/jira/browse/PIG-5036 Project: Pig Issue Type: Improvement Components: e2e harness Reporter: Daniel Dai Assignee: Daniel Dai Fix For: 0.17.0
To reduce e2e runtime. It takes around 10 min to generate it and more time to run the tests involving the file (Rank_4, Rank_5). Actually it is not necessary, the purpose is to run multiple map and we can do that with "mapreduce.input.fileinputformat.split.maxsize" parameter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)