[
https://issues.apache.org/jira/browse/PIG-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gianmarco De Francisci Morales resolved PIG-1539.
-------------------------------------------------
Resolution: Fixed
Thanks Daniel.
It worked. I assume there are temp files that need to be cleaned up when
testing with MiniCluster.
It might be worth opening a separate Jira for this.
> TestAccumulator fails on trunk
> ------------------------------
>
> Key: PIG-1539
> URL: https://issues.apache.org/jira/browse/PIG-1539
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Gianmarco De Francisci Morales
> Priority: Minor
>
> TestAccumulator fails systematically on trunk.
> I have already tried 5 times with no success.
> Once I got successful testing exit result but I still got errors in the log.
> Here the error.
> Testcase: testAccumWithBuildin took 17.202 sec
> Caused an ERROR
> Unable to open iterator for alias D
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> open iterator for alias D
> at org.apache.pig.PigServer.openIterator(PigServer.java:728)
> at
> org.apache.pig.test.TestAccumulator.testAccumWithBuildin(TestAccumulator.java:495)
> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2088:
> Unable to get results for:
> hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957:org.apache.pig.impl.io.InterStorage
> at
> org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:99)
> at org.apache.pig.PigServer.openIterator(PigServer.java:716)
> Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input
> path does not exist: hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigFileInputFormat.listStatus(PigFileInputFormat.java:37)
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
> at
> org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:153)
> at
> org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:115)
> at
> org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:92)
> Caused by this
> INFO mapred.TaskInProgress: Error from
> attempt_20100807152543110_0002_r_000000_0:
> org.apache.pig.backend.executionengine.ExecException: ERROR 2078: Caught
> error from UDF: org.apache.pig.test.utils.AccumulatorBagCount [exec() should
> not be called.]
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:262)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:283)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:355)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:291)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.runPipeline(PigMapReduce.java:435)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:403)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:383)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:251)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
> at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.io.IOException: exec() should not be called.
> at
> org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:56)
> at
> org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:28)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:229)
> ... 11 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
