[
https://issues.apache.org/jira/browse/PIG-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Daniels updated PIG-2336:
------------------------------
Description:
In ILLUSTRATE, an ORDER statement followed by a LIMIT statement throws a
ConcurrentModificationException. I've attached a test exercising the bug (it
also provides the embedded Exception in PigServer).
The stack trace is:
{code}
java.io.IOException: Exception : null
at org.apache.pig.PigServer.getExamples(PigServer.java:1208)
at
org.apache.pig.test.TestExampleGenerator.testOrderThenLimit(TestExampleGenerator.java:371)
Caused by: java.util.ConcurrentModificationException
at
java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372)
at java.util.AbstractList$Itr.next(AbstractList.java:343)
at
org.apache.pig.data.ReadOnceBag$ReadOnceBagIterator.next(ReadOnceBag.java:242)
at
org.apache.pig.data.ReadOnceBag$ReadOnceBagIterator.next(ReadOnceBag.java:227)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:411)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:208)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:290)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLimit.getNext(POLimit.java:117)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.runPipeline(PigGenericMapReduce.java:459)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:427)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:407)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:261)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at
org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:222)
at
org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257)
at
org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238)
at
org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:200)
at org.apache.pig.PigServer.getExamples(PigServer.java:1202)
{code}
was:
In ILLUSTRATE, an ORDER statement followed by a LIMIT statement throws a
ConcurrentModificationException. I've attached a test exercising the bug (it
also provides the embedded Exception in PigServer).
> ORDER then LIMIT throws ConcurrentModificationException in ILLUSTRATE
> ---------------------------------------------------------------------
>
> Key: PIG-2336
> URL: https://issues.apache.org/jira/browse/PIG-2336
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.0, 0.10
> Reporter: Doug Daniels
> Attachments: PIG-2336-test.patch
>
>
> In ILLUSTRATE, an ORDER statement followed by a LIMIT statement throws a
> ConcurrentModificationException. I've attached a test exercising the bug (it
> also provides the embedded Exception in PigServer).
> The stack trace is:
> {code}
> java.io.IOException: Exception : null
> at org.apache.pig.PigServer.getExamples(PigServer.java:1208)
> at
> org.apache.pig.test.TestExampleGenerator.testOrderThenLimit(TestExampleGenerator.java:371)
> Caused by: java.util.ConcurrentModificationException
> at
> java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372)
> at java.util.AbstractList$Itr.next(AbstractList.java:343)
> at
> org.apache.pig.data.ReadOnceBag$ReadOnceBagIterator.next(ReadOnceBag.java:242)
> at
> org.apache.pig.data.ReadOnceBag$ReadOnceBagIterator.next(ReadOnceBag.java:227)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:411)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:208)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:290)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLimit.getNext(POLimit.java:117)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.runPipeline(PigGenericMapReduce.java:459)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:427)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:407)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:261)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
> at
> org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:222)
> at
> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257)
> at
> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238)
> at
> org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:200)
> at org.apache.pig.PigServer.getExamples(PigServer.java:1202)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
