[ https://issues.apache.org/jira/browse/PIG-5380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated PIG-5380: ------------------------------ Attachment: pig-5380-v03.patch {quote} Also while comparing the two source codes, I think I found one section that was missing locking while reading from memory. Added. {quote} Actually there were more than one. Creating (yet another) jira for the race condition and updating the patch to just focus on the issue reported on this jira. > SortedDataBag hitting ConcurrentModificationException or producing incorrect > output in a corner-case > ----------------------------------------------------------------------------------------------------- > > Key: PIG-5380 > URL: https://issues.apache.org/jira/browse/PIG-5380 > Project: Pig > Issue Type: Bug > Reporter: Koji Noguchi > Assignee: Koji Noguchi > Priority: Major > Attachments: pig-5380-v01.patch, pig-5380-v02.patch, > pig-5380-v03.patch > > > User had a UDF that created large SortedDataBag. This UDF was failing with > {noformat} > java.util.ConcurrentModificationException > at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:901) > at java.util.ArrayList$Itr.next(ArrayList.java:851) > at > org.apache.pig.data.SortedDataBag$SortedDataBagIterator.readFromPriorityQ(SortedDataBag.java:346) > at > org.apache.pig.data.SortedDataBag$SortedDataBagIterator.next(SortedDataBag.java:322) > at > org.apache.pig.data.SortedDataBag$SortedDataBagIterator.hasNext(SortedDataBag.java:235) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)