[
https://issues.apache.org/jira/browse/PIG-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824097#comment-17824097
]
Koji Noguchi commented on PIG-5447:
-----------------------------------
I don't see how this ever worked.
Iterator under {{SkewedJoinConverter.ToValueFunction.Tuple2TransformIterable}}
is NOT following the api requirement.
{{hasNext()}} simply returns by checking the delegated iterator.
{quote}{{delegate.hasNext();}}
{quote}
However, inside {{{}next(){}}}, it sometimes recursively traverses the
delegated iterator by calling {{next()}} inside. So even when {{hasNext()}}
returns true, there are times when {{next()}} doesn't have an element to return
and ending up with {{{}NoSuchElementException{}}}.
> Pig-on-Spark TestSkewedJoin.testSkewedJoinOuter failing with
> NoSuchElementException
> -----------------------------------------------------------------------------------
>
> Key: PIG-5447
> URL: https://issues.apache.org/jira/browse/PIG-5447
> Project: Pig
> Issue Type: Bug
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Priority: Major
>
> TestSkewedJoin.testSkewedJoinOuter is consistently failing for right-outer
> and full-outer joins.
> "Caused by: java.util.NoSuchElementException: next on empty iterator"
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
