[
https://issues.apache.org/jira/browse/FLINK-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346050#comment-14346050
]
ASF GitHub Bot commented on FLINK-1587:
---------------------------------------
Github user vasia commented on the pull request:
https://github.com/apache/flink/pull/440#issuecomment-77068115
Hi,
I was about to merge this one, but I have two doubts:
- the tests print all execution output, including the exceptions, in
standard output. Is this OK or should we avoid it?
- apart from the expected exception, the last 3 tests also produce the
following:
```
java.lang.Exception: The data preparation for task 'Reduce(SUM(1), at
getDegrees(Graph.java:664) (981992a0fbf442e4039eba434b173362)' , caused an
error: Error obtaining the sorted input: Thread 'SortMerger Reading Thread'
terminated due to an exception: Bug in input gate/channel logic: input gate
gotnotified by channel about available data, but none was available.
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:471)
at
org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
at
org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:205)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Error obtaining the sorted input:
Thread 'SortMerger Reading Thread' terminated due to an exception: Bug in input
gate/channel logic: input gate gotnotified by channel about available data, but
none was available.
at
org.apache.flink.runtime.operators.sort.UnilateralSortMerger.getIterator(UnilateralSortMerger.java:607)
at
org.apache.flink.runtime.operators.RegularPactTask.getInput(RegularPactTask.java:1131)
at
org.apache.flink.runtime.operators.GroupReduceDriver.prepare(GroupReduceDriver.java:94)
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:466)
... 3 more
Caused by: java.io.IOException: Thread 'SortMerger Reading Thread'
terminated due to an exception: Bug in input gate/channel logic: input gate
gotnotified by channel about available data, but none was available.
at
org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:784)
Caused by: java.lang.IllegalStateException: Bug in input gate/channel
logic: input gate gotnotified by channel about available data, but none was
available.
at
org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.getNextBufferOrEvent(SingleInputGate.java:314)
at
org.apache.flink.runtime.io.network.partition.consumer.UnionInputGate.getNextBufferOrEvent(UnionInputGate.java:141)
at
org.apache.flink.runtime.io.network.api.reader.AbstractRecordReader.getNextRecord(AbstractRecordReader.java:75)
at
org.apache.flink.runtime.io.network.api.reader.MutableRecordReader.next(MutableRecordReader.java:34)
at
org.apache.flink.runtime.operators.util.ReaderIterator.next(ReaderIterator.java:59)
at
org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ReadingThread.go(UnilateralSortMerger.java:958)
at
org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:781)
```
I'm not sure where this is coming from and whether it's a problem in this
case. Any ideas?
Thanks ^^
> coGroup throws NoSuchElementException on iterator.next()
> --------------------------------------------------------
>
> Key: FLINK-1587
> URL: https://issues.apache.org/jira/browse/FLINK-1587
> Project: Flink
> Issue Type: Bug
> Components: Gelly
> Environment: flink-0.8.0-SNAPSHOT
> Reporter: Carsten Brandt
> Assignee: Andra Lungu
>
> I am receiving the following exception when running a simple job that
> extracts outdegree from a graph using Gelly. It is currently only failing on
> the cluster and I am not able to reproduce it locally. Will try that the next
> days.
> {noformat}
> 02/20/2015 02:27:02: CoGroup (CoGroup at inDegrees(Graph.java:675)) (5/64)
> switched to FAILED
> java.util.NoSuchElementException
> at java.util.Collections$EmptyIterator.next(Collections.java:3006)
> at flink.graphs.Graph$CountNeighborsCoGroup.coGroup(Graph.java:665)
> at
> org.apache.flink.runtime.operators.CoGroupDriver.run(CoGroupDriver.java:130)
> at
> org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:493)
> at
> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:360)
> at
> org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:257)
> at java.lang.Thread.run(Thread.java:745)
> 02/20/2015 02:27:02: Job execution switched to status FAILING
> ...
> {noformat}
> The error occurs in Gellys Graph.java at this line:
> https://github.com/apache/flink/blob/a51c02f6e8be948d71a00c492808115d622379a7/flink-staging/flink-gelly/src/main/java/org/apache/flink/graph/Graph.java#L636
> Is there any valid case where a coGroup Iterator may be empty? As far as I
> see there is a bug somewhere.
> I'd like to write a test case for this to reproduce the issue. Where can I
> put such a test?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
