[
https://issues.apache.org/jira/browse/FLINK-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127596#comment-14127596
]
Stephan Ewen commented on FLINK-1090:
-------------------------------------
I think the reason may be very similar to [FLINK-1088].
We are finalizing a new network runtime that can handle these situations
properly.
Here is a hint how to temporarily work around that: In general, deadlocks can
only occur if there are more the one consumer for a data set. We run a deadlock
detection algorithm, but it still has some deficits that we are aware of.
You should always be able to work around that by creating two different
DataSets instead of using the same one twice. That is a workaround with
overhead, but is is only temporary.
> Join deadlocks when used inside Delta iteration
> -----------------------------------------------
>
> Key: FLINK-1090
> URL: https://issues.apache.org/jira/browse/FLINK-1090
> Project: Flink
> Issue Type: Bug
> Components: Distributed Runtime, Iterations, Scala API
> Affects Versions: 0.6-incubating
> Environment: Ubuntu 14.04, Flink 0.6-incubating
> LocalExecutor
> JVM 1.7 with 7 GB RAM assigned
> Reporter: Stefan Bunk
>
> I have a join inside a delta iteration, which hangs, i.e.I think it's
> deadlocked.
> If I do the join without a delta iteration, it works.
> _Why I think it's a deadlock_:
> - no output in the logs
> - CPU idles
> - no IO (measured using iotop)
> - stacktrace (when starting in debug mode and stopping at arbitrary points)
> locks deadlockish !http://i.imgur.com/4TgSK3x.png!
> _Join properties_:
> - size of the operands: 6.1 GB, 257 MB
> - estimated result size: 50 MB
> - the deadlock only occurs for big inputs, if I decrease the size of the
> first operand to something smaller, e.g. 1MB, it works.
> I am using the Scala API.
> Let me know, which further information you need. The code is basically the
> one I posted on the [mailing
> list|http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/Delta-Iteration-Runtime-Error-quot-Could-not-set-up-runtime-strategy-for-input-channel-to-node-quot-td6.html],
> but I could provide a compilable version if thats necessary.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
