[
https://issues.apache.org/jira/browse/TEZ-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983539#comment-13983539
]
Cheolsoo Park commented on TEZ-1087:
------------------------------------
{quote}
For the patch itself, I think we are better off just continuing after checking
for completed inputs instead of re-ordering the way its done in that patch.
Unless you see differently, I will make that change.
{quote}
Sure. I was just swapping the order because I didn't want to change any logic.
If it's not possible that both conditions ({{obsoletedInputs.contains(input) &&
completedInputSet.contains(input.getInputIdentifier()}}) are met at the same
time, what you suggest makes sense.
> ShuffleManager fails with IllegalStateException
> -----------------------------------------------
>
> Key: TEZ-1087
> URL: https://issues.apache.org/jira/browse/TEZ-1087
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Cheolsoo Park
> Attachments: TEZ-1087-1.patch, am.log.tar.gz
>
>
> While running a Pig-on-Tez job, I ran into this error-
> {code}
> at java.util.ArrayList$Itr.remove(ArrayList.java:844)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.constructFetcherForHost(ShuffleManager.java:314)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.access$1200(ShuffleManager.java:80)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager$RunShuffleCallable.call(ShuffleManager.java:260)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager$RunShuffleCallable.call(ShuffleManager.java:213)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
