[
https://issues.apache.org/jira/browse/TEZ-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated TEZ-1087:
-------------------------------
Attachment: am.log.tar.gz
Attaching the AM log that contains the stack trace.
I think the failure was originally triggered by my own Pig storage. Then, it
led ShuffleManager to failing with IllegalStateException.
I am working on fixing my Pig storage, but I think we should also get this
patch committed to Tez. Thanks!
> ShuffleManager fails with IllegalStateException
> -----------------------------------------------
>
> Key: TEZ-1087
> URL: https://issues.apache.org/jira/browse/TEZ-1087
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Cheolsoo Park
> Attachments: TEZ-1087-1.patch, am.log.tar.gz
>
>
> While running a Pig-on-Tez job, I ran into this error-
> {code}
> at java.util.ArrayList$Itr.remove(ArrayList.java:844)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.constructFetcherForHost(ShuffleManager.java:314)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.access$1200(ShuffleManager.java:80)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager$RunShuffleCallable.call(ShuffleManager.java:260)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager$RunShuffleCallable.call(ShuffleManager.java:213)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
