[ https://issues.apache.org/jira/browse/TEZ-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506193#comment-14506193 ]
Sergey Shelukhin commented on TEZ-2327: --------------------------------------- [~sseth] I hit this again... in q17, it happens for me every few runs (that's the one with 2x 1009 reducers) > NPE in shuffle > -------------- > > Key: TEZ-2327 > URL: https://issues.apache.org/jira/browse/TEZ-2327 > Project: Apache Tez > Issue Type: Bug > Reporter: Sergey Shelukhin > Assignee: Siddharth Seth > > {noformat} > 2015-04-15 15:19:46,529 INFO [Dispatcher thread: Central] > history.HistoryEventHandler: > [HISTORY][DAG:dag_1428572510173_0219_1][Event:TASK_ATTEMPT_FINISHED]: > vertexName=Reducer 2, taskAttemptId=attempt_1428572510173_0219_1_08_000872_0, > startTime=1429136298733, finishTime=1429136386528, timeTaken=87795, > status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while > running task:java.lang.NullPointerException > at sun.net.www.http.KeepAliveStream.close(KeepAliveStream.java:93) > at java.io.FilterInputStream.close(FilterInputStream.java:181) > at > sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.close(HttpURLConnection.java:3395) > at java.io.BufferedInputStream.close(BufferedInputStream.java:483) > at java.io.FilterInputStream.close(FilterInputStream.java:181) > at > org.apache.tez.runtime.library.common.shuffle.HttpConnection.cleanup(HttpConnection.java:278) > at > org.apache.tez.runtime.library.common.shuffle.Fetcher.shutdownInternal(Fetcher.java:644) > at > org.apache.tez.runtime.library.common.shuffle.Fetcher.shutdownInternal(Fetcher.java:634) > at > org.apache.tez.runtime.library.common.shuffle.Fetcher.shutdown(Fetcher.java:629) > at > org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager.shutdown(ShuffleManager.java:759) > at > org.apache.tez.runtime.library.input.UnorderedKVInput.close(UnorderedKVInput.java:209) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.close(LogicalIOProcessorRuntimeTask.java:347) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:182) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {noformat} > This caused the task in question to fail -- This message was sent by Atlassian JIRA (v6.3.4#6332)