[ https://issues.apache.org/jira/browse/TEZ-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541429#comment-14541429 ]
Jeff Zhang edited comment on TEZ-494 at 5/13/15 6:22 AM: --------------------------------------------------------- It is due to the RPC request beyond the limit. {noformat} 2015-05-13 05:59:13,901 INFO Socket Reader #1 for port 32794 ipc.Server: Socket Reader #1 for port 32794: readAndProcess from client 10.51.5.41 threw exception [java.io.IOException: Requested data length 77710987 is longer than maximum configured RPC length 67108864. RPC came from 10.51.5.41] java.io.IOException: Requested data length 77710987 is longer than maximum configured RPC length 67108864. RPC came from 10.51.5.41 at org.apache.hadoop.ipc.Server$Connection.checkDataLength(Server.java:1433) at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1495) at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:752) at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:626) at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:597) {noformat} [~richard.huang] You can resolve this issue, by configure this property to increase the rpc max data length. {noformat} ipc.maximum.data.length {noformat} was (Author: zjffdu): It is due to the RPC request beyond the limit. {noformat} 2015-05-13 05:59:13,901 INFO Socket Reader #1 for port 32794 ipc.Server: Socket Reader #1 for port 32794: readAndProcess from client 10.51.5.41 threw exception [java.io.IOException: Requested data length 77710987 is longer than maximum configured RPC length 67108864. RPC came from 10.51.5.41] java.io.IOException: Requested data length 77710987 is longer than maximum configured RPC length 67108864. RPC came from 10.51.5.41 at org.apache.hadoop.ipc.Server$Connection.checkDataLength(Server.java:1433) at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1495) at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:752) at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:626) at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:597) {noformat} > Investigate: Exception while submitting a dag to a TezSession > ------------------------------------------------------------- > > Key: TEZ-494 > URL: https://issues.apache.org/jira/browse/TEZ-494 > Project: Apache Tez > Issue Type: Bug > Reporter: Siddharth Seth > Assignee: Rekha Joshi > > {code} > destination host is: "local":54446; > at org.apache.tez.client.TezSession.submitDAG(TezSession.java:139) > at > org.apache.tez.mapreduce.examples.TestBroadcast.main(TestBroadcast.java:155) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) > at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) > at > org.apache.tez.mapreduce.examples.ExampleDriver.main(ExampleDriver.java:78) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: com.google.protobuf.ServiceException: java.io.IOException: Failed > on local exception: java.io.EOFException; Host Details : local host is: > "local/10.11.2.219"; destination host is: "local":54446; > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:216) > at $Proxy12.submitDAG(Unknown Source) > at org.apache.tez.client.TezSession.submitDAG(TezSession.java:137) > ... 13 more > Caused by: java.io.IOException: Failed on local exception: > java.io.EOFException; Host Details : local host is: "local/10.11.2.219"; > destination host is: "local":54446; > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764) > at org.apache.hadoop.ipc.Client.call(Client.java:1408) > at org.apache.hadoop.ipc.Client.call(Client.java:1357) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) > ... 15 more > Caused by: java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:375) > at > org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1049) > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:944) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)