Re: Hadoop execution failure

2023-05-04 Thread Ayush Saxena
What is the bug here? Connection reset by peer, mostly n/w issue or the client aborted the connection.What were you executing? Is this intermittent? What is the state of the task that you ran? Is it happening for all operations or few?Mostly this ain’t a bug but some issue with your cluster-AyushSent from my iPhoneOn 05-May-2023, at 7:42 AM, 马福辰  wrote:I found a bug when executing the hadoop in namenode, the version is 3.3.2. The namenode throws the following trace:```2023-03-27 17:35:23,759 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 9000: readAndProcess from client 192.168.101.162:56078 threw exception [java.io.IOException: Connection reset by peer]java.io.IOException: Connection reset by peer        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)        at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)        at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)        at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)2023-03-27 17:35:24,271 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 9000: readAndProcess from client 192.168.101.162:56084 threw exception [java.io.IOException: Connection reset by peer]java.io.IOException: Connection reset by peer        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)        at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)        at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)        at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)```


Hadoop execution failure

2023-05-04 Thread 马福辰
I found a bug when executing the hadoop in namenode, the version is 3.3.2.
The namenode throws the following trace:
```
2023-03-27 17:35:23,759 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
for port 9000: readAndProcess from client 192.168.101.162:56078 threw
exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at
java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
at
java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
at
org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
2023-03-27 17:35:24,271 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
for port 9000: readAndProcess from client 192.168.101.162:56084 threw
exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at
java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
at
java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
at
org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
```