Benoit Perroud created HDFS-7873: ------------------------------------ Summary: OIV webhdfs premature close channel issue Key: HDFS-7873 URL: https://issues.apache.org/jira/browse/HDFS-7873 Project: Hadoop HDFS Issue Type: Bug Components: tools Affects Versions: 2.5.2, 2.6.0 Reporter: Benoit Perroud Assignee: Benoit Perroud Priority: Minor
The new Offline Image Viewer (OIV) supports to load the FSImage and _emulate_ a webhdfs server to explore the image without touching the NN. This webhdfs server is not working with folders holding a significant number of children (files or other folders): {quote} $ hadoop fs -ls webhdfs://127.0.0.1:5978/a/big/folder 15/03/03 04:28:19 WARN ssl.FileBasedKeyStoresFactory: The property 'ssl.client.truststore.location' has not been set, no TrustStore will be loaded 15/03/03 04:28:21 WARN security.UserGroupInformation: PriviledgedActionException as:bperroud (auth:SIMPLE) cause:java.io.IOException: Response decoding failure: java.lang.IllegalStateException: Expected one of '"}' ls: Response decoding failure: java.lang.IllegalStateException: Expected one of '"}' {quote} The error comes from an inappropriate usage of Netty. {{e.getFuture().addListener(ChannelFutureListener.CLOSE)}} is closing the channel too early because the future attached to the channel already sent the header so the I/O operation succeeded. -- This message was sent by Atlassian JIRA (v6.3.4#6332)