Benoit Perroud created HDFS-7873:
------------------------------------

             Summary: OIV webhdfs premature close channel issue
                 Key: HDFS-7873
                 URL: https://issues.apache.org/jira/browse/HDFS-7873
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: tools
    Affects Versions: 2.5.2, 2.6.0
            Reporter: Benoit Perroud
            Assignee: Benoit Perroud
            Priority: Minor


The new Offline Image Viewer (OIV) supports to load the FSImage and _emulate_ a 
webhdfs server to explore the image without touching the NN.

This webhdfs server is not working with folders holding a significant number of 
children (files or other folders):

{quote}
$  hadoop fs -ls webhdfs://127.0.0.1:5978/a/big/folder
15/03/03 04:28:19 WARN ssl.FileBasedKeyStoresFactory: The property 
'ssl.client.truststore.location' has not been set, no TrustStore will be loaded
15/03/03 04:28:21 WARN security.UserGroupInformation: 
PriviledgedActionException as:bperroud (auth:SIMPLE) cause:java.io.IOException: 
Response decoding failure: java.lang.IllegalStateException: Expected one of '"}'
ls: Response decoding failure: java.lang.IllegalStateException: Expected one of 
'"}'
{quote}

The error comes from an inappropriate usage of Netty. 
{{e.getFuture().addListener(ChannelFutureListener.CLOSE)}} is closing the 
channel too early because the future attached to the channel already sent the 
header so the I/O operation succeeded.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to