Daryn Sharp created HDFS-6214:
---------------------------------

             Summary: Webhdfs has poor throughput for files >2GB
                 Key: HDFS-6214
                 URL: https://issues.apache.org/jira/browse/HDFS-6214
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: webhdfs
    Affects Versions: 2.0.0-alpha, 3.0.0
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp


For the DN's open call, jetty returns a Content-Length header for files <2GB, 
and uses chunking for files >2GB.  A "bug" in jetty's buffer handling results 
in a ~8X reduction in throughput.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to