Daryn Sharp created HDFS-6214: --------------------------------- Summary: Webhdfs has poor throughput for files >2GB Key: HDFS-6214 URL: https://issues.apache.org/jira/browse/HDFS-6214 Project: Hadoop HDFS Issue Type: Bug Components: webhdfs Affects Versions: 2.0.0-alpha, 3.0.0 Reporter: Daryn Sharp Assignee: Daryn Sharp
For the DN's open call, jetty returns a Content-Length header for files <2GB, and uses chunking for files >2GB. A "bug" in jetty's buffer handling results in a ~8X reduction in throughput. -- This message was sent by Atlassian JIRA (v6.2#6252)