David Mollitor created HDFS-14872: ------------------------------------- Summary: Read HDFS Blocks in Random Order Key: HDFS-14872 URL: https://issues.apache.org/jira/browse/HDFS-14872 Project: Hadoop HDFS Issue Type: New Feature Components: hdfs-client Affects Versions: 3.2.1, 2.8.5 Reporter: David Mollitor
When the HDFS client is downloading (copying) an entire file, allow the client to download the blocks in random order. If a lot of clients are reading the same file, in parallel, they will all download the first block, the second block, and so on, stampeding down the line. It would be interesting to spread the load across across all the available DataNodes. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org