farmmamba created MAPREDUCE-7462:
------------------------------------

             Summary: Use thread pool to improve the speed of creating control 
files in TestDFSIO
                 Key: MAPREDUCE-7462
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7462
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: examples, test
    Affects Versions: 3.3.6
            Reporter: farmmamba


When we use TestDFSIO tool to test the throughouts of HDFS clusters, we found 
it is so slow in the creating controll files stage. 

After refering to the source code, we found that method createControlFile try 
to create control files serially. It can be improved by using thread pool.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org

Reply via email to