[GitHub] [hadoop] steveloughran commented on a change in pull request #2732: HADOOP-17531. DistCp: Reduce memory usage on copying huge directories.

steveloughran commented on a change in pull request #2732: URL: https://github.com/apache/hadoop/pull/2732#discussion_r594463078 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/test/GenericTestUtils.java ## @@ -53,8 +53,10 @@ import org.apach

[GitHub] [hadoop] steveloughran commented on a change in pull request #2732: HADOOP-17531. DistCp: Reduce memory usage on copying huge directories.

steveloughran commented on a change in pull request #2732: URL: https://github.com/apache/hadoop/pull/2732#discussion_r591753745 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/test/GenericTestUtils.java ## @@ -64,12 +71,22 @@ import org.ap

[GitHub] [hadoop] steveloughran commented on a change in pull request #2732: HADOOP-17531. DistCp: Reduce memory usage on copying huge directories.

steveloughran commented on a change in pull request #2732: URL: https://github.com/apache/hadoop/pull/2732#discussion_r590624549 ## File path: hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/SimpleCopyListing.java ## @@ -730,4 +660,155 @@ private void writeToF