[GitHub] [hadoop] lamber-ken edited a comment on pull request #2751: HDFS-15882. Fix incorrectly initializing RandomAccessFile based on configuration options

2021-03-10 Thread GitBox 


lamber-ken edited a comment on pull request #2751:
URL: https://github.com/apache/hadoop/pull/2751#issuecomment-795527785


   > use `nnbench` or similar tools to check it. Thanks.
   
   Yeah, we use `nnbench` tool to test `create_write`.
   
   ```
   hadoop dfs -rm -r /tmp/nnbench
   hadoop jar 
hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.0-tests.jar 
nnbench \
   -Ddfs.checksum.type=NULL \
   -operation create_write -maps 200 -reduces 15 \
   -bytesToWrite 1 -numberOfFiles 5000 \
   -blockSize 1048576 -replicationFactorPerFile 3 \
   -readFileAfterOpen true -baseDir /tmp/nnbench 
   ```
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[GitHub] [hadoop] lamber-ken edited a comment on pull request #2751: HDFS-15882. Fix incorrectly initializing RandomAccessFile based on configuration options

2021-03-10 Thread GitBox 


lamber-ken edited a comment on pull request #2751:
URL: https://github.com/apache/hadoop/pull/2751#issuecomment-795398380


   After patching, the performance is nearly doubled.
   
   
![image](https://user-images.githubusercontent.com/20113411/110635696-585ec880-81e6-11eb-93aa-338985b20e75.png)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[GitHub] [hadoop] lamber-ken edited a comment on pull request #2751: HDFS-15882. Fix incorrectly initializing RandomAccessFile based on configuration options

2021-03-07 Thread GitBox 


lamber-ken edited a comment on pull request #2751:
URL: https://github.com/apache/hadoop/pull/2751#issuecomment-792305475


   I think the test failures are not related to the patch, and the failed tests 
succeeded on my local computer.
   
   
![image](https://user-images.githubusercontent.com/20113411/110247557-ca959a00-7fa7-11eb-9443-578c0596589e.png)
   
   
![image](https://user-images.githubusercontent.com/20113411/110246922-95d41380-7fa4-11eb-91f0-fd70c07a3f50.png)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org