[GitHub] [hadoop] virajjasani commented on a change in pull request #3936: YARN-11068. Exclude transitive log4j2 dependency coming from solr 8.

virajjasani commented on a change in pull request #3936: URL: https://github.com/apache/hadoop/pull/3936#discussion_r792375120 ## File path: LICENSE-binary ## @@ -321,6 +321,9 @@ org.apache.kerby:kerby-pkix:1.0.1 org.apache.kerby:kerby-util:1.0.1 org.apache.kerby:kerby-xdr:1.

[GitHub] [hadoop] tomscut commented on pull request #3912: HDFS-16435. Remove no need TODO comment for ObserverReadProxyProvider

tomscut commented on pull request #3912: URL: https://github.com/apache/hadoop/pull/3912#issuecomment-1021932343 Hi @sunchao , could you please take a look. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] (HADOOP-18090) Exclude com/jcraft/jsch classes from being shaded/relocated

[ https://issues.apache.org/jira/browse/HADOOP-18090 ] mkv deleted comment on HADOOP-18090: -- was (Author: manojkumarvohra9): [~busbey] created this issue. Can you please verify if this can be taken as a bug? > Exclude com/jcraft/jsch classes from bei

[GitHub] [hadoop] jojochuang commented on pull request #3928: HDFS-16438. Avoid holding read locks for a long time when scanDatanodeStorage

jojochuang commented on pull request #3928: URL: https://github.com/apache/hadoop/pull/3928#issuecomment-1021917153 Sorry. My bad. Posted to the wrong PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] jojochuang removed a comment on pull request #3928: HDFS-16438. Avoid holding read locks for a long time when scanDatanodeStorage

jojochuang removed a comment on pull request #3928: URL: https://github.com/apache/hadoop/pull/3928#issuecomment-1021860865 Next: fix the transitive dependency of the hbase2 profile; update reload4j to 1.2.18.3 (latest) -- This is an automated message from the Apache Git Service. To resp

[GitHub] [hadoop] jojochuang opened a new pull request #3936: YARN-11068. Exclude transitive log4j2 dependency coming from solr 8.

jojochuang opened a new pull request #3936: URL: https://github.com/apache/hadoop/pull/3936 ### Description of PR Exclude transitive log4j2 dependency coming from solr 8 ### How was this patch tested? manually verified the output of 'mvn dependency:tree' ### F

[GitHub] [hadoop] tomscut commented on pull request #3928: HDFS-16438. Avoid holding read locks for a long time when scanDatanodeStorage

tomscut commented on pull request #3928: URL: https://github.com/apache/hadoop/pull/3928#issuecomment-1021863918 > Next: fix the transitive dependency of the hbase2 profile; update reload4j to 1.2.18.3 (latest) Hi @jojochuang , I want to confirm whether this comment is related to thi

[GitHub] [hadoop] jojochuang commented on pull request #3928: HDFS-16438. Avoid holding read locks for a long time when scanDatanodeStorage

jojochuang commented on pull request #3928: URL: https://github.com/apache/hadoop/pull/3928#issuecomment-1021860865 Next: fix the transitive dependency of the hbase2 profile; update reload4j to 1.2.18.3 (latest) -- This is an automated message from the Apache Git Service. To respond to t

[jira] [Updated] (HADOOP-18088) Replace log4j 1.x with reload4j

[ https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18088: - Target Version/s: 3.2.3, 3.3.3 Set tentative target release of 3.3.3 /3.2.3. [~chaosun

[jira] [Work logged] (HADOOP-18087) fix bug when getting CNAME chain records and no record from remote dns server

[ https://issues.apache.org/jira/browse/HADOOP-18087?focusedWorklogId=715446&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715446 ] ASF GitHub Bot logged work on HADOOP-18087: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3935: HADOOP-18087. fix bug when getting CNAME chain records and no record from remote dns server

hadoop-yetus commented on pull request #3935: URL: https://github.com/apache/hadoop/pull/3935#issuecomment-1021849158 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] jojochuang commented on pull request #3924: HDFS-16423. Balancer should not get blocks on stale storages (#3883)

jojochuang commented on pull request #3924: URL: https://github.com/apache/hadoop/pull/3924#issuecomment-1021837205 Thanks @tasanuma ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hadoop] jojochuang merged pull request #3924: HDFS-16423. Balancer should not get blocks on stale storages (#3883)

jojochuang merged pull request #3924: URL: https://github.com/apache/hadoop/pull/3924 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issue

[jira] [Resolved] (HADOOP-18089) Test coverage for Async profiler servlets

[ https://issues.apache.org/jira/browse/HADOOP-18089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18089. -- Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~vjasani] for the patch and [~a

[jira] [Work logged] (HADOOP-18089) Test coverage for Async profiler servlets

[ https://issues.apache.org/jira/browse/HADOOP-18089?focusedWorklogId=715433&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715433 ] ASF GitHub Bot logged work on HADOOP-18089: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang merged pull request #3913: HADOOP-18089. Test coverage for Async profiler servlets

jojochuang merged pull request #3913: URL: https://github.com/apache/hadoop/pull/3913 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issue

[jira] [Work logged] (HADOOP-18087) fix bug when getting CNAME chain records and no record from remote dns server

[ https://issues.apache.org/jira/browse/HADOOP-18087?focusedWorklogId=715392&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715392 ] ASF GitHub Bot logged work on HADOOP-18087: --- Author: ASF GitHub B

[GitHub] [hadoop] eubnara commented on pull request #3911: HADOOP-18087. fix bug when getting CNAME chain records and no record from remote dns server

eubnara commented on pull request #3911: URL: https://github.com/apache/hadoop/pull/3911#issuecomment-1021765464 I made new PR at https://github.com/apache/hadoop/pull/3935 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-18087) fix bug when getting CNAME chain records and no record from remote dns server

[ https://issues.apache.org/jira/browse/HADOOP-18087?focusedWorklogId=715390&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715390 ] ASF GitHub Bot logged work on HADOOP-18087: --- Author: ASF GitHub B

[GitHub] [hadoop] eubnara opened a new pull request #3935: HADOOP-18087. fix bug when getting CNAME chain records and no record from remote dns server

eubnara opened a new pull request #3935: URL: https://github.com/apache/hadoop/pull/3935 ### Description of PR When query A record which is chained by CNAME, YARN Registry DNS Server does not properly respond. Some CNAME records are missing. For example, "repo.mave

[GitHub] [hadoop] hadoop-yetus commented on pull request #3831: HDFS-16398. Reconfig block report parameters for datanode

hadoop-yetus commented on pull request #3831: URL: https://github.com/apache/hadoop/pull/3831#issuecomment-1021728219 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[GitHub] [hadoop] hadoop-yetus commented on pull request #3928: HDFS-16438. Avoid holding read locks for a long time when scanDatanodeStorage

hadoop-yetus commented on pull request #3928: URL: https://github.com/apache/hadoop/pull/3928#issuecomment-1021687826 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18091) S3A auditing leaks memory through ThreadLocal references

[ https://issues.apache.org/jira/browse/HADOOP-18091?focusedWorklogId=715354&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715354 ] ASF GitHub Bot logged work on HADOOP-18091: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3930: HADOOP-18091. S3A auditing leaks memory through ThreadLocal references

hadoop-yetus commented on pull request #3930: URL: https://github.com/apache/hadoop/pull/3930#issuecomment-1021685303 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715340&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715340 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3932: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

hadoop-yetus commented on pull request #3932: URL: https://github.com/apache/hadoop/pull/3932#issuecomment-1021654982 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3933: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

hadoop-yetus commented on pull request #3933: URL: https://github.com/apache/hadoop/pull/3933#issuecomment-1021649654 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715335&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715335 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715330&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715330 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3929: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

hadoop-yetus commented on pull request #3929: URL: https://github.com/apache/hadoop/pull/3929#issuecomment-1021641886 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715319&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715319 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3931: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

hadoop-yetus commented on pull request #3931: URL: https://github.com/apache/hadoop/pull/3931#issuecomment-1021625269 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715286&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715286 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin commented on pull request #3918: HADOOP-18093: Better exception handling for testFileStatusOnMountLink

xinglin commented on pull request #3918: URL: https://github.com/apache/hadoop/pull/3918#issuecomment-1021587828 @ayushtkn Can you approve and commit my other pull requests to get this change merged into lower supported versions? I should have mentioned targeted version in my jira issue.

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715277&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715277 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin opened a new pull request #3934: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

xinglin opened a new pull request #3934: URL: https://github.com/apache/hadoop/pull/3934 ### Description of PR Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java (#3918). ### How was this patch tested? mvn test -Dtest=TestViewFsLoca

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715276&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715276 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin opened a new pull request #3933: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

xinglin opened a new pull request #3933: URL: https://github.com/apache/hadoop/pull/3933 Signed-off-by: Ayush Saxena (cherry picked from commit 0d17b629ffee2f645f405ad46b0afa65224f87d5) ### Description of PR HADOOP-18093. Better exception handling for testFi

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715273&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715273 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin opened a new pull request #3932: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

xinglin opened a new pull request #3932: URL: https://github.com/apache/hadoop/pull/3932 Signed-off-by: Ayush Saxena (cherry picked from commit 0d17b629ffee2f645f405ad46b0afa65224f87d5) ### Description of PR Better exception handling for testFileStatusOnMoun

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715235&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715235 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin opened a new pull request #3931: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

xinglin opened a new pull request #3931: URL: https://github.com/apache/hadoop/pull/3931 Signed-off-by: Ayush Saxena (cherry picked from commit 0d17b629ffee2f645f405ad46b0afa65224f87d5) ### Description of PR ### How was this patch tested? mvn test

[GitHub] [hadoop] hadoop-yetus commented on pull request #3847: HDFS-16406. ReadsFromLocalClient counts short-circuit reads

hadoop-yetus commented on pull request #3847: URL: https://github.com/apache/hadoop/pull/3847#issuecomment-1021530438 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18091) S3A auditing leaks memory through ThreadLocal references

[ https://issues.apache.org/jira/browse/HADOOP-18091?focusedWorklogId=715227&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715227 ] ASF GitHub Bot logged work on HADOOP-18091: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3930: HADOOP-18091. S3A auditing leaks memory through ThreadLocal references

steveloughran commented on pull request #3930: URL: https://github.com/apache/hadoop/pull/3930#issuecomment-1021526012 note, does not yet update the docs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Work logged] (HADOOP-18091) S3A auditing leaks memory through ThreadLocal references

[ https://issues.apache.org/jira/browse/HADOOP-18091?focusedWorklogId=715226&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715226 ] ASF GitHub Bot logged work on HADOOP-18091: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran opened a new pull request #3930: HADOOP-18091. S3A auditing leaks memory through ThreadLocal references

steveloughran opened a new pull request #3930: URL: https://github.com/apache/hadoop/pull/3930 Adds a new map type WeakReferenceMap, which stores weak references to values, and a WeakReferenceThreadMap subclass to more closely resemble a thread local type, as it is a map of thread id t

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=715219&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715219 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin opened a new pull request #3929: HADOOP-18093. Better exception handling for testFileStatusOnMountLink…

xinglin opened a new pull request #3929: URL: https://github.com/apache/hadoop/pull/3929 Signed-off-by: Ayush Saxena (cherry picked from commit 0d17b629ffee2f645f405ad46b0afa65224f87d5) ### Description of PR ### How was this patch tested? mvn test -Dt

[jira] [Work logged] (HADOOP-15245) S3AInputStream.skip() to use lazy seek

[ https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=715215&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715215 ] ASF GitHub Bot logged work on HADOOP-15245: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3927: HADOOP-15245. S3AInputStream.skip() to use lazy seek

hadoop-yetus commented on pull request #3927: URL: https://github.com/apache/hadoop/pull/3927#issuecomment-1021518093 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3926: HDFS-16437 ReverseXML processor doesn't accept XML files without the …

hadoop-yetus commented on pull request #3926: URL: https://github.com/apache/hadoop/pull/3926#issuecomment-1021435550 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] goiri merged pull request #3766: YARN-11034. Add enhanced headroom in AllocateResponse

goiri merged pull request #3766: URL: https://github.com/apache/hadoop/pull/3766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-uns

[GitHub] [hadoop] minni31 commented on a change in pull request #3741: YARN-11026. Make default AppPlacementAllocator configurable in AppSch…

minni31 commented on a change in pull request #3741: URL: https://github.com/apache/hadoop/pull/3741#discussion_r791930672 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/sc

[GitHub] [hadoop] ferhui merged pull request #3838: HDFS-16401.Remove the worthless DatasetVolumeChecker#numAsyncDatasetChecks.

ferhui merged pull request #3838: URL: https://github.com/apache/hadoop/pull/3838 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-un

[GitHub] [hadoop] hadoop-yetus commented on pull request #3923: HDFS-16303. Fix edge case where DatanodeAdminDefaultMonitor doubly en…

hadoop-yetus commented on pull request #3923: URL: https://github.com/apache/hadoop/pull/3923#issuecomment-1020714294 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3741: YARN-11026. Make default AppPlacementAllocator configurable in AppSch…

hadoop-yetus commented on pull request #3741: URL: https://github.com/apache/hadoop/pull/3741#issuecomment-1021289626 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[GitHub] [hadoop] cndaimin commented on a change in pull request #3881: HDFS-16422. Fix thread safety of EC decoding during concurrent preads

cndaimin commented on a change in pull request #3881: URL: https://github.com/apache/hadoop/pull/3881#discussion_r791312508 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/StripeReader.java ## @@ -432,7 +432,9 @@ void decodeAndFillBuff

[GitHub] [hadoop] sodonnel merged pull request #3527: HDFS-16262 Async refresh of cached locations in DFSInputStream

sodonnel merged pull request #3527: URL: https://github.com/apache/hadoop/pull/3527 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-

[GitHub] [hadoop] tomscut commented on a change in pull request #3831: HDFS-16398. Reconfig block report parameters for datanode

tomscut commented on a change in pull request #3831: URL: https://github.com/apache/hadoop/pull/3831#discussion_r791853926 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DNConf.java ## @@ -311,6 +299,19 @@ public DNConf(final

[GitHub] [hadoop] fapifta commented on pull request #3842: HDFS-16403. Improve FUSE IO performance by supporting FUSE parameter max_background

fapifta commented on pull request #3842: URL: https://github.com/apache/hadoop/pull/3842#issuecomment-1020661356 Hi @cndaimin sorry for the long reply time, I could not get to this one last week, and still I was not able to review the linked study but I am pretty much convinced by the numb

[GitHub] [hadoop] jojochuang commented on a change in pull request #3881: HDFS-16422. Fix thread safety of EC decoding during concurrent preads

jojochuang commented on a change in pull request #3881: URL: https://github.com/apache/hadoop/pull/3881#discussion_r791286115 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/StripeReader.java ## @@ -432,7 +432,9 @@ void decodeAndFillBu

[GitHub] [hadoop] hadoop-yetus commented on pull request #3858: YARN-10918. Simplify method: CapacitySchedulerQueueManager#parseQueue

hadoop-yetus commented on pull request #3858: URL: https://github.com/apache/hadoop/pull/3858#issuecomment-1021063232 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] tasanuma commented on pull request #3831: HDFS-16398. Reconfig block report parameters for datanode

tasanuma commented on pull request #3831: URL: https://github.com/apache/hadoop/pull/3831#issuecomment-1020761891 @tomscut Thanks for the PR. It mostly looks good to me. - Could you fix the conflict? - `dfs.blockreport.initialDelay` is only used when initializing DataNode. Do we n

[jira] [Work logged] (HADOOP-15245) S3AInputStream.skip() to use lazy seek

[ https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=714984&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714984 ] ASF GitHub Bot logged work on HADOOP-15245: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3920: HDFS-16303. Improve handling of datanode lost while decommissioning

hadoop-yetus commented on pull request #3920: URL: https://github.com/apache/hadoop/pull/3920#issuecomment-1020622158 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18087) fix bug when getting CNAME chain records and no record from remote dns server

[ https://issues.apache.org/jira/browse/HADOOP-18087?focusedWorklogId=714957&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714957 ] ASF GitHub Bot logged work on HADOOP-18087: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3924: HDFS-16423. Balancer should not get blocks on stale storages (#3883)

hadoop-yetus commented on pull request #3924: URL: https://github.com/apache/hadoop/pull/3924#issuecomment-1020930685 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] steveloughran commented on pull request #3911: HADOOP-18087. fix bug when getting CNAME chain records and no record from remote dns server

steveloughran commented on pull request #3911: URL: https://github.com/apache/hadoop/pull/3911#issuecomment-1020397892 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [hadoop] ferhui commented on pull request #3838: HDFS-16401.Remove the worthless DatasetVolumeChecker#numAsyncDatasetChecks.

ferhui commented on pull request #3838: URL: https://github.com/apache/hadoop/pull/3838#issuecomment-1021202940 @jianghuazhu Thanks for your contribution. @ayushtkn Thanks for your review! Merged. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [hadoop] Hexiaoqiao merged pull request #3898: HDFS-16428. Source path with storagePolicy cause wrong typeConsumed while rename

Hexiaoqiao merged pull request #3898: URL: https://github.com/apache/hadoop/pull/3898 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issue

[GitHub] [hadoop] singer-bin closed pull request #3925: HDFS-16437 ReverseXML processor doesn't accept XML files without the SnapshotDiffSection

singer-bin closed pull request #3925: URL: https://github.com/apache/hadoop/pull/3925 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issue

[GitHub] [hadoop] jojochuang merged pull request #3842: HDFS-16403. Improve FUSE IO performance by supporting FUSE parameter max_background

jojochuang merged pull request #3842: URL: https://github.com/apache/hadoop/pull/3842 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issue

[GitHub] [hadoop] KevinWikant closed pull request #3922: Feature/hdfs 16303

KevinWikant closed pull request #3922: URL: https://github.com/apache/hadoop/pull/3922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issu

[GitHub] [hadoop] hadoop-yetus commented on pull request #3888: HDFS-16427. Add debug log for BlockManager#chooseExcessRedundancyStriped

hadoop-yetus commented on pull request #3888: URL: https://github.com/apache/hadoop/pull/3888#issuecomment-1020457945 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] jojochuang commented on pull request #3923: HDFS-16303. Fix edge case where DatanodeAdminDefaultMonitor doubly en…

jojochuang commented on pull request #3923: URL: https://github.com/apache/hadoop/pull/3923#issuecomment-1020721954 @KevinWikant while this is a small patch, please file a new jira to make issue tracking easier. Thank you -- This is an automated message from the Apache Git Service. To re

[GitHub] [hadoop] hadoop-yetus commented on pull request #3842: HDFS-16403. Improve FUSE IO performance by supporting FUSE parameter max_background

hadoop-yetus commented on pull request #3842: URL: https://github.com/apache/hadoop/pull/3842#issuecomment-1020903689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [hadoop] jojochuang edited a comment on pull request #3923: HDFS-16303. Fix edge case where DatanodeAdminDefaultMonitor doubly en…

jojochuang edited a comment on pull request #3923: URL: https://github.com/apache/hadoop/pull/3923#issuecomment-1020721954 @KevinWikant while this is a small patch, please file a new jira to make issue tracking easier. Thank you We'd like to keep one commit per issue. -- This is an au

[GitHub] [hadoop] cndaimin commented on pull request #3842: HDFS-16403. Improve FUSE IO performance by supporting FUSE parameter max_background

cndaimin commented on pull request #3842: URL: https://github.com/apache/hadoop/pull/3842#issuecomment-1020798721 The indentation difference seems to be gap between tab and space, I just fixed it. Thanks a lot. @jojochuang -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=714863&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714863 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] bbeaudreault commented on pull request #3527: HDFS-16262 Async refresh of cached locations in DFSInputStream

bbeaudreault commented on pull request #3527: URL: https://github.com/apache/hadoop/pull/3527#issuecomment-1021196335 Thank you @sodonnel! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hadoop] ayushtkn commented on pull request #3918: HADOOP-18093: Better exception handling for testFileStatusOnMountLink

ayushtkn commented on pull request #3918: URL: https://github.com/apache/hadoop/pull/3918#issuecomment-1020372992 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [hadoop] hadoop-yetus commented on pull request #3921: HDFS-16303. Improve handling of datanode lost while decommissioning

hadoop-yetus commented on pull request #3921: URL: https://github.com/apache/hadoop/pull/3921#issuecomment-1020691857 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=714792&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714792 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3881: HDFS-16422. Fix thread safety of EC decoding during concurrent preads

hadoop-yetus commented on pull request #3881: URL: https://github.com/apache/hadoop/pull/3881#issuecomment-1021256813 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18087) fix bug when getting CNAME chain records and no record from remote dns server

[ https://issues.apache.org/jira/browse/HADOOP-18087?focusedWorklogId=714781&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714781 ] ASF GitHub Bot logged work on HADOOP-18087: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin commented on pull request #3918: HADOOP-18093: Better exception handling for testFileStatusOnMountLink

xinglin commented on pull request #3918: URL: https://github.com/apache/hadoop/pull/3918#issuecomment-1020355511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

[GitHub] [hadoop] eubnara commented on pull request #3911: HADOOP-18087. fix bug when getting CNAME chain records and no record from remote dns server

eubnara commented on pull request #3911: URL: https://github.com/apache/hadoop/pull/3911#issuecomment-1020563876 @steveloughran Why close this issue? YARN Registry DNS is not maintained anymore? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] tasanuma commented on a change in pull request #3831: HDFS-16398. Reconfig block report parameters for datanode

tasanuma commented on a change in pull request #3831: URL: https://github.com/apache/hadoop/pull/3831#discussion_r791320927 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DNConf.java ## @@ -311,6 +299,19 @@ public DNConf(fina

[GitHub] [hadoop] liubingxing edited a comment on pull request #3907: HDFS-16432. Namenode block report add yield to avoid holding write lo…

liubingxing edited a comment on pull request #3907: URL: https://github.com/apache/hadoop/pull/3907#issuecomment-1019266612 @tasanuma @Hexiaoqiao Please take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Work logged] (HADOOP-18093) Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java

[ https://issues.apache.org/jira/browse/HADOOP-18093?focusedWorklogId=714726&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714726 ] ASF GitHub Bot logged work on HADOOP-18093: --- Author: ASF GitHub B

[GitHub] [hadoop] goiri commented on pull request #3878: HDFS-16411 RBF: RouterId is NULL when disable RourterRpcServer

goiri commented on pull request #3878: URL: https://github.com/apache/hadoop/pull/3878#issuecomment-1020620894 TestRouterDistCpProcedure seems to be failing consistently. @Hexiaoqiao @wojiaodoubao @ayushtkn @xiaoxiaopan118 can you take a look? -- This is an automated message from the A

[GitHub] [hadoop] ayushtkn merged pull request #3918: HADOOP-18093: Better exception handling for testFileStatusOnMountLink

ayushtkn merged pull request #3918: URL: https://github.com/apache/hadoop/pull/3918 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-

[GitHub] [hadoop] sodonnel commented on pull request #3527: HDFS-16262 Async refresh of cached locations in DFSInputStream

sodonnel commented on pull request #3527: URL: https://github.com/apache/hadoop/pull/3527#issuecomment-1021100619 @bbeaudreault The CI looks good - that test often fails, so I don't believe it is related to this. I gave the changes another check and I don't see any issues, plus you h

[GitHub] [hadoop] tomscut commented on pull request #3831: HDFS-16398. Reconfig block report parameters for datanode

tomscut commented on pull request #3831: URL: https://github.com/apache/hadoop/pull/3831#issuecomment-1021321783 > @tomscut Thanks for the PR. It mostly looks good to me. > > * Could you fix the conflict? > * `dfs.blockreport.initialDelay` is only used when initializing DataNode.

[GitHub] [hadoop] tomscut commented on pull request #3888: HDFS-16427. Add debug log for BlockManager#chooseExcessRedundancyStriped

tomscut commented on pull request #3888: URL: https://github.com/apache/hadoop/pull/3888#issuecomment-1021097425 Hi @tasanuma , could you please take a look again. Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-18087) fix bug when getting CNAME chain records and no record from remote dns server

[ https://issues.apache.org/jira/browse/HADOOP-18087?focusedWorklogId=714667&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714667 ] ASF GitHub Bot logged work on HADOOP-18087: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran closed pull request #3911: HADOOP-18087. fix bug when getting CNAME chain records and no record from remote dns server

steveloughran closed pull request #3911: URL: https://github.com/apache/hadoop/pull/3911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-is

[GitHub] [hadoop] hadoop-yetus commented on pull request #3922: Feature/hdfs 16303

hadoop-yetus commented on pull request #3922: URL: https://github.com/apache/hadoop/pull/3922#issuecomment-1020478081 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] tomscut commented on a change in pull request #3831: HDFS-16398. Reconfig block report parameters for datanode

tomscut commented on a change in pull request #3831: URL: https://github.com/apache/hadoop/pull/3831#discussion_r791853926 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DNConf.java ## @@ -311,6 +299,19 @@ public DNConf(final

  1   2   >