[GitHub] [hadoop] jianghuazhu commented on pull request #4048: HDFS-16494.Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks().

2022-03-04 Thread GitBox
jianghuazhu commented on pull request #4048: URL: https://github.com/apache/hadoop/pull/4048#issuecomment-1059709044 Here are some unit tests that are failing. E.g: org.apache.hadoop.hdfs.server.namenode.TestFileTruncate org.apache.hadoop.hdfs.server.mover.TestMover It looks

[GitHub] [hadoop] hadoop-yetus commented on pull request #4003: HDFS-16462. Make HDFS get tool cross platform

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4003: URL: https://github.com/apache/hadoop/pull/4003#issuecomment-1059696850 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=737019=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-737019 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xinglin commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
xinglin commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r820035459 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/TrashPolicyDefault.java ## @@ -191,8 +191,8 @@ public boolean

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=737016=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-737016 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xinglin commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
xinglin commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r820037169 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java ## @@ -1141,60 +1143,52 @@ public

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=737013=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-737013 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xinglin commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
xinglin commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r820035684 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/TrashPolicyDefault.java ## @@ -191,8 +191,8 @@ public boolean

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=737012=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-737012 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xinglin commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
xinglin commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r820035459 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/TrashPolicyDefault.java ## @@ -191,8 +191,8 @@ public boolean

[GitHub] [hadoop] GauthamBanasandra commented on pull request #4022: [Do not commit] Debug CI issues

2022-03-04 Thread GitBox
GauthamBanasandra commented on pull request #4022: URL: https://github.com/apache/hadoop/pull/4022#issuecomment-1059645285 This was only for debugging. Abandoning this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] GauthamBanasandra closed pull request #4022: [Do not commit] Debug CI issues

2022-03-04 Thread GitBox
GauthamBanasandra closed pull request #4022: URL: https://github.com/apache/hadoop/pull/4022 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] GauthamBanasandra closed pull request #4029: [Do not commit] Debug CI issues

2022-03-04 Thread GitBox
GauthamBanasandra closed pull request #4029: URL: https://github.com/apache/hadoop/pull/4029 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] GauthamBanasandra commented on pull request #4029: [Do not commit] Debug CI issues

2022-03-04 Thread GitBox
GauthamBanasandra commented on pull request #4029: URL: https://github.com/apache/hadoop/pull/4029#issuecomment-1059645244 This was only for debugging. Abandoning this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Resolved] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautham Banasandra resolved HADOOP-18151. - Fix Version/s: 3.4.0 Resolution: Fixed Merged PR

[jira] [Work logged] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?focusedWorklogId=736998=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736998 ] ASF GitHub Bot logged work on HADOOP-18151: --- Author: ASF GitHub Bot

[GitHub] [hadoop] GauthamBanasandra merged pull request #4047: HADOOP-18151. Switch the baseurl for Centos 8

2022-03-04 Thread GitBox
GauthamBanasandra merged pull request #4047: URL: https://github.com/apache/hadoop/pull/4047 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-1059640249 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #4010: HDFS-16476.Increase the number of metrics used to record PendingRecoveryBlocks.

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4010: URL: https://github.com/apache/hadoop/pull/4010#issuecomment-1059618600 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-18153) The CallerContext should not use ":" as the separator.

2022-03-04 Thread Owen O'Malley (Jira)
Owen O'Malley created HADOOP-18153: -- Summary: The CallerContext should not use ":" as the separator. Key: HADOOP-18153 URL: https://issues.apache.org/jira/browse/HADOOP-18153 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #4048: HDFS-16494.Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks().

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4048: URL: https://github.com/apache/hadoop/pull/4048#issuecomment-1059604940 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] omalley commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
omalley commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r819950355 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/Constants.java ## @@ -134,8 +134,10 @@

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=736933=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736933 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18149) The FSDownload verifyAndCopy method doesn't support S3

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18149?focusedWorklogId=736932=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736932 ] ASF GitHub Bot logged work on HADOOP-18149: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4042: HADOOP-18149 Allow S3 and other potential fs implementations to bypass verifyAndDownload IO Exception

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4042: URL: https://github.com/apache/hadoop/pull/4042#issuecomment-1059565318 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=736930=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736930 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[GitHub] [hadoop] omalley commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
omalley commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r819927130 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -1128,51 +1128,58 @@ public

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=736927=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736927 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xinglin commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
xinglin commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r819943782 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/Constants.java ## @@ -134,8 +134,10 @@

[GitHub] [hadoop] steveloughran commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-1059545705 just updated with changes from sseth's review * renamed StoreOperations to ManifestStoreOperations, set scope up. that makes for a change which touches many

[jira] [Work logged] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?focusedWorklogId=736900=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736900 ] ASF GitHub Bot logged work on HADOOP-18144: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ibuenros commented on a change in pull request #4034: HADOOP-18144. getTrashRoot/s in ViewFileSystem return a viewFS path

2022-03-04 Thread GitBox
ibuenros commented on a change in pull request #4034: URL: https://github.com/apache/hadoop/pull/4034#discussion_r819904428 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/TrashPolicyDefault.java ## @@ -191,8 +191,8 @@ public boolean

[jira] [Work logged] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?focusedWorklogId=736869=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736869 ] ASF GitHub Bot logged work on HADOOP-18151: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4047: HADOOP-18151. Switch the baseurl for Centos 8

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4047: URL: https://github.com/apache/hadoop/pull/4047#issuecomment-1059479588 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?focusedWorklogId=736823=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736823 ] ASF GitHub Bot logged work on HADOOP-18151: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?focusedWorklogId=736826=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736826 ] ASF GitHub Bot logged work on HADOOP-18151: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4047: HADOOP-18151. Switch the baseurl for Centos 8

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4047: URL: https://github.com/apache/hadoop/pull/4047#issuecomment-1059397881 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] hadoop-yetus commented on pull request #4047: HADOOP-18151. Switch the baseurl for Centos 8

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4047: URL: https://github.com/apache/hadoop/pull/4047#issuecomment-1059396091 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819749615 ## File path: hadoop-project/pom.xml ## @@ -383,6 +383,13 @@ ${hadoop.version} + Review comment: need to allow

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819747827 ## File path: hadoop-tools/hadoop-azure/pom.xml ## @@ -319,7 +371,7 @@ ${test.build.data}/${surefire.forkNumber}

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-1051075854 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819746192 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/commit/AbfsManifestStoreOperations.java ## @@ -0,0 +1,125 @@

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819745766 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -42,6 +42,10 @@ import

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819744266 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819743600 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819743248 ## File path:

[GitHub] [hadoop] ayushtkn commented on a change in pull request #4009: HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS

2022-03-04 Thread GitBox
ayushtkn commented on a change in pull request #4009: URL: https://github.com/apache/hadoop/pull/4009#discussion_r819740564 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/sps/StoragePolicySatisfyManager.java ## @@ -292,4

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819741347 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819741101 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819737407 ## File path:

[GitHub] [hadoop] ayushtkn commented on pull request #4028: HDFS-16481. Provide support to set Http and Rpc ports in MiniJournalCluster

2022-03-04 Thread GitBox
ayushtkn commented on pull request #4028: URL: https://github.com/apache/hadoop/pull/4028#issuecomment-1059331962 Thanx @tomscut & @virajjasani -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] ayushtkn merged pull request #4028: HDFS-16481. Provide support to set Http and Rpc ports in MiniJournalCluster

2022-03-04 Thread GitBox
ayushtkn merged pull request #4028: URL: https://github.com/apache/hadoop/pull/4028 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819731305 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819718169 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819694970 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819694675 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819692383 ## File path:

[GitHub] [hadoop] jianghuazhu commented on pull request #3862: HDFS-11107.TestStartup#testStorageBlockContentsStaleAfterNNRestart fails intermittently.

2022-03-04 Thread GitBox
jianghuazhu commented on pull request #3862: URL: https://github.com/apache/hadoop/pull/3862#issuecomment-1059284831 Thanks @ayushtkn for the pointers, I'll keep trying to fix this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819690283 ## File path:

[jira] [Work logged] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?focusedWorklogId=736745=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736745 ] ASF GitHub Bot logged work on HADOOP-18151: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819689337 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4047: HADOOP-18151. Switch the baseurl for Centos 8

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4047: URL: https://github.com/apache/hadoop/pull/4047#issuecomment-1059282941 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819688505 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819686614 ## File path:

[jira] [Work logged] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?focusedWorklogId=736730=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736730 ] ASF GitHub Bot logged work on HADOOP-18146: --- Author: ASF GitHub Bot

[GitHub] [hadoop] anmolanmol1234 edited a comment on pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header with append re…

2022-03-04 Thread GitBox
anmolanmol1234 edited a comment on pull request #4039: URL: https://github.com/apache/hadoop/pull/4039#issuecomment-1054251984 AGGREGATED TEST RESULT HNS-OAuth [INFO] Results: [INFO] [WARNING] Tests run: 106, Failures: 0, Errors: 0,

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819678664 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819673642 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819669730 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/statistics/impl/IOStatisticsBinding.java ## @@ -450,12 +451,37

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r819666225 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/RateLimiting.java ## @@ -0,0 +1,43 @@ +/* + * Licensed to

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=736717=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736717 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-04 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-1031992765 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] steveloughran closed pull request #3611: HADOOP-17981. resilient commit through etag validation

2022-03-04 Thread GitBox
steveloughran closed pull request #3611: URL: https://github.com/apache/hadoop/pull/3611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] bbeaudreault commented on pull request #3271: HDFS-16155: Allow configurable exponential backoff in DFSInputStream refetchLocations

2022-03-04 Thread GitBox
bbeaudreault commented on pull request #3271: URL: https://github.com/apache/hadoop/pull/3271#issuecomment-1059256787 Thanks for the approval @Hexiaoqiao. Is there a downside to jsut merging this? It's been open for over 6 months, so I doubt anyone else will be jumping in any time soon.

[jira] [Work logged] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?focusedWorklogId=736655=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736655 ] ASF GitHub Bot logged work on HADOOP-18151: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4047: HADOOP-18151. Switch the baseurl for Centos 8

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4047: URL: https://github.com/apache/hadoop/pull/4047#issuecomment-1059176000 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Work logged] (HADOOP-18151) Switch the baseurl for Centos 8

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18151?focusedWorklogId=736653=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736653 ] ASF GitHub Bot logged work on HADOOP-18151: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4047: HADOOP-18151. Switch the baseurl for Centos 8

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4047: URL: https://github.com/apache/hadoop/pull/4047#issuecomment-1059174876 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] virajjasani commented on pull request #4027: YARN-11081. TestYarnConfigurationFields consistently keeps failing

2022-03-04 Thread GitBox
virajjasani commented on pull request #4027: URL: https://github.com/apache/hadoop/pull/4027#issuecomment-1059105858 > We should not add any parameter to configurationPrefixToSkipCompare without some specific reason (e.g., deprecated parameter). I see, the configs that I saw were

[jira] [Commented] (HADOOP-18152) fail to upload logfile to s3 by flume using hadoop-tools

2022-03-04 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501286#comment-17501286 ] 王独醉 commented on HADOOP-18152: -- 2022-03-04 10:50:13,173 WARN

[jira] (HADOOP-18152) fail to upload logfile to s3 by flume using hadoop-tools

2022-03-04 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18152 ] 王独醉 deleted comment on HADOOP-18152: -- was (Author: 1051738725):

[jira] [Commented] (HADOOP-18152) fail to upload logfile to s3 by flume using hadoop-tools

2022-03-04 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501283#comment-17501283 ] 王独醉 commented on HADOOP-18152: --

[jira] [Created] (HADOOP-18152) fail to upload logfile to s3 by flume using hadoop-tools

2022-03-04 Thread Jira
王独醉 created HADOOP-18152: Summary: fail to upload logfile to s3 by flume using hadoop-tools Key: HADOOP-18152 URL: https://issues.apache.org/jira/browse/HADOOP-18152 Project: Hadoop Common Issue

[jira] [Work logged] (HADOOP-15245) S3AInputStream.skip() to use lazy seek

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=736578=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736578 ] ASF GitHub Bot logged work on HADOOP-15245: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ahmarsuhail commented on a change in pull request #3927: HADOOP-15245. S3AInputStream.skip() to use lazy seek

2022-03-04 Thread GitBox
ahmarsuhail commented on a change in pull request #3927: URL: https://github.com/apache/hadoop/pull/3927#discussion_r819469226 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/statistics/impl/EmptyS3AStatisticsContext.java ## @@ -317,6 +322,9 @@

[jira] [Work logged] (HADOOP-15980) Enable TLS in RPC client/server

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15980?focusedWorklogId=736577=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736577 ] ASF GitHub Bot logged work on HADOOP-15980: --- Author: ASF GitHub Bot

[GitHub] [hadoop] vnhive commented on pull request #3966: [WIP] HADOOP-15980 : Enable TLS in RPC client/server

2022-03-04 Thread GitBox
vnhive commented on pull request #3966: URL: https://github.com/apache/hadoop/pull/3966#issuecomment-1059053952 - @aajisaka @jojochuang - I have seen the following Unit Test Failure. I am presenting a quick analysis. There will be some delay in addressing them, since I have switched

[jira] [Work logged] (HADOOP-15980) Enable TLS in RPC client/server

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15980?focusedWorklogId=736576=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736576 ] ASF GitHub Bot logged work on HADOOP-15980: --- Author: ASF GitHub Bot

[GitHub] [hadoop] vnhive commented on pull request #3966: [WIP] HADOOP-15980 : Enable TLS in RPC client/server

2022-03-04 Thread GitBox
vnhive commented on pull request #3966: URL: https://github.com/apache/hadoop/pull/3966#issuecomment-1059050684 > Hi @vnhive - Thank you for the PR! > > There are some checkstyle issues to be fixed:

[GitHub] [hadoop] jianghuazhu opened a new pull request #4048: HDFS-16494.Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks().

2022-03-04 Thread GitBox
jianghuazhu opened a new pull request #4048: URL: https://github.com/apache/hadoop/pull/4048 ### Description of PR When using the default constructor to build the AvailableSpaceVolumeChoosingPolicy, initLocks() is used twice, which is actually unnecessary, the purpose of this pr is

[GitHub] [hadoop] tomscut commented on pull request #4009: HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS

2022-03-04 Thread GitBox
tomscut commented on pull request #4009: URL: https://github.com/apache/hadoop/pull/4009#issuecomment-1058998161 Unit tests failed because of OOM, regardless of changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-18112) Rename operation fails during multi object delete of size more than 1000.

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18112?focusedWorklogId=736545=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736545 ] ASF GitHub Bot logged work on HADOOP-18112: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #4045: HADOOP-18112: Rename operation fails during multi object delete of size more than 1000.

2022-03-04 Thread GitBox
mukund-thakur commented on pull request #4045: URL: https://github.com/apache/hadoop/pull/4045#issuecomment-1058993001 Why these many java doc errors in PR ? I haven't changed the MarkerTool. `[ERROR]

[GitHub] [hadoop] hadoop-yetus commented on pull request #4009: HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4009: URL: https://github.com/apache/hadoop/pull/4009#issuecomment-1058991178 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=736541=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736541 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3990: [HADOOP-13386] upgrade to avro 1.9.2

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #3990: URL: https://github.com/apache/hadoop/pull/3990#issuecomment-1058985987 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18112) Rename operation fails during multi object delete of size more than 1000.

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18112?focusedWorklogId=736540=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736540 ] ASF GitHub Bot logged work on HADOOP-18112: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #4045: HADOOP-18112: Rename operation fails during multi object delete of size more than 1000.

2022-03-04 Thread GitBox
mehakmeet commented on a change in pull request #4045: URL: https://github.com/apache/hadoop/pull/4045#discussion_r818663529 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DeleteOperation.java ## @@ -382,10 +381,8 @@ private void

[jira] [Work logged] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2022-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?focusedWorklogId=736537=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-736537 ] ASF GitHub Bot logged work on HADOOP-18146: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header with append re…

2022-03-04 Thread GitBox
hadoop-yetus commented on pull request #4039: URL: https://github.com/apache/hadoop/pull/4039#issuecomment-1058977915 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

  1   2   >