[GitHub] [hadoop] hadoop-yetus commented on pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#issuecomment-1078703073 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Updated] (HADOOP-18173) AWS S3 copyFromLocalOperation doesn't support single file

2022-03-24 Thread qian (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qian updated HADOOP-18173: -- Description: Spark job uses aws s3 as fileSystem and calls  {code:java} fs.copyFromLocalFile(delSrc, overwrit

[GitHub] [hadoop] jojochuang commented on pull request #4104: HDFS-16520. Improve EC pread: avoid potential reading whole block

2022-03-24 Thread GitBox
jojochuang commented on pull request #4104: URL: https://github.com/apache/hadoop/pull/4104#issuecomment-1078594592 This looks like a great improvement. @sodonnel , @umamaheswararao , @ferhui @tasanuma you guys may be interested -- This is an automated message from the Apache Git Servic

[GitHub] [hadoop] tomscut commented on a change in pull request #4082: HDFS-16507. [SBN read] Avoid purging edit log which is in progress

2022-03-24 Thread GitBox
tomscut commented on a change in pull request #4082: URL: https://github.com/apache/hadoop/pull/4082#discussion_r834896270 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java ## @@ -1509,13 +1509,18 @@ synchronized

[GitHub] [hadoop] tomscut commented on a change in pull request #4082: HDFS-16507. [SBN read] Avoid purging edit log which is in progress

2022-03-24 Thread GitBox
tomscut commented on a change in pull request #4082: URL: https://github.com/apache/hadoop/pull/4082#discussion_r834896270 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java ## @@ -1509,13 +1509,18 @@ synchronized

[jira] [Commented] (HADOOP-18173) AWS S3 copyFromLocalOperation doesn't support single file

2022-03-24 Thread qian (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512156#comment-17512156 ] qian commented on HADOOP-18173: --- [~bogthe] Hi. Could u help me about this case? > AWS S3

[jira] [Updated] (HADOOP-18173) AWS S3 copyFromLocalOperation doesn't support single file

2022-03-24 Thread qian (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qian updated HADOOP-18173: -- Description: Spark job uses aws s3 as fileSystem and calls  {code:java} fs.copyFromLocalFile(delSrc, overwrit

[jira] [Created] (HADOOP-18173) AWS S3 copyFromLocalOperation doesn't support single file

2022-03-24 Thread qian (Jira)
qian created HADOOP-18173: - Summary: AWS S3 copyFromLocalOperation doesn't support single file Key: HADOOP-18173 URL: https://issues.apache.org/jira/browse/HADOOP-18173 Project: Hadoop Common Issue T

[GitHub] [hadoop] tomscut commented on a change in pull request #4082: HDFS-16507. [SBN read] Avoid purging edit log which is in progress

2022-03-24 Thread GitBox
tomscut commented on a change in pull request #4082: URL: https://github.com/apache/hadoop/pull/4082#discussion_r834896270 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java ## @@ -1509,13 +1509,18 @@ synchronized

[GitHub] [hadoop] tomscut commented on a change in pull request #4082: HDFS-16507. [SBN read] Avoid purging edit log which is in progress

2022-03-24 Thread GitBox
tomscut commented on a change in pull request #4082: URL: https://github.com/apache/hadoop/pull/4082#discussion_r834896270 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java ## @@ -1509,13 +1509,18 @@ synchronized

[GitHub] [hadoop] tomscut commented on a change in pull request #4082: HDFS-16507. [SBN read] Avoid purging edit log which is in progress

2022-03-24 Thread GitBox
tomscut commented on a change in pull request #4082: URL: https://github.com/apache/hadoop/pull/4082#discussion_r834896270 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java ## @@ -1509,13 +1509,18 @@ synchronized

[GitHub] [hadoop] hadoop-yetus commented on pull request #4106: Changed scope for isRootInternalDir/getRootFallbackLink for InodeTree

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4106: URL: https://github.com/apache/hadoop/pull/4106#issuecomment-1078573267 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] tomscut commented on pull request #4001: HDFS-16460. [SPS]: Handle failure retries for moving tasks

2022-03-24 Thread GitBox
tomscut commented on pull request #4001: URL: https://github.com/apache/hadoop/pull/4001#issuecomment-1078572001 Hi @umamaheswararao @tasanuma @Hexiaoqiao , could you please take a look? Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [hadoop] tomscut edited a comment on pull request #4001: HDFS-16460. [SPS]: Handle failure retries for moving tasks

2022-03-24 Thread GitBox
tomscut edited a comment on pull request #4001: URL: https://github.com/apache/hadoop/pull/4001#issuecomment-1078572001 Hi @umamaheswararao @tasanuma @Hexiaoqiao @ferhui , could you please take a look? Thank you very much. -- This is an automated message from the Apache Git Service. To r

[GitHub] [hadoop] tomscut removed a comment on pull request #4001: HDFS-16460. [SPS]: Handle failure retries for moving tasks

2022-03-24 Thread GitBox
tomscut removed a comment on pull request #4001: URL: https://github.com/apache/hadoop/pull/4001#issuecomment-1048427499 Hi @jojochuang @tasanuma @Hexiaoqiao @ferhui , PTAL. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [hadoop] tomscut commented on a change in pull request #4057: HDFS-16498. Fix NPE for checkBlockReportLease

2022-03-24 Thread GitBox
tomscut commented on a change in pull request #4057: URL: https://github.com/apache/hadoop/pull/4057#discussion_r834874623 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -2751,6 +2751,13 @@ publ

[GitHub] [hadoop] tomscut commented on pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-24 Thread GitBox
tomscut commented on pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#issuecomment-1078553976 > #4064 added a new `namesystem.writeUnlock()`. Could you add the opname too? The others look good to me. Thank you very much. -- This is an automated message from the

[GitHub] [hadoop] tomscut commented on a change in pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-24 Thread GitBox
tomscut commented on a change in pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#discussion_r834869705 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java ## @@ -158,7 +1

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=747489&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747489 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub B

[GitHub] [hadoop] simbadzina commented on a change in pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-03-24 Thread GitBox
simbadzina commented on a change in pull request #4092: URL: https://github.com/apache/hadoop/pull/4092#discussion_r834774762 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/AbstractDelegationTokenSecretManager.java #

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=747451&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747451 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub B

[GitHub] [hadoop] omalley commented on a change in pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-03-24 Thread GitBox
omalley commented on a change in pull request #4092: URL: https://github.com/apache/hadoop/pull/4092#discussion_r834722208 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/AbstractDelegationTokenSecretManager.java ## @

[GitHub] [hadoop] omalley commented on pull request #4100: HDFS-16518: Close cached KeyProvider when DFSClient is closed

2022-03-24 Thread GitBox
omalley commented on pull request #4100: URL: https://github.com/apache/hadoop/pull/4100#issuecomment-1078244353 I commented on the jira, but: I don't understand why this is required. Obviously at jvm shutdown the cache will be discarded. The order of shutdown hooks isn't determinist

[jira] [Updated] (HADOOP-18172) Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package

2022-03-24 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HADOOP-18172: -- Description: Sometimes, we need to access rootFallBackLink from another package. We should make them

[jira] [Assigned] (HADOOP-18172) Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package

2022-03-24 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin reassigned HADOOP-18172: - Assignee: Xing Lin > Change scope of getRootFallbackLink for InodeTree to make them accessible

[jira] [Created] (HADOOP-18172) Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package

2022-03-24 Thread Xing Lin (Jira)
Xing Lin created HADOOP-18172: - Summary: Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package Key: HADOOP-18172 URL: https://issues.apache.org/jira/browse/HADOOP-18172

[GitHub] [hadoop] hadoop-yetus commented on pull request #4105: YARN-11088. Introduce the config to control the AM allocated to non-e…

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4105: URL: https://github.com/apache/hadoop/pull/4105#issuecomment-1077969608 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Resolved] (HADOOP-18171) NameNode Access Time Precision

2022-03-24 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-18171. Resolution: Invalid Setting the value of 0 disables access times for HDFS. You should ask

[GitHub] [hadoop] hadoop-yetus commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1077857491 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] tasanuma commented on pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-24 Thread GitBox
tasanuma commented on pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#issuecomment-1077804296 #4064 added a new `namesystem.writeUnlock()`. Could you add the opname too? The others look good to me. -- This is an automated message from the Apache Git Service. To respon

[GitHub] [hadoop] tasanuma commented on a change in pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-24 Thread GitBox
tasanuma commented on a change in pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#discussion_r834081133 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java ## @@ -158,7 +

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #4057: HDFS-16498. Fix NPE for checkBlockReportLease

2022-03-24 Thread GitBox
Hexiaoqiao commented on a change in pull request #4057: URL: https://github.com/apache/hadoop/pull/4057#discussion_r834482510 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -2751,6 +2751,13 @@ p

[jira] [Work logged] (HADOOP-15245) S3AInputStream.skip() to use lazy seek

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=747304&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747304 ] ASF GitHub Bot logged work on HADOOP-15245: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3927: HADOOP-15245. S3AInputStream.skip() to use lazy seek

2022-03-24 Thread GitBox
hadoop-yetus removed a comment on pull request #3927: URL: https://github.com/apache/hadoop/pull/3927#issuecomment-1069321823 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] hadoop-yetus commented on pull request #3960: HDFS-16446. Consider ioutils of disk when choosing volume

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #3960: URL: https://github.com/apache/hadoop/pull/3960#issuecomment-1077761539 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] zuston commented on pull request #4060: YARN-11084. Introduce new config to specify AM default node-label whe…

2022-03-24 Thread GitBox
zuston commented on pull request #4060: URL: https://github.com/apache/hadoop/pull/4060#issuecomment-1077727264 Thanks for your patience and review @9uapaw -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [hadoop] zuston opened a new pull request #4105: YARN-11088. Introduce the config to control the AM allocated to non-e…

2022-03-24 Thread GitBox
zuston opened a new pull request #4105: URL: https://github.com/apache/hadoop/pull/4105 …xclusive nodes ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA is

[jira] [Updated] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-24 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-13386: --- Assignee: PJ Fanning Status: Patch Available (was: Reopened) > Upgrade Avro to 1.8.x

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=747228&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747228 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka edited a comment on pull request #3990: [HADOOP-13386] upgrade to avro 1.9.2

2022-03-24 Thread GitBox
aajisaka edited a comment on pull request #3990: URL: https://github.com/apache/hadoop/pull/3990#issuecomment-1077631722 Hi @pjfanning - I'm not asking you to fix the issue, please ignore the errors by adding some entries in https://github.com/apache/hadoop/blob/1b29c9bfeee0035dd042357038b

[jira] [Comment Edited] (HADOOP-18142) Increase precommit job timeout from 24 hr to 30 hr

2022-03-24 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503046#comment-17503046 ] Viraj Jasani edited comment on HADOOP-18142 at 3/24/22, 1:30 PM:

[jira] [Updated] (HADOOP-18142) Increase precommit job timeout from 24 hr to 30 hr

2022-03-24 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18142: -- Target Version/s: 3.4.0 Status: Patch Available (was: In Progress) > Increase

[jira] [Work started] (HADOOP-18142) Increase precommit job timeout from 24 hr to 30 hr

2022-03-24 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-18142 started by Viraj Jasani. - > Increase precommit job timeout from 24 hr to 30 hr > -

[GitHub] [hadoop] tomscut removed a comment on pull request #4009: HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS

2022-03-24 Thread GitBox
tomscut removed a comment on pull request #4009: URL: https://github.com/apache/hadoop/pull/4009#issuecomment-1073427612 Hi @ayushtkn @Hexiaoqiao @ferhui , could you please take a look. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=747177&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747177 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka edited a comment on pull request #3990: [HADOOP-13386] upgrade to avro 1.9.2

2022-03-24 Thread GitBox
aajisaka edited a comment on pull request #3990: URL: https://github.com/apache/hadoop/pull/3990#issuecomment-1077570607 Hi @pjfanning - Would you ignore the findbugs error? > A known null value is checked to see if it is an instance of org.apache.avro.util.Utf8 in org.apache.hado

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=747176&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747176 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka commented on pull request #3990: [HADOOP-13386] upgrade to avro 1.9.2

2022-03-24 Thread GitBox
aajisaka commented on pull request #3990: URL: https://github.com/apache/hadoop/pull/3990#issuecomment-1077570607 Hi @pjfanning - Would you ignore the findbugs error? > A known null value is checked to see if it is an instance of org.apache.avro.util.Utf8 in org.apache.hadoop.mapr

[jira] [Created] (HADOOP-18171) NameNode Access Time Precision

2022-03-24 Thread Doug (Jira)
Doug created HADOOP-18171: - Summary: NameNode Access Time Precision Key: HADOOP-18171 URL: https://issues.apache.org/jira/browse/HADOOP-18171 Project: Hadoop Common Issue Type: Improvement E

[GitHub] [hadoop] hadoop-yetus commented on pull request #4104: HDFS-16520. Improve EC pread: avoid potential reading whole block

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4104: URL: https://github.com/apache/hadoop/pull/4104#issuecomment-1077561251 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] cndaimin commented on pull request #4077: HDFS-16509. Fix decommission UnsupportedOperationException

2022-03-24 Thread GitBox
cndaimin commented on pull request #4077: URL: https://github.com/apache/hadoop/pull/4077#issuecomment-1077544022 @tomscut Thanks for your review and advice! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=747136&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747136 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#issuecomment-1077529427 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=747069&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747069 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub B

[GitHub] [hadoop] brahmareddybattula commented on pull request #3990: [HADOOP-13386] upgrade to avro 1.9.2

2022-03-24 Thread GitBox
brahmareddybattula commented on pull request #3990: URL: https://github.com/apache/hadoop/pull/3990#issuecomment-1077442958 @aajisaka do you've cycles to review this... Patch lgtm. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[jira] [Assigned] (HADOOP-15245) S3AInputStream.skip() to use lazy seek

2022-03-24 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones reassigned HADOOP-15245: -- Assignee: Ahmar Suhail > S3AInputStream.skip() to use lazy seek > --

[jira] [Assigned] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

2022-03-24 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones reassigned HADOOP-12020: -- Assignee: Monthon Klongklaew > Support AWS S3 reduced redundancy storage cla

[jira] [Assigned] (HADOOP-16155) S3AInputStream read(bytes[]) to not retry on read failure: pass action up

2022-03-24 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones reassigned HADOOP-16155: -- Assignee: Ahmar Suhail > S3AInputStream read(bytes[]) to not retry on read f

[GitHub] [hadoop] singer-bin commented on pull request #4069: HDFS-16457.Make fs.getspaceused.classname reconfigurable

2022-03-24 Thread GitBox
singer-bin commented on pull request #4069: URL: https://github.com/apache/hadoop/pull/4069#issuecomment-1077421729 Can you review my code, thanks a lot. @sunchao @tasanuma @ayushtkn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-14661) S3A to support Requester Pays Buckets

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14661?focusedWorklogId=747031&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747031 ] ASF GitHub Bot logged work on HADOOP-14661: --- Author: ASF GitHub B

[GitHub] [hadoop] dannycjones commented on pull request #3962: HADOOP-14661. Add S3 requester pays bucket support to S3A

2022-03-24 Thread GitBox
dannycjones commented on pull request #3962: URL: https://github.com/apache/hadoop/pull/3962#issuecomment-1077391264 Thanks Steve, Mukund, and Monthon for the reviews! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [hadoop] liubingxing commented on pull request #4088: HDFS-16514. Reduce the failover sleep time if multiple namenode are c…

2022-03-24 Thread GitBox
liubingxing commented on pull request #4088: URL: https://github.com/apache/hadoop/pull/4088#issuecomment-1077376875 @tasanuma Please take a look at this. Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hadoop] hadoop-yetus commented on pull request #4104: HDFS-16520. Improve EC pread: avoid potential reading whole block

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4104: URL: https://github.com/apache/hadoop/pull/4104#issuecomment-1077373154 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] aajisaka merged pull request #4103: YARN-10720. (branch-2.10) YARN WebAppProxyServlet should support connection timeout…

2022-03-24 Thread GitBox
aajisaka merged pull request #4103: URL: https://github.com/apache/hadoop/pull/4103 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-

[GitHub] [hadoop] aajisaka merged pull request #4102: YARN-10720. (branch-3.2) YARN WebAppProxyServlet should support connection timeout…

2022-03-24 Thread GitBox
aajisaka merged pull request #4102: URL: https://github.com/apache/hadoop/pull/4102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-

[GitHub] [hadoop] hadoop-yetus commented on pull request #4102: YARN-10720. (branch-3.2) YARN WebAppProxyServlet should support connection timeout…

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4102: URL: https://github.com/apache/hadoop/pull/4102#issuecomment-1077367563 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[GitHub] [hadoop] hadoop-yetus commented on pull request #4103: YARN-10720. (branch-2.10) YARN WebAppProxyServlet should support connection timeout…

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4103: URL: https://github.com/apache/hadoop/pull/4103#issuecomment-1077364475 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[GitHub] [hadoop] hadoop-yetus commented on pull request #4032: HDFS-16484. [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2022-03-24 Thread GitBox
hadoop-yetus commented on pull request #4032: URL: https://github.com/apache/hadoop/pull/4032#issuecomment-1077343940 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=746997&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746997 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub B

[GitHub] [hadoop] zhongjingxiong commented on a change in pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-24 Thread GitBox
zhongjingxiong commented on a change in pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#discussion_r834016387 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileUtil.java ## @@ -706,35 +706,40 @@ public void testCre

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=746995&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746995 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub B

[GitHub] [hadoop] zhongjingxiong commented on a change in pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-24 Thread GitBox
zhongjingxiong commented on a change in pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#discussion_r834015838 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileUtil.java ## @@ -706,35 +706,40 @@ public void testCre

[GitHub] [hadoop] liubingxing commented on pull request #4032: HDFS-16484. [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2022-03-24 Thread GitBox
liubingxing commented on pull request #4032: URL: https://github.com/apache/hadoop/pull/4032#issuecomment-1077322620 Hi @tasanuma could you please take a look at this? Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=746981&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746981 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=746982&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746982 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub B

[GitHub] [hadoop] zhongjingxiong removed a comment on pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-24 Thread GitBox
zhongjingxiong removed a comment on pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#issuecomment-1077313260 > Yes, if I set the suid flag, the file will be executed with the same permissions as the owner of the executable file. I think it's dangerous. So, in the

[GitHub] [hadoop] zhongjingxiong edited a comment on pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-24 Thread GitBox
zhongjingxiong edited a comment on pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#issuecomment-1077313810 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=746980&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746980 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub B

[GitHub] [hadoop] zhongjingxiong commented on pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-24 Thread GitBox
zhongjingxiong commented on pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#issuecomment-1077313810 > Yes, if I set the suid flag, the file will be executed with the same permissions as the owner of the executable file. I think it's dangerous. So, in the code, any file

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=746979&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746979 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub B

[GitHub] [hadoop] zhongjingxiong commented on pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-24 Thread GitBox
zhongjingxiong commented on pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#issuecomment-1077313260 > Yes, if I set the suid flag, the file will be executed with the same permissions as the owner of the executable file. I think it's dangerous. So, in the code, a

[GitHub] [hadoop] cndaimin opened a new pull request #4104: HDFS-16520. Improve EC pread: avoid potential reading whole block

2022-03-24 Thread GitBox
cndaimin opened a new pull request #4104: URL: https://github.com/apache/hadoop/pull/4104 HDFS client 'pread' represents 'position read', this kind of read just need a range of data instead of reading the whole file/block. By using BlockReaderFactory#setLength, client tells datanode the bl

[GitHub] [hadoop] aajisaka opened a new pull request #4103: YARN-10720. YARN WebAppProxyServlet should support connection timeout…

2022-03-24 Thread GitBox
aajisaka opened a new pull request #4103: URL: https://github.com/apache/hadoop/pull/4103 … to prevent proxy server from hanging. Contributed by Qi Zhu. (cherry picked from commit a0deda1a777d8967fb8c08ac976543cda895773d) Conflicts: hadoop-yarn-project/hadoop-yarn/had