[jira] [Work logged] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

2022-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=743588&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-743588 ] ASF GitHub Bot logged work on HADOOP-18129: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4083: HADOOP-18129: Change URI to String in INodeLink to reduce memory footprint of ViewFileSystem

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4083: URL: https://github.com/apache/hadoop/pull/4083#issuecomment-1072044160 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #4082: HDFS-16507. Avoid purging edit log which is in progress

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4082: URL: https://github.com/apache/hadoop/pull/4082#issuecomment-1072003345 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

2022-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=743567&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-743567 ] ASF GitHub Bot logged work on HADOOP-18129: --- Author: ASF GitHub B

[GitHub] [hadoop] abhishekdas99 opened a new pull request #4083: HADOOP-18129: Change URI to String in INodeLink to reduce memory footprint of ViewFileSystem

2022-03-17 Thread GitBox
abhishekdas99 opened a new pull request #4083: URL: https://github.com/apache/hadoop/pull/4083 … Fixes #3996 (cherry picked from commit da9970dd697752b4d00fe4e4760ea9cbf019ff2e) ### Description of PR ### How was this patch tested? ### For co

[GitHub] [hadoop] tomscut commented on pull request #4058: HDFS-16499. [SPS]: Should not start indefinitely while another SPS process is running

2022-03-17 Thread GitBox
tomscut commented on pull request #4058: URL: https://github.com/apache/hadoop/pull/4058#issuecomment-1071901635 Thanks @umamaheswararao and @ferhui . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Resolved] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

2022-03-17 Thread Owen O'Malley (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-18129. Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed I committed this.

[jira] [Work logged] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

2022-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=743507&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-743507 ] ASF GitHub Bot logged work on HADOOP-18129: --- Author: ASF GitHub B

[GitHub] [hadoop] omalley closed pull request #3996: HADOOP-18129: Change URI to String in INodeLink to reduce memory footprint of ViewFileSystem

2022-03-17 Thread GitBox
omalley closed pull request #3996: URL: https://github.com/apache/hadoop/pull/3996 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-u

[GitHub] [hadoop] tomscut opened a new pull request #4082: HDFS-16507. Avoid purging edit log which is in progress

2022-03-17 Thread GitBox
tomscut opened a new pull request #4082: URL: https://github.com/apache/hadoop/pull/4082 JIRA: [HDFS-16507](https://issues.apache.org/jira/browse/HDFS-16507). Avoid purging edit log which is in progress. This is described in detail in JIRA. The stack: ``` java.lang.Threa

[GitHub] [hadoop] tomscut closed pull request #4079: HDFS-16507. Avoid purging edit log which is in progress

2022-03-17 Thread GitBox
tomscut closed pull request #4079: URL: https://github.com/apache/hadoop/pull/4079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-u

[GitHub] [hadoop] goiri commented on a change in pull request #4081: HDFS-13248: Namenode needs to use the actual client IP when going through RBF proxy.

2022-03-17 Thread GitBox
goiri commented on a change in pull request #4081: URL: https://github.com/apache/hadoop/pull/4081#discussion_r829554238 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java ## @@ -1899,7 +1907,29 @@ private

[GitHub] [hadoop] omalley opened a new pull request #4081: HDFS-13248: Namenode needs to use the actual client IP when going through RBF proxy.

2022-03-17 Thread GitBox
omalley opened a new pull request #4081: URL: https://github.com/apache/hadoop/pull/4081 The NN makes decisions based on the client machine that control the locality of data access. Currently that is done by finding the ip address using the rpc connection, however in the RBF configur

[jira] [Work logged] (HADOOP-12760) sun.misc.Cleaner has moved to a new location in OpenJDK 9

2022-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12760?focusedWorklogId=743436&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-743436 ] ASF GitHub Bot logged work on HADOOP-12760: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4080: HADOOP-12760. sun.misc.Cleaner has moved to a new location in OpenJDK…

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4080: URL: https://github.com/apache/hadoop/pull/4080#issuecomment-1071505605 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-12760) sun.misc.Cleaner has moved to a new location in OpenJDK 9

2022-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12760?focusedWorklogId=743394&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-743394 ] ASF GitHub Bot logged work on HADOOP-12760: --- Author: ASF GitHub B

[GitHub] [hadoop] mccormickt12 opened a new pull request #4080: HADOOP-12760. sun.misc.Cleaner has moved to a new location in OpenJDK…

2022-03-17 Thread GitBox
mccormickt12 opened a new pull request #4080: URL: https://github.com/apache/hadoop/pull/4080 … 9. Contributed by Akira Ajisaka. (cherry picked from commit 5d084d7eca32cfa647a78ff6ed3c378659f5b186) ### Description of PR ### How was this patch tested?

[GitHub] [hadoop] hadoop-yetus commented on pull request #4069: HDFS-16457.Make fs.getspaceused.classname reconfigurable

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4069: URL: https://github.com/apache/hadoop/pull/4069#issuecomment-1071181384 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #4078: HDFS-16510. Fix EC decommission when rack is not enough

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4078: URL: https://github.com/apache/hadoop/pull/4078#issuecomment-1071092163 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #4078: HDFS-16510. Fix EC decommission when rack is not enough

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4078: URL: https://github.com/apache/hadoop/pull/4078#issuecomment-1071052723 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] tomscut opened a new pull request #4079: HDFS-16507. Avoid purging edit log which is in progress

2022-03-17 Thread GitBox
tomscut opened a new pull request #4079: URL: https://github.com/apache/hadoop/pull/4079 JIRA: [HDFS-16507](https://issues.apache.org/jira/browse/HDFS-16507). Avoid purging edit log which is in progress. This is described in detail in JIRA. -- This is an automated message from the

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=743176&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-743176 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3990: [HADOOP-13386] upgrade to avro 1.9.2

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #3990: URL: https://github.com/apache/hadoop/pull/3990#issuecomment-1070974306 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #4068: HDFS-16504.add `dfs.namenode.get-blocks.check.operation` to enable or disable ch…

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4068: URL: https://github.com/apache/hadoop/pull/4068#issuecomment-1070973085 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Commented] (HADOOP-16613) s3a to set fake directory marker contentType to application/x-directory

2022-03-17 Thread Brais Couce (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508161#comment-17508161 ] Brais Couce commented on HADOOP-16613: -- Should I create a new ticket for this ques

[GitHub] [hadoop] Hexiaoqiao commented on pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2022-03-17 Thread GitBox
Hexiaoqiao commented on pull request #2918: URL: https://github.com/apache/hadoop/pull/2918#issuecomment-1070851373 Thanks @whbing for your updates. It almost look good to me. Please fix checkstyle issue also. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Resolved] (HADOOP-17976) abfs etag extraction inconsistent between LIST and HEAD calls

2022-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17976. - Fix Version/s: 3.3.3 Resolution: Fixed > abfs etag extraction inconsistent betwe

[jira] [Resolved] (HADOOP-16204) ABFS tests to include terasort

2022-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16204. - Fix Version/s: 3.3.3 Resolution: Fixed > ABFS tests to include terasort > --

[jira] [Resolved] (HADOOP-18163) hadoop-azure support for the Manifest Committer of MAPREDUCE-7341

2022-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18163. - Fix Version/s: 3.3.3 Resolution: Fixed > hadoop-azure support for the Manifest C

[jira] [Resolved] (HADOOP-18162) hadoop-common enhancements for the Manifest Committer of MAPREDUCE-7341

2022-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18162. - Fix Version/s: 3.3.3 Resolution: Fixed > hadoop-common enhancements for the Mani

[GitHub] [hadoop] steveloughran closed pull request #4075: MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS

2022-03-17 Thread GitBox
steveloughran closed pull request #4075: URL: https://github.com/apache/hadoop/pull/4075 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-is

[GitHub] [hadoop] steveloughran commented on pull request #4075: MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS

2022-03-17 Thread GitBox
steveloughran commented on pull request #4075: URL: https://github.com/apache/hadoop/pull/4075#issuecomment-1070831325 merged to 3.3 and trunk manually -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #2918: URL: https://github.com/apache/hadoop/pull/2918#issuecomment-1070805870 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :

[GitHub] [hadoop] hadoop-yetus commented on pull request #4077: HDFS-16509. Fix decommission UnsupportedOperationException

2022-03-17 Thread GitBox
hadoop-yetus commented on pull request #4077: URL: https://github.com/apache/hadoop/pull/4077#issuecomment-1070683680 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] Neilxzn commented on a change in pull request #4068: HDFS-16504.add `dfs.namenode.get-blocks.check.operation` to enable or disable ch…

2022-03-17 Thread GitBox
Neilxzn commented on a change in pull request #4068: URL: https://github.com/apache/hadoop/pull/4068#discussion_r828928528 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml ## @@ -4119,6 +4119,14 @@ Mover, and StoragePolicySatisfier. +

[GitHub] [hadoop] cndaimin opened a new pull request #4078: HDFS-16510. Fix EC decommission when rack is not enough

2022-03-17 Thread GitBox
cndaimin opened a new pull request #4078: URL: https://github.com/apache/hadoop/pull/4078 The decommission always fail when we start decommission multiple nodes on a cluster whose racks is not enough, a cluster with 6 racks to deploy RS-6-3, for example. We find that those decommiss

[GitHub] [hadoop] liubingxing commented on pull request #4062: HDFS-16501. Print the exception when reporting a bad block

2022-03-17 Thread GitBox
liubingxing commented on pull request #4062: URL: https://github.com/apache/hadoop/pull/4062#issuecomment-1070545032 @tasanuma Please take a look. Thanks you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] liubingxing commented on pull request #4032: HDFS-16484. [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2022-03-17 Thread GitBox
liubingxing commented on pull request #4032: URL: https://github.com/apache/hadoop/pull/4032#issuecomment-1070518847 Hi @umamaheswararao , could you please take a look at this? Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, pl