[GitHub] [hadoop] hadoop-yetus commented on pull request #3613: HDFS-16296. RouterRpcFairnessPolicyController add rejected permits for each nameservice

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3613: URL: https://github.com/apache/hadoop/pull/3613#issuecomment-958690121 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] ferhui commented on pull request #3613: HDFS-16296. RouterRpcFairnessPolicyController add rejected permits for each nameservice

2021-11-02 Thread GitBox
ferhui commented on pull request #3613: URL: https://github.com/apache/hadoop/pull/3613#issuecomment-958680152 @symious Thanks for contribution, it looks good. Let's wait for the CI reports. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [hadoop] ferhui commented on a change in pull request #3602: HDFS-16291.Make the comment of INode#ReclaimContext more standardized.

2021-11-02 Thread GitBox
ferhui commented on a change in pull request #3602: URL: https://github.com/apache/hadoop/pull/3602#discussion_r741639733 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INode.java ## @@ -993,15 +993,13 @@ public long getNsDel

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674389&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674389 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya commented on pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#issuecomment-958664918 Hmm, for the test, I built `hadoop-lzo` `0.4.21-SNAPSHOT` locally with native-lzo library for Mac OS. Switched to `0.4.20` for CI to see if it works. -- This is an automated mes

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=674385&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674385 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub B

[GitHub] [hadoop] sidseth commented on pull request #3597: HADOOP-17981 Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread GitBox
sidseth commented on pull request #3597: URL: https://github.com/apache/hadoop/pull/3597#issuecomment-958658416 > > This mechanism becomes very FileSystem specific. Implemented by Azure right now. > > I agree, which is why the API is restricted for its uses to mr-client-core only. a

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674381&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674381 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#issuecomment-958653673 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] symious commented on pull request #3613: HDFS-16296. RouterRpcFairnessPolicyController add rejected permits for each nameservice

2021-11-02 Thread GitBox
symious commented on pull request #3613: URL: https://github.com/apache/hadoop/pull/3613#issuecomment-958652432 @goiri @ferhui Could you help to check? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] symious opened a new pull request #3613: HDFS-16296. RouterRpcFairnessPolicyController add rejected permits for each nameservice

2021-11-02 Thread GitBox
symious opened a new pull request #3613: URL: https://github.com/apache/hadoop/pull/3613 ### Description of PR Currently RouterRpcFairnessPolicyController has a metric of "getProxyOpPermitRejected" to show the total rejected invokes due to lack of permits. This ticket

[GitHub] [hadoop] tomscut commented on pull request #3538: HDFS-16266. Add remote port information to HDFS audit log

2021-11-02 Thread GitBox
tomscut commented on pull request #3538: URL: https://github.com/apache/hadoop/pull/3538#issuecomment-958648376 Hi @tasanuma @jojochuang @aajisaka , could you please help merge this PR. And I will open a new JIRA based on it. Thanks a lot. -- This is an automated message from the Apache

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674342&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674342 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya commented on pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#issuecomment-958610739 Comparing with #2159, this adds `LzoCompressor` and `LzoDecompressor` (WIP) supports. I don't put this bridging classes with same name to `com.hadoop.compression.lzo.LzoCodec` etc

[GitHub] [hadoop] cndaimin commented on pull request #3593: HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file

2021-11-02 Thread GitBox
cndaimin commented on pull request #3593: URL: https://github.com/apache/hadoop/pull/3593#issuecomment-958610440 @sodonnel Thanks for your review. Update: Removed the unused import and added a test on verifying file with 2 block groups. -- This is an automated message from the Apac

[GitHub] [hadoop] cndaimin commented on a change in pull request #3593: HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file

2021-11-02 Thread GitBox
cndaimin commented on a change in pull request #3593: URL: https://github.com/apache/hadoop/pull/3593#discussion_r741582271 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java ## @@ -166,8 +179,91 @@ public void testComp

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674334&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674334 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674333&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674333 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674335&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674335 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya commented on a change in pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#discussion_r741581518 ## File path: hadoop-project/pom.xml ## @@ -2457,5 +2463,9 @@ + + twitter + https://maven.twttr.com/ + Review comment: W

[GitHub] [hadoop] hadoop-yetus commented on pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#issuecomment-958607089 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] viirya commented on a change in pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya commented on a change in pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#discussion_r741581381 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/LzoCodec2.java ## @@ -0,0 +1,186 @@ +/* + * Licensed to the A

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674331&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674331 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674330&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674330 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya commented on a change in pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#discussion_r741581302 ## File path: hadoop-common-project/hadoop-common/pom.xml ## @@ -375,6 +375,17 @@ lz4-java provided + + io.airlift + airco

[GitHub] [hadoop] viirya commented on pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya commented on pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#issuecomment-958606819 `LzoCompressor` is ready for review. I will work on `LzoDecompressor` next. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674328&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674328 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya commented on pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#issuecomment-958606536 cc @sunchao @dbtsai -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=674327&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674327 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya opened a new pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-02 Thread GitBox
viirya opened a new pull request #3612: URL: https://github.com/apache/hadoop/pull/3612 ### Description of PR This patch adds LZO Codec which includes `LzoCompressor` and `LzoDecompressor`. See https://issues.apache.org/jira/browse/HADOOP-17124 for details. ###

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=674322&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674322 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub B

[GitHub] [hadoop] symious commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-02 Thread GitBox
symious commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-958605853 @fapifta Thanks for the explanation. Is the current situation as follows? Correct me if I'm wrong. Server S has two clients, client A of non-secure settings with "

[jira] [Commented] (HADOOP-17933) Document of "DistCp Guide" is wrong

2021-11-02 Thread Jiahongchao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437688#comment-17437688 ] Jiahongchao commented on HADOOP-17933: -- I'm not sure what this command will actual

[jira] [Updated] (HADOOP-17933) Document of "DistCp Guide" is wrong

2021-11-02 Thread Jiahongchao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiahongchao updated HADOOP-17933: - Description: In [https://hadoop.apache.org/docs/stable/hadoop-distcp/DistCp.html] ,it says {quo

[jira] [Updated] (HADOOP-17933) Document of "DistCp Guide" is wrong

2021-11-02 Thread Jiahongchao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiahongchao updated HADOOP-17933: - Description: In [https://hadoop.apache.org/docs/stable/hadoop-distcp/DistCp.html] [,|https://h

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=674299&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674299 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-958583977 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=674261&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674261 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub B

[GitHub] [hadoop] fapifta edited a comment on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-02 Thread GitBox
fapifta edited a comment on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-958358986 @symious actually the connection is not two different connection, but the same connection to the same DataNode (it is a socket connection from the client node to the datan

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=674260&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674260 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub B

[GitHub] [hadoop] fapifta edited a comment on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-02 Thread GitBox
fapifta edited a comment on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-958358986 @symious actually the connection is not two different connection, but the same connection to the same DataNode (it is a socket connection from the client node to the datan

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=674259&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674259 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=674258&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674258 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub B

[GitHub] [hadoop] fapifta edited a comment on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-02 Thread GitBox
fapifta edited a comment on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-958358986 @symious actually the connection is not two different connection, but the same connection to the same DataNode (it is a socket connection from the client node to the datan

[GitHub] [hadoop] fapifta edited a comment on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-02 Thread GitBox
fapifta edited a comment on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-958358986 @symious actually the connection is not two different connection, but the same connection to the same DataNode (it is a socket connection from the client node to the datan

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=674256&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674256 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub B

[GitHub] [hadoop] fapifta commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-02 Thread GitBox
fapifta commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-958364897 @sodonnel thank you for the review (and sorry for the delay, I was off last week), also I have an idea on how to add a test for this case to demonstrate the problem better, I am

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=674254&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674254 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub B

[GitHub] [hadoop] fapifta commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-02 Thread GitBox
fapifta commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-958358986 @symious actually the connection is not two different connection, but the same connection to the same DataNode. The problem is with what we send via the connection. In a secure e

[GitHub] [hadoop] aihuaxu commented on pull request #3595: HDFS-16283: RBF: improve renewLease() to call only a specific NameNod…

2021-11-02 Thread GitBox
aihuaxu commented on pull request #3595: URL: https://github.com/apache/hadoop/pull/3595#issuecomment-958268688 Please take a look at the simple design doc I posted in the jira and let me know your thoughts. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-17987) Disable JIRA plugin for YETUS on Hadoop

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17987?focusedWorklogId=674202&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674202 ] ASF GitHub Bot logged work on HADOOP-17987: --- Author: ASF GitHub B

[GitHub] [hadoop] ferhui commented on pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode and dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigu

2021-11-02 Thread GitBox
ferhui commented on pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#issuecomment-957338822 @haiyang1987 Thanks for contribution, some comments: we can change the title here and jira, If dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled is not reconfigura

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=674172&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674172 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-11-02 Thread GitBox
hadoop-yetus removed a comment on pull request #3585: URL: https://github.com/apache/hadoop/pull/3585#issuecomment-951328176 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=674160&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674160 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3606: YARN-10997. Revisit allocation and reservation logging

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3606: URL: https://github.com/apache/hadoop/pull/3606#issuecomment-957358485 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] tomscut commented on pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode and dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfig

2021-11-02 Thread GitBox
tomscut commented on pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#issuecomment-957437161 > @ferhui @tomscut I submitted some code. Can you help review. thank you very much. Thanks for reminding me. -- This is an automated message from the Apache Git Service

[GitHub] [hadoop] jianghuazhu commented on pull request #3605: HDFS-16294.Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED.

2021-11-02 Thread GitBox
jianghuazhu commented on pull request #3605: URL: https://github.com/apache/hadoop/pull/3605#issuecomment-957661245 It seems that Jenkins did not execute successfully, It seems that these have little to do with the code I submitted. @tasanuma @prasad-acit @tomscut, you are willing to spe

[GitHub] [hadoop] hadoop-yetus commented on pull request #3603: [YARN-10998] Add YARN_ROUTER_HEAPSIZE to yarn-env for routers

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3603: URL: https://github.com/apache/hadoop/pull/3603#issuecomment-957273131 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3597: HADOOP-17981 Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3597: URL: https://github.com/apache/hadoop/pull/3597#issuecomment-956975430 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [hadoop] aajisaka commented on pull request #3538: HDFS-16266. Add remote port information to HDFS audit log

2021-11-02 Thread GitBox
aajisaka commented on pull request #3538: URL: https://github.com/apache/hadoop/pull/3538#issuecomment-957445801 > I will make some changes in the other JIRA if necessary, because this might involve the callContext from Router. What do you think of this? Thank you. Agreed. Let's disc

[jira] [Work logged] (HADOOP-17988) Disable JIRA plugin for YETUS on Hadoop

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17988?focusedWorklogId=674144&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674144 ] ASF GitHub Bot logged work on HADOOP-17988: --- Author: ASF GitHub B

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3550: YARN-10907. Minimize usages of AbstractCSQueue#csContext

2021-11-02 Thread GitBox
9uapaw commented on a change in pull request #3550: URL: https://github.com/apache/hadoop/pull/3550#discussion_r740835594 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/mon

[GitHub] [hadoop] hadoop-yetus commented on pull request #3610: HADOOP-17988. Disable JIRA plugin for YETUS on Hadoop

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3610: URL: https://github.com/apache/hadoop/pull/3610#issuecomment-958088845 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17986) Disable JIRA plugin for YETUS on Hadoop

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17986?focusedWorklogId=674121&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674121 ] ASF GitHub Bot logged work on HADOOP-17986: --- Author: ASF GitHub B

[GitHub] [hadoop] sodonnel merged pull request #3598: HDFS-16259. Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger)

2021-11-02 Thread GitBox
sodonnel merged pull request #3598: URL: https://github.com/apache/hadoop/pull/3598 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-

[GitHub] [hadoop] haiyang1987 commented on pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode and dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reco

2021-11-02 Thread GitBox
haiyang1987 commented on pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#issuecomment-957160686 @ferhui @tomscut I submitted some code. Can you help review. thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=674109&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674109 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3585: URL: https://github.com/apache/hadoop/pull/3585#issuecomment-957567201 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] tomscut commented on a change in pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode and dfs.namenode.block-placement-policy.exclude-slow-nodes.enab

2021-11-02 Thread GitBox
tomscut commented on a change in pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#discussion_r741006484 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java ## @@ -511,7 +505,16 @@ pri

[GitHub] [hadoop] cndaimin commented on a change in pull request #3593: HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file

2021-11-02 Thread GitBox
cndaimin commented on a change in pull request #3593: URL: https://github.com/apache/hadoop/pull/3593#discussion_r740842196 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DebugAdmin.java ## @@ -387,6 +414,211 @@ int run(List args) thro

[jira] [Work logged] (HADOOP-17713) Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17713?focusedWorklogId=674081&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674081 ] ASF GitHub Bot logged work on HADOOP-17713: --- Author: ASF GitHub B

[GitHub] [hadoop] adoroszlai commented on pull request #3577: HADOOP-17713. Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-02 Thread GitBox
adoroszlai commented on pull request #3577: URL: https://github.com/apache/hadoop/pull/3577#issuecomment-957348441 > Now CDN (https://dlcdn.apache.org/hadoop/common/hadoop-3.3.1/hadoop-3.3.1.tar.gz) can be used for downloading Hadoop binary tarball. Would you update the URL? Thanks

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=674076&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674076 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17988) Disable JIRA plugin for YETUS on Hadoop

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17988?focusedWorklogId=674078&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674078 ] ASF GitHub Bot logged work on HADOOP-17988: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran merged pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-11-02 Thread GitBox
steveloughran merged pull request #3585: URL: https://github.com/apache/hadoop/pull/3585 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-is

[GitHub] [hadoop] aajisaka commented on pull request #3553: HDFS-16273. RBF: RouterRpcFairnessPolicyController add availableHandl…

2021-11-02 Thread GitBox
aajisaka commented on pull request #3553: URL: https://github.com/apache/hadoop/pull/3553#issuecomment-957333859 Hi @tasanuma would you check this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=674055&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674055 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3593: HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3593: URL: https://github.com/apache/hadoop/pull/3593#issuecomment-957941102 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] tomscut commented on pull request #3538: HDFS-16266. Add remote port information to HDFS audit log

2021-11-02 Thread GitBox
tomscut commented on pull request #3538: URL: https://github.com/apache/hadoop/pull/3538#issuecomment-957045765 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

[GitHub] [hadoop] steveloughran commented on pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-11-02 Thread GitBox
steveloughran commented on pull request #3585: URL: https://github.com/apache/hadoop/pull/3585#issuecomment-957274478 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [hadoop] sodonnel commented on a change in pull request #3593: HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file

2021-11-02 Thread GitBox
sodonnel commented on a change in pull request #3593: URL: https://github.com/apache/hadoop/pull/3593#discussion_r741306774 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDebugAdmin.java ## @@ -166,8 +179,91 @@ public void testComp

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=674039&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674039 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub B

[GitHub] [hadoop] cndaimin commented on pull request #3593: HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file

2021-11-02 Thread GitBox
cndaimin commented on pull request #3593: URL: https://github.com/apache/hadoop/pull/3593#issuecomment-957273204 @sodonnel Thanks for your review. Update: I have fixed the review comments and added some test in `TestDebugAdmin#testVerifyECCommand`. -- This is an automated message fro

[GitHub] [hadoop] hadoop-yetus commented on pull request #3605: HDFS-16294.Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED.

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3605: URL: https://github.com/apache/hadoop/pull/3605#issuecomment-957588812 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] steveloughran commented on pull request #3597: HADOOP-17981 Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread GitBox
steveloughran commented on pull request #3597: URL: https://github.com/apache/hadoop/pull/3597#issuecomment-957310383 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[jira] [Work logged] (HADOOP-17986) Disable JIRA plugin for YETUS on Hadoop

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17986?focusedWorklogId=674033&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674033 ] ASF GitHub Bot logged work on HADOOP-17986: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3608: HADOOP-17986. Disable JIRA plugin for YETUS on Hadoop

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3608: URL: https://github.com/apache/hadoop/pull/3608#issuecomment-958064967 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=674020&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674020 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub B

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #3597: HADOOP-17981 Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread GitBox
mukund-thakur commented on a change in pull request #3597: URL: https://github.com/apache/hadoop/pull/3597#discussion_r740782689 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/ResilientCommitByRename.java ## @@ -0,0 +1,209 @@ +/* + *

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=674006&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-674006 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17713) Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17713?focusedWorklogId=673971&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-673971 ] ASF GitHub Bot logged work on HADOOP-17713: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka commented on a change in pull request #3577: HADOOP-17713. Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-02 Thread GitBox
aajisaka commented on a change in pull request #3577: URL: https://github.com/apache/hadoop/pull/3577#discussion_r740970427 ## File path: build.sh ## @@ -18,7 +18,7 @@ DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )" set -e mkdir -p build if [ ! -d "$DIR/build/apache-

[jira] [Work logged] (HADOOP-17713) Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17713?focusedWorklogId=673950&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-673950 ] ASF GitHub Bot logged work on HADOOP-17713: --- Author: ASF GitHub B

[GitHub] [hadoop] adoroszlai commented on a change in pull request #3577: HADOOP-17713. Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-02 Thread GitBox
adoroszlai commented on a change in pull request #3577: URL: https://github.com/apache/hadoop/pull/3577#discussion_r740990384 ## File path: build.sh ## @@ -18,7 +18,7 @@ DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )" set -e mkdir -p build if [ ! -d "$DIR/build/apach

[GitHub] [hadoop] hadoop-yetus commented on pull request #3604: YARN-10996. Fix race condition of User object acquisitions

2021-11-02 Thread GitBox
hadoop-yetus commented on pull request #3604: URL: https://github.com/apache/hadoop/pull/3604#issuecomment-957346603 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [hadoop] jianghuazhu commented on pull request #3602: HDFS-16291.Make the comment of INode#ReclaimContext more standardized.

2021-11-02 Thread GitBox
jianghuazhu commented on pull request #3602: URL: https://github.com/apache/hadoop/pull/3602#issuecomment-957340418 Hi @jojochuang @ferhui @Hexiaoqiao, are you willing to spend some time to help review this pr. Thank you very much. -- This is an automated message from the Apache Git S

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=673911&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-673911 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-11-02 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-954108334 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] sidseth commented on a change in pull request #3597: HADOOP-17981 Support etag-assisted renames in FileOutputCommitter

2021-11-02 Thread GitBox
sidseth commented on a change in pull request #3597: URL: https://github.com/apache/hadoop/pull/3597#discussion_r740720279 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitt

  1   2   3   >