[jira] [Commented] (HADOOP-17621) hadoop-auth to remove jetty-server dependency

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315981#comment-17315981 ] Wei-Chiu Chuang commented on HADOOP-17621: -- Resolve for now but we should get it backported to

[jira] [Updated] (HADOOP-17621) hadoop-auth to remove jetty-server dependency

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17621: - Fix Version/s: 3.3.1 > hadoop-auth to remove jetty-server dependency >

[jira] [Resolved] (HADOOP-17621) hadoop-auth to remove jetty-server dependency

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17621. -- Resolution: Fixed > hadoop-auth to remove jetty-server dependency >

[GitHub] [hadoop] aajisaka commented on pull request #2860: Test Pre-Commits.

2021-04-06 Thread GitBox
aajisaka commented on pull request #2860: URL: https://github.com/apache/hadoop/pull/2860#issuecomment-814614430 Maybe we need to increase the heap size in MAVEN_OPTS or/and surefire setting. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] tasanuma commented on a change in pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
tasanuma commented on a change in pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#discussion_r608346819 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDecommission.java ## @@ -1587,4 +1587,50 @@ public Boolean get()

[jira] [Updated] (HADOOP-17624) Remove any rocksdb exclusion code

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17624: - Fix Version/s: 3.3.1 > Remove any rocksdb exclusion code >

[jira] [Work logged] (HADOOP-17621) hadoop-auth to remove jetty-server dependency

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17621?focusedWorklogId=578120=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-578120 ] ASF GitHub Bot logged work on HADOOP-17621: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17621) hadoop-auth to remove jetty-server dependency

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17621: - Fix Version/s: 3.4.0 > hadoop-auth to remove jetty-server dependency >

[GitHub] [hadoop] jojochuang merged pull request #2865: HADOOP-17621. hadoop-auth to remove jetty-server dependency.

2021-04-06 Thread GitBox
jojochuang merged pull request #2865: URL: https://github.com/apache/hadoop/pull/2865 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Work logged] (HADOOP-17624) Remove any rocksdb exclusion code

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17624?focusedWorklogId=578119=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-578119 ] ASF GitHub Bot logged work on HADOOP-17624: --- Author: ASF GitHub Bot

[jira] [Resolved] (HADOOP-17624) Remove any rocksdb exclusion code

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17624. -- Fix Version/s: 3.4.0 Resolution: Fixed > Remove any rocksdb exclusion code >

[jira] [Work logged] (HADOOP-17624) Remove any rocksdb exclusion code

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17624?focusedWorklogId=578118=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-578118 ] ASF GitHub Bot logged work on HADOOP-17624: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #2867: HADOOP-17624. Remove any rocksdb exclusion code.

2021-04-06 Thread GitBox
jojochuang commented on pull request #2867: URL: https://github.com/apache/hadoop/pull/2867#issuecomment-814598438 Merged. Thanks both for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] jojochuang merged pull request #2867: HADOOP-17624. Remove any rocksdb exclusion code.

2021-04-06 Thread GitBox
jojochuang merged pull request #2867: URL: https://github.com/apache/hadoop/pull/2867 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Updated] (HADOOP-17613) Log not flushed fully when daemon shutdown

2021-04-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-17613: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Updated] (HADOOP-17613) Log not flushed fully when daemon shutdown

2021-04-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-17613: - Issue Type: Improvement (was: Bug) > Log not flushed fully when daemon shutdown >

[jira] [Updated] (HADOOP-17613) Log not flushed fully when daemon shutdown

2021-04-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-17613: - Summary: Log not flushed fully when daemon shutdown (was: Log not flushed fully when NN

[GitHub] [hadoop] jojochuang commented on a change in pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
jojochuang commented on a change in pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#discussion_r608323737 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDecommission.java ## @@ -1587,4 +1587,50 @@ public Boolean

[GitHub] [hadoop] jojochuang commented on a change in pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
jojochuang commented on a change in pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#discussion_r608322695 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -4584,8 +4584,16 @@

[GitHub] [hadoop] Hexiaoqiao closed pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
Hexiaoqiao closed pull request #2872: URL: https://github.com/apache/hadoop/pull/2872 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] Hexiaoqiao commented on pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
Hexiaoqiao commented on pull request #2872: URL: https://github.com/apache/hadoop/pull/2872#issuecomment-814580627 Thanks @kihwal for your comments. I totally agree with you after dig code and original design carefully. AND thanks @WeisonWei for your kindly report. -- This is an

[jira] [Resolved] (HADOOP-17623) Add a publish section to the .asf.yaml file

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17623. -- Resolution: Fixed > Add a publish section to the .asf.yaml file >

[GitHub] [hadoop] tasanuma commented on pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
tasanuma commented on pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#issuecomment-814556761 The failed tests succeeded locally. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] xiaoyuyao commented on pull request #2784: HDFS-15850. Superuser actions should be reported to external enforcers

2021-04-06 Thread GitBox
xiaoyuyao commented on pull request #2784: URL: https://github.com/apache/hadoop/pull/2784#issuecomment-814542380 Thanks @vivekratnavel for update. The latest change LGTM, +1 pending CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] hadoop-yetus commented on pull request #2784: HDFS-15850. Superuser actions should be reported to external enforcers

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2784: URL: https://github.com/apache/hadoop/pull/2784#issuecomment-814454728 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] kihwal commented on pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
kihwal commented on pull request #2872: URL: https://github.com/apache/hadoop/pull/2872#issuecomment-814448848 -1 This is intentional, not a bug. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#issuecomment-814442925 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2872: URL: https://github.com/apache/hadoop/pull/2872#issuecomment-814422495 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=577794=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577794 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sunchao commented on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-04-06 Thread GitBox
sunchao commented on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-814322161 @viirya yeah you're right. Personally I feel it should be fine as long as we have good documentation and error messages like mentioned above, but would like to hear inputs from

[GitHub] [hadoop] Nargeshdb commented on pull request #2809: HDFS-15914. Possible Resource Leak in org.apache.hadoop.hdfs.server.common.blockaliasmap.impl.TextFileRegionAliasMap

2021-04-06 Thread GitBox
Nargeshdb commented on pull request #2809: URL: https://github.com/apache/hadoop/pull/2809#issuecomment-814292521 I was wondering if I could get feedback on this pull request. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Comment Edited] (HADOOP-17588) CryptoInputStream#close() should be syncronized

2021-04-06 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315720#comment-17315720 ] Renukaprasad C edited comment on HADOOP-17588 at 4/6/21, 5:08 PM: --

[jira] [Commented] (HADOOP-17588) CryptoInputStream#close() should be syncronized

2021-04-06 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315720#comment-17315720 ] Renukaprasad C commented on HADOOP-17588: - Thanks [~hemanthboyina][~brahmareddy] for reviewing

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=577745=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577745 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-04-06 Thread GitBox
viirya commented on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-814280689 Hmm, seems we cannot do that. hadoop-compression depends on hadoop-common, so we cannot make hadoop-common depends on hadoop-compression. -- This is an automated message from

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=577743=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577743 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sunchao commented on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-04-06 Thread GitBox
sunchao commented on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-814278629 Another thing is as @iwasakims mentioned in the `common-dev` email thread, we may want to make this as a compile dependency of `hadoop-common` for now, since it is a breaking

[jira] [Work logged] (HADOOP-11245) Update NFS gateway to use Netty4

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11245?focusedWorklogId=577729=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577729 ] ASF GitHub Bot logged work on HADOOP-11245: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2832: HADOOP-11245. Update NFS gateway to use Netty4

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2832: URL: https://github.com/apache/hadoop/pull/2832#issuecomment-814259390 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#issuecomment-814257077 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri merged pull request #2792: HDFS-15909. Make fnmatch cross platform

2021-04-06 Thread GitBox
goiri merged pull request #2792: URL: https://github.com/apache/hadoop/pull/2792 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hadoop] hadoop-yetus commented on pull request #2792: HDFS-15909. Make fnmatch cross platform

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2792: URL: https://github.com/apache/hadoop/pull/2792#issuecomment-814251212 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
Hexiaoqiao commented on a change in pull request #2872: URL: https://github.com/apache/hadoop/pull/2872#discussion_r607915433 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogOp.java ## @@ -252,7 +252,7 @@ public void

[GitHub] [hadoop] WeisonWei commented on a change in pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
WeisonWei commented on a change in pull request #2872: URL: https://github.com/apache/hadoop/pull/2872#discussion_r607884856 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogOp.java ## @@ -252,7 +252,7 @@ public void

[GitHub] [hadoop] hadoop-yetus commented on pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#issuecomment-814135509 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
Hexiaoqiao commented on a change in pull request #2872: URL: https://github.com/apache/hadoop/pull/2872#discussion_r607862424 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogOp.java ## @@ -252,7 +252,7 @@ public void

[GitHub] [hadoop] tasanuma commented on pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
tasanuma commented on pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#issuecomment-814125642 @virajjasani Thanks for your confirmation. Reverted the last commit and added more comment. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-16118) S3Guard to support on-demand DDB tables

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16118?focusedWorklogId=577581=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577581 ] ASF GitHub Bot logged work on HADOOP-16118: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16118) S3Guard to support on-demand DDB tables

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16118?focusedWorklogId=577582=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577582 ] ASF GitHub Bot logged work on HADOOP-16118: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran closed pull request #731: HADOOP-16118. S3Guard to support on-demand DDB tables (branch-3.2).

2021-04-06 Thread GitBox
steveloughran closed pull request #731: URL: https://github.com/apache/hadoop/pull/731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] steveloughran commented on pull request #731: HADOOP-16118. S3Guard to support on-demand DDB tables (branch-3.2).

2021-04-06 Thread GitBox
steveloughran commented on pull request #731: URL: https://github.com/apache/hadoop/pull/731#issuecomment-814115266 abandoning; moot now you don't need s3guard no more -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (HADOOP-15603) S3A to support configuring various AWS S3 client extended options

2021-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15603: Parent Issue: HADOOP-17566 (was: HADOOP-16829) > S3A to support configuring various AWS

[jira] [Commented] (HADOOP-17613) Log not flushed fully when NN shutdown

2021-04-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315547#comment-17315547 ] Xiaoqiao He commented on HADOOP-17613: -- Thanks [~prasad-acit] for your works. +1 on

[jira] [Updated] (HADOOP-15555) S3AFileStatus to add a serialVersionUID; review & test serialization

2021-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-1: Parent Issue: HADOOP-17566 (was: HADOOP-16829) > S3AFileStatus to add a

[jira] [Updated] (HADOOP-13728) S3A can support short user-friendly aliases for configuration of credential providers.

2021-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13728: Parent Issue: HADOOP-17566 (was: HADOOP-16829) > S3A can support short user-friendly

[GitHub] [hadoop] virajjasani commented on pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
virajjasani commented on pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#issuecomment-814107239 Oh I see, yeah this is a possibility. I agree that we should bring back zero capacity check. > Actually `TestDecommission#testDecommissionWithNamenodeRestart()`

[GitHub] [hadoop] jianghuazhu commented on pull request #2831: HDFS-15920.Solve the problem that the value of SafeModeMonitor#RECHECK_INTERVAL can be configured.

2021-04-06 Thread GitBox
jianghuazhu commented on pull request #2831: URL: https://github.com/apache/hadoop/pull/2831#issuecomment-814090829 @ayushtkn , I submitted some new code. Can you help to check it? thank you very much -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HADOOP-17588) CryptoInputStream#close() should be syncronized

2021-04-06 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Boyina updated HADOOP-17588: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-17588) CryptoInputStream#close() should be syncronized

2021-04-06 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315497#comment-17315497 ] Hemanth Boyina commented on HADOOP-17588: - +1, committing to trunk thanks [~prasad-acit] for

[GitHub] [hadoop] WeisonWei opened a new pull request #2872: HDFS-15953. fix DUMMY_CLIENT_ID verification

2021-04-06 Thread GitBox
WeisonWei opened a new pull request #2872: URL: https://github.com/apache/hadoop/pull/2872 rpcClientId != RpcConstants.DUMMY_CLIENT_ID in FSEditLogOp#hasRpcIds() // code placeholder public boolean hasRpcIds() { return rpcClientId != RpcConstants.DUMMY_CLIENT_ID &&

[GitHub] [hadoop] tasanuma commented on pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
tasanuma commented on pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#issuecomment-814082007 On second thought, the last commit has a problem. Just after restarting NameNode, NameNode hasn't received any block reports from any DataNode, so NameNode recognizes all

[GitHub] [hadoop] hadoop-yetus commented on pull request #2831: HDFS-15920.Solve the problem that the value of SafeModeMonitor#RECHECK_INTERVAL can be configured.

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2831: URL: https://github.com/apache/hadoop/pull/2831#issuecomment-814058272 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17625) Update to Jetty 9.4.39

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17625?focusedWorklogId=577481=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577481 ] ASF GitHub Bot logged work on HADOOP-17625: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2870: HADOOP-17625. Update to Jetty 9.4.39.

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2870: URL: https://github.com/apache/hadoop/pull/2870#issuecomment-814037774 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17614) Bump netty to the latest 4.1.61

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17614?focusedWorklogId=577440=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577440 ] ASF GitHub Bot logged work on HADOOP-17614: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2871: HADOOP-17614. Bump netty to the latest 4.1.61.

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2871: URL: https://github.com/apache/hadoop/pull/2871#issuecomment-813998243 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka merged pull request #2857: HDFS-15949. Fix integer overflow

2021-04-06 Thread GitBox
aajisaka merged pull request #2857: URL: https://github.com/apache/hadoop/pull/2857 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Work logged] (HADOOP-17621) hadoop-auth to remove jetty-server dependency

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17621?focusedWorklogId=577430=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577430 ] ASF GitHub Bot logged work on HADOOP-17621: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2865: HADOOP-17621. hadoop-auth to remove jetty-server dependency.

2021-04-06 Thread GitBox
aajisaka commented on pull request #2865: URL: https://github.com/apache/hadoop/pull/2865#issuecomment-813968864 > The javac warning is expected. I intend to use this deprecated API to achieve the goal. Agreed. -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] tasanuma commented on pull request #2854: HDFS-15945. DataNodes with zero capacity and zero blocks should be decommissioned immediately.

2021-04-06 Thread GitBox
tasanuma commented on pull request #2854: URL: https://github.com/apache/hadoop/pull/2854#issuecomment-813959250 Based on a discussion with @virajjasani (https://github.com/apache/hadoop/pull/2854#discussion_r607104128), I realized it doesn't matter what the capacity is. If a datanode

[jira] [Work logged] (HADOOP-17614) Bump netty to the latest 4.1.61

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17614?focusedWorklogId=577419=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577419 ] ASF GitHub Bot logged work on HADOOP-17614: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #2871: HADOOP-17614. Bump netty to the latest 4.1.61.

2021-04-06 Thread GitBox
jojochuang commented on pull request #2871: URL: https://github.com/apache/hadoop/pull/2871#issuecomment-813954553 This is the branch-3.1 version. Note that the structural change inside hadoop-project/pom.xml between branch-3.1 and branch-3.2 was quite substantial. -- This is an

[jira] [Work logged] (HADOOP-17614) Bump netty to the latest 4.1.61

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17614?focusedWorklogId=577418=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577418 ] ASF GitHub Bot logged work on HADOOP-17614: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang opened a new pull request #2871: HADOOP-17614. Bump netty to the latest 4.1.61.

2021-04-06 Thread GitBox
jojochuang opened a new pull request #2871: URL: https://github.com/apache/hadoop/pull/2871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[jira] [Updated] (HADOOP-17614) Bump netty to the latest 4.1.61

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17614: - Fix Version/s: 3.2.3 > Bump netty to the latest 4.1.61 >

[jira] [Work logged] (HADOOP-17371) Bump Jetty to the latest version 9.4.35

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17371?focusedWorklogId=577412=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577412 ] ASF GitHub Bot logged work on HADOOP-17371: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang closed pull request #2635: Revert "HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang."

2021-04-06 Thread GitBox
jojochuang closed pull request #2635: URL: https://github.com/apache/hadoop/pull/2635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] qizhu-lucas commented on pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-06 Thread GitBox
qizhu-lucas commented on pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#issuecomment-813931427 @ayushtkn Thanks a lot for your review and good suggestions. I have updated in latest PR. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] qizhu-lucas commented on a change in pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-06 Thread GitBox
qizhu-lucas commented on a change in pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#discussion_r607637557 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java ## @@ -836,6 +836,10 @@ public static final

[GitHub] [hadoop] qizhu-lucas commented on a change in pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-06 Thread GitBox
qizhu-lucas commented on a change in pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#discussion_r607637716 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java ## @@ -316,6 +317,18 @@

[GitHub] [hadoop] qizhu-lucas commented on a change in pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-06 Thread GitBox
qizhu-lucas commented on a change in pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#discussion_r607637557 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java ## @@ -836,6 +836,10 @@ public static final

[jira] [Work logged] (HADOOP-17625) Update to Jetty 9.4.39

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17625?focusedWorklogId=577389=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577389 ] ASF GitHub Bot logged work on HADOOP-17625: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17625) Update to Jetty 9.4.39

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17625: Labels: pull-request-available (was: ) > Update to Jetty 9.4.39 >

[GitHub] [hadoop] jojochuang opened a new pull request #2870: HADOOP-17625. Update to Jetty 9.4.39.

2021-04-06 Thread GitBox
jojochuang opened a new pull request #2870: URL: https://github.com/apache/hadoop/pull/2870 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[jira] [Deleted] (HADOOP-17626) Update to Jetty 9.4.39

2021-04-06 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang deleted HADOOP-17626: - > Update to Jetty 9.4.39 > -- > > Key: HADOOP-17626 >

[jira] [Created] (HADOOP-17625) Update to Jetty 9.4.39

2021-04-06 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-17625: Summary: Update to Jetty 9.4.39 Key: HADOOP-17625 URL: https://issues.apache.org/jira/browse/HADOOP-17625 Project: Hadoop Common Issue Type: Task

[jira] [Created] (HADOOP-17626) Update to Jetty 9.4.39

2021-04-06 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-17626: Summary: Update to Jetty 9.4.39 Key: HADOOP-17626 URL: https://issues.apache.org/jira/browse/HADOOP-17626 Project: Hadoop Common Issue Type: Task

[GitHub] [hadoop] tasanuma commented on pull request #2866: HDFS-15900. RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode.

2021-04-06 Thread GitBox
tasanuma commented on pull request #2866: URL: https://github.com/apache/hadoop/pull/2866#issuecomment-813882207 I confirmed that building branch-3.1 with this PR succeeded and `mvn test -pl hadoop-hdfs-rbf` passed in my local environment. Cherry-picked to branch-3.1. -- This is an

[GitHub] [hadoop] hadoop-yetus commented on pull request #2868: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode (#2585)

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2868: URL: https://github.com/apache/hadoop/pull/2868#issuecomment-813876696 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2869: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode (#2585)

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2869: URL: https://github.com/apache/hadoop/pull/2869#issuecomment-813873890 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17624) Remove any rocksdb exclusion code

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17624?focusedWorklogId=577356=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577356 ] ASF GitHub Bot logged work on HADOOP-17624: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17624) Remove any rocksdb exclusion code

2021-04-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17624?focusedWorklogId=577357=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-577357 ] ASF GitHub Bot logged work on HADOOP-17624: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2867: HADOOP-17624. Remove any rocksdb exclusion code.

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2867: URL: https://github.com/apache/hadoop/pull/2867#issuecomment-813864127 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2867: HADOOP-17624. Remove any rocksdb exclusion code.

2021-04-06 Thread GitBox
hadoop-yetus commented on pull request #2867: URL: https://github.com/apache/hadoop/pull/2867#issuecomment-813864010 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0