[jira] [Work logged] (HADOOP-17615) ADLFS: Update SDK version from 2.3.6 to 2.3.9

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17615?focusedWorklogId=584063=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-584063 ] ASF GitHub Bot logged work on HADOOP-17615: --- Author: ASF GitHub Bot

[GitHub] [hadoop] surendralilhore commented on pull request #2842: HADOOP-17615. ADLS Gen1: Update adls SDK to 2.3.9

2021-04-15 Thread GitBox
surendralilhore commented on pull request #2842: URL: https://github.com/apache/hadoop/pull/2842#issuecomment-820920271 Triggered build again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Resolved] (HADOOP-17576) ABFS: Disable throttling update for auth failures

2021-04-15 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore resolved HADOOP-17576. - Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed

[jira] [Work logged] (HADOOP-17576) ABFS: Disable throttling update for auth failures

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17576?focusedWorklogId=584057=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-584057 ] ASF GitHub Bot logged work on HADOOP-17576: --- Author: ASF GitHub Bot

[GitHub] [hadoop] surendralilhore merged pull request #2885: HADOOP-17576. ABFS: Disable throttling update for auth failures

2021-04-15 Thread GitBox
surendralilhore merged pull request #2885: URL: https://github.com/apache/hadoop/pull/2885 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [hadoop] langlaile1221 opened a new pull request #2916: HDFS-15981. Removing redundant block queues will slow down block reporting

2021-04-15 Thread GitBox
langlaile1221 opened a new pull request #2916: URL: https://github.com/apache/hadoop/pull/2916 When the block report satisfies the block distribution strategy, the block is removed from the lowredundancyBlocks. But removing the block from the lowredundancyBlocks is a redundant operation.

[GitHub] [hadoop] hadoop-yetus commented on pull request #2915: HDFS-15974. Fix RBF does not display datanode UI

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2915: URL: https://github.com/apache/hadoop/pull/2915#issuecomment-820903604 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka commented on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
aajisaka commented on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820897074 Merged. Thank you @GauthamBanasandra, @iwasakims, and @goiri. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] aajisaka merged pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
aajisaka merged pull request #2914: URL: https://github.com/apache/hadoop/pull/2914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] zhuxiangyi opened a new pull request #2915: Fix RBF does not display datanode UI

2021-04-15 Thread GitBox
zhuxiangyi opened a new pull request #2915: URL: https://github.com/apache/hadoop/pull/2915 [HDFS-15974](https://issues.apache.org/jira/browse/HDFS-15974) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] qizhu-lucas commented on pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-15 Thread GitBox
qizhu-lucas commented on pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#issuecomment-820872414 Thanks very much for @ayushtkn patient review. I have updated above in latest PR. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] qizhu-lucas commented on pull request #2911: YARN-10737: Fix typos in CapacityScheduler#schedule.

2021-04-15 Thread GitBox
qizhu-lucas commented on pull request #2911: URL: https://github.com/apache/hadoop/pull/2911#issuecomment-820857577 Thanks @fdalsotto for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] tomscut commented on a change in pull request #2907: HDFS-15975. Use LongAdder instead of AtomicLong

2021-04-15 Thread GitBox
tomscut commented on a change in pull request #2907: URL: https://github.com/apache/hadoop/pull/2907#discussion_r614496017 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetCache.java ## @@ -607,11

[GitHub] [hadoop] hadoop-yetus commented on pull request #2737: HDFS-15869. Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2737: URL: https://github.com/apache/hadoop/pull/2737#issuecomment-820829126 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17638) Checksum type is always forced to be crc32

2021-04-15 Thread Daryn Sharp (Jira)
Daryn Sharp created HADOOP-17638: Summary: Checksum type is always forced to be crc32 Key: HADOOP-17638 URL: https://issues.apache.org/jira/browse/HADOOP-17638 Project: Hadoop Common Issue

[jira] [Work logged] (HADOOP-17633) Please upgrade json-smart dependency to the latest version

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17633?focusedWorklogId=583900=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583900 ] ASF GitHub Bot logged work on HADOOP-17633: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2895: HADOOP-17633. Bump json-smart to 2.4.2 and nimbus-jose-jwt to 9.8.1 due to CVEs

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2895: URL: https://github.com/apache/hadoop/pull/2895#issuecomment-820788402 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri merged pull request #2903: HDFS-15423 RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-15 Thread GitBox
goiri merged pull request #2903: URL: https://github.com/apache/hadoop/pull/2903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hadoop] goiri commented on a change in pull request #2896: HDFS-15970. Print network topology on the web

2021-04-15 Thread GitBox
goiri commented on a change in pull request #2896: URL: https://github.com/apache/hadoop/pull/2896#discussion_r614449369 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NetworkTopologyServlet.java ## @@ -0,0 +1,115 @@ +/** +

[GitHub] [hadoop] xiaoyuyao merged pull request #2784: HDFS-15850. Superuser actions should be reported to external enforcers

2021-04-15 Thread GitBox
xiaoyuyao merged pull request #2784: URL: https://github.com/apache/hadoop/pull/2784 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2913: HDFS-15978.Solve DatanodeManager#getBlockRecoveryCommand() printing IOException.

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2913: URL: https://github.com/apache/hadoop/pull/2913#issuecomment-820749035 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=583741=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583741 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-820684101 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17523) Replace LogCapturer with mock

2021-04-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322351#comment-17322351 ] Viraj Jasani commented on HADOOP-17523: --- [~zhangduo] [~aajisaka] Mockito also seems to require

[jira] [Work logged] (HADOOP-17633) Please upgrade json-smart dependency to the latest version

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17633?focusedWorklogId=583605=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583605 ] ASF GitHub Bot logged work on HADOOP-17633: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani removed a comment on pull request #2895: HADOOP-17633. Bump json-smart to 2.4.2 and nimbus-jose-jwt to 9.8.1 due to CVEs

2021-04-15 Thread GitBox
virajjasani removed a comment on pull request #2895: URL: https://github.com/apache/hadoop/pull/2895#issuecomment-820126450 Build#8 has timed-out after 20 hr and has these test failures recorded. Pasting screenshots here as the build data will be archived very soon.

[jira] [Commented] (HADOOP-17525) Support log4j2 API in GenericTestUtils.setLogLevel

2021-04-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322331#comment-17322331 ] Viraj Jasani commented on HADOOP-17525: --- You are right [~zhangduo], it would be better to pick

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-15 Thread GitBox
ayushtkn commented on a change in pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#discussion_r614224919 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java ## @@ -315,6 +316,40 @@ public

[GitHub] [hadoop] tasanuma commented on pull request #2907: HDFS-15975. Use LongAdder instead of AtomicLong

2021-04-15 Thread GitBox
tasanuma commented on pull request #2907: URL: https://github.com/apache/hadoop/pull/2907#issuecomment-820568403 > Nice one. For metrics and statistics, LongAdder provides much better throughput. Agreed with @virajjasani. Thanks for working on this, @tomscut. -- This is an

[GitHub] [hadoop] tasanuma commented on a change in pull request #2907: HDFS-15975. Use LongAdder instead of AtomicLong

2021-04-15 Thread GitBox
tasanuma commented on a change in pull request #2907: URL: https://github.com/apache/hadoop/pull/2907#discussion_r614222329 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetCache.java ## @@ -607,11

[jira] [Created] (HADOOP-17637) rename ListResultSchemaTest to TestListResultSchema so maven tests run it

2021-04-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17637: --- Summary: rename ListResultSchemaTest to TestListResultSchema so maven tests run it Key: HADOOP-17637 URL: https://issues.apache.org/jira/browse/HADOOP-17637

[jira] [Commented] (HADOOP-17525) Support log4j2 API in GenericTestUtils.setLogLevel

2021-04-15 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322265#comment-17322265 ] Duo Zhang commented on HADOOP-17525: I think this shouldbe be part of HADOOP-16206? We need to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2907: HDFS-15975. Use LongAdder instead of AtomicLong

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2907: URL: https://github.com/apache/hadoop/pull/2907#issuecomment-820500567 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17569) Building native code fails on Fedora 33

2021-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17569: -- Fix Version/s: 3.2.3 > Building native code fails on Fedora 33 >

[GitHub] [hadoop] tasanuma commented on pull request #2896: HDFS-15970. Print network topology on the web

2021-04-15 Thread GitBox
tasanuma commented on pull request #2896: URL: https://github.com/apache/hadoop/pull/2896#issuecomment-820451390 Mostly looks good to me. Is it possible to extend to Router UI as @ayushtkn commented? (maybe another jira?) -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=583416=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583416 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-820436221 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2737: HDFS-15869. Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2737: URL: https://github.com/apache/hadoop/pull/2737#issuecomment-820433086 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17569) Building native code fails on Fedora 33

2021-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17569: -- Fix Version/s: 3.3.1 > Building native code fails on Fedora 33 >

[GitHub] [hadoop] iwasakims commented on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
iwasakims commented on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820399933 > I found the latest list: https://ci.bigtop.apache.org/job/Bigtop-trunk-repos/ Yeah. You can see the discussion on

[GitHub] [hadoop] hadoop-yetus commented on pull request #2913: HDFS-15978.Solve DatanodeManager#getBlockRecoveryCommand() printing IOException.

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2913: URL: https://github.com/apache/hadoop/pull/2913#issuecomment-820397465 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2889: HDFS-15963. Unreleased volume references cause an infinite loop.

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2889: URL: https://github.com/apache/hadoop/pull/2889#issuecomment-820392449 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17569) Building native code fails on Fedora 33

2021-04-15 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17569: -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Work logged] (HADOOP-17569) Building native code fails on Fedora 33

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17569?focusedWorklogId=583366=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583366 ] ASF GitHub Bot logged work on HADOOP-17569: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17569) Building native code fails on Fedora 33

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17569?focusedWorklogId=583367=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583367 ] ASF GitHub Bot logged work on HADOOP-17569: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on pull request #2886: HADOOP-17569. Building native code fails on Fedora 33.

2021-04-15 Thread GitBox
iwasakims commented on pull request #2886: URL: https://github.com/apache/hadoop/pull/2886#issuecomment-820386755 Thanks, @aajisaka. I merged this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] iwasakims merged pull request #2886: HADOOP-17569. Building native code fails on Fedora 33.

2021-04-15 Thread GitBox
iwasakims merged pull request #2886: URL: https://github.com/apache/hadoop/pull/2886 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Assigned] (HADOOP-17525) Support log4j2 API in GenericTestUtils.setLogLevel

2021-04-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-17525: - Assignee: Viraj Jasani > Support log4j2 API in GenericTestUtils.setLogLevel >

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583332=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583332 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613990480 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestCustomerProvidedKey.java ## @@ -0,0 +1,937 @@ +/** + *

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583330=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583330 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583329=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583329 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613989746 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestCustomerProvidedKey.java ## @@ -0,0 +1,937 @@ +/** + *

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613989593 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestCustomerProvidedKey.java ## @@ -0,0 +1,937 @@ +/** + *

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583327=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583327 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613988562 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestCustomerProvidedKey.java ## @@ -0,0 +1,937 @@ +/** + *

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583324=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583324 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613988363 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestCustomerProvidedKey.java ## @@ -0,0 +1,937 @@ +/** + *

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583321=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583321 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613987240 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestCustomerProvidedKey.java ## @@ -0,0 +1,937 @@ +/** + *

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583316=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583316 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613984620 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestCustomerProvidedKey.java ## @@ -0,0 +1,937 @@ +/** + *

[GitHub] [hadoop] hadoop-yetus commented on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820342938 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2912: YARN-10738: When multi thread scheduling with multi node, we should s…

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2912: URL: https://github.com/apache/hadoop/pull/2912#issuecomment-820342885 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka commented on a change in pull request #2910: HDFS-15810. RBF: Use BigInteger for Router capacity metrics

2021-04-15 Thread GitBox
aajisaka commented on a change in pull request #2910: URL: https://github.com/apache/hadoop/pull/2910#discussion_r613976067 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/metrics/RBFMetrics.java ## @@ -371,13 +372,13

[jira] [Work logged] (HADOOP-17536) ABFS: Suport for customer provided encrption key

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=583306=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583306 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2707: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-04-15 Thread GitBox
bilaharith commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r613975367 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -412,6 +466,7 @@ public

[jira] [Created] (HADOOP-17636) ABFS: Remove the workaround used for Http PATCH

2021-04-15 Thread Bilahari T H (Jira)
Bilahari T H created HADOOP-17636: - Summary: ABFS: Remove the workaround used for Http PATCH Key: HADOOP-17636 URL: https://issues.apache.org/jira/browse/HADOOP-17636 Project: Hadoop Common

[GitHub] [hadoop] aajisaka edited a comment on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
aajisaka edited a comment on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820336080 I found the latest list: https://ci.bigtop.apache.org/job/Bigtop-trunk-repos/ - centos 7, 8 - debian 10 - fedora 33 - ubuntu 18, 20 -- This is an automated

[GitHub] [hadoop] aajisaka commented on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
aajisaka commented on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820336080 I found the latest list: https://ci.bigtop.apache.org/job/Bigtop-trunk-repos/ - centos7, 8 - debian 10 - fedora 33 - ubuntu 18, 20 -- This is an automated message

[jira] [Created] (HADOOP-17635) Update the ubuntu version in the build instruction

2021-04-15 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17635: -- Summary: Update the ubuntu version in the build instruction Key: HADOOP-17635 URL: https://issues.apache.org/jira/browse/HADOOP-17635 Project: Hadoop Common

[GitHub] [hadoop] aajisaka commented on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
aajisaka commented on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820328578 IMO, it would be better for Hadoop to support the list in Apache Bigtop: - centos7 - centos8 - debian9 - debian10 - fedora31 - ubuntu16 (soon EoL at the end of

[jira] [Updated] (HADOOP-17525) Support log4j2 API in GenericTestUtils.setLogLevel

2021-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17525: --- Description: GenericTestUtils.setLogLevel depends on Log4J 1.x API, should be updated to

[jira] [Updated] (HADOOP-17525) Support log4j2 API in GenericTestUtils.setLogLevel

2021-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17525: --- Summary: Support log4j2 API in GenericTestUtils.setLogLevel (was: Remove

[jira] [Commented] (HADOOP-17525) Support log4j2 API in GenericTestUtils.setLogLevel

2021-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322070#comment-17322070 ] Akira Ajisaka commented on HADOOP-17525: Updated the title and the description. > Support

[jira] [Commented] (HADOOP-17525) Remove GenericTestUtils.setLogLevel

2021-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322066#comment-17322066 ] Akira Ajisaka commented on HADOOP-17525: {quote}Do you think we should go with this change

[GitHub] [hadoop] hadoop-yetus commented on pull request #2889: HDFS-15963. Unreleased volume references cause an infinite loop.

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2889: URL: https://github.com/apache/hadoop/pull/2889#issuecomment-820312921 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17525) Remove GenericTestUtils.setLogLevel

2021-04-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322057#comment-17322057 ] Viraj Jasani commented on HADOOP-17525: --- [~aajisaka] [~zhangduo] Do you think we should go with

[jira] [Updated] (HADOOP-17524) Remove EventCounter and Log counters from JVM Metrics

2021-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17524: --- Fix Version/s: 3.4.0 Hadoop Flags: Incompatible change,Reviewed (was: Incompatible

[jira] [Updated] (HADOOP-17524) Remove EventCounter and Log counters from JVM Metrics

2021-04-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17524: --- Summary: Remove EventCounter and Log counters from JVM Metrics (was: Remove EventCounter)

[jira] [Work logged] (HADOOP-17524) Remove EventCounter

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17524?focusedWorklogId=583230=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583230 ] ASF GitHub Bot logged work on HADOOP-17524: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17524) Remove EventCounter

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17524?focusedWorklogId=583229=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583229 ] ASF GitHub Bot logged work on HADOOP-17524: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2909: HADOOP-17524. Remove EventCounter and Log counters from JVM Metrics

2021-04-15 Thread GitBox
aajisaka commented on pull request #2909: URL: https://github.com/apache/hadoop/pull/2909#issuecomment-820258271 Thank you @virajjasani and @Apache9 ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] aajisaka merged pull request #2909: HADOOP-17524. Remove EventCounter and Log counters from JVM Metrics

2021-04-15 Thread GitBox
aajisaka merged pull request #2909: URL: https://github.com/apache/hadoop/pull/2909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Work logged] (HADOOP-17524) Remove EventCounter

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17524?focusedWorklogId=583226=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583226 ] ASF GitHub Bot logged work on HADOOP-17524: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2909: HADOOP-17524. Remove EventCounter and Log counters from JVM Metrics

2021-04-15 Thread GitBox
aajisaka commented on pull request #2909: URL: https://github.com/apache/hadoop/pull/2909#issuecomment-820255833 > Incompatible change flag in Jira is enough right? I added the flag in the jira and wrote a release note. It is enough. -- This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on pull request #2912: YARN-10738: When multi thread scheduling with multi node, we should s…

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2912: URL: https://github.com/apache/hadoop/pull/2912#issuecomment-820255291 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
GauthamBanasandra commented on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820249127 Thanks @aajisaka for the fix. Is there a list of OS that we need to support? I'll compile my PRs against them to avoid these issues in the future. -- This is an

[jira] [Work logged] (HADOOP-17524) Remove EventCounter

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17524?focusedWorklogId=583216=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583216 ] ASF GitHub Bot logged work on HADOOP-17524: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2909: HADOOP-17524. Remove EventCounter and Log counters from JVM Metrics

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2909: URL: https://github.com/apache/hadoop/pull/2909#issuecomment-820240289 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17633) Please upgrade json-smart dependency to the latest version

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17633?focusedWorklogId=583206=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583206 ] ASF GitHub Bot logged work on HADOOP-17633: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2895: HADOOP-17633. Bump json-smart to 2.4.2 and nimbus-jose-jwt to 9.8.1 due to CVEs

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2895: URL: https://github.com/apache/hadoop/pull/2895#issuecomment-820221955 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka commented on pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
aajisaka commented on pull request #2914: URL: https://github.com/apache/hadoop/pull/2914#issuecomment-820214521 @GauthamBanasandra @goiri Would you review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] aajisaka opened a new pull request #2914: HDFS-15977. Call explicit_bzero only if it is available.

2021-04-15 Thread GitBox
aajisaka opened a new pull request #2914: URL: https://github.com/apache/hadoop/pull/2914 Manually tested with CentOS 7.9. JIRA: HDFS-15977 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-17633) Please upgrade json-smart dependency to the latest version

2021-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17633?focusedWorklogId=583194=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583194 ] ASF GitHub Bot logged work on HADOOP-17633: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2895: HADOOP-17633. Bump json-smart to 2.4.2 and nimbus-jose-jwt to 9.8.1 due to CVEs

2021-04-15 Thread GitBox
hadoop-yetus commented on pull request #2895: URL: https://github.com/apache/hadoop/pull/2895#issuecomment-820209651 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] ayushtkn edited a comment on pull request #2860: Test Pre-Commits.

2021-04-15 Thread GitBox
ayushtkn edited a comment on pull request #2860: URL: https://github.com/apache/hadoop/pull/2860#issuecomment-820201000 Well there aren’t too many failures getting surfaced now, the journal node is being already tracked. Does adding a retry flaky test(

[GitHub] [hadoop] ayushtkn commented on pull request #2860: Test Pre-Commits.

2021-04-15 Thread GitBox
ayushtkn commented on pull request #2860: URL: https://github.com/apache/hadoop/pull/2860#issuecomment-820201000 Well there aren’t too many failures getting surfaced now, the journal node is being already tracked. Does adding a retry flaky test( -Dsurefire.rerunFailingTestsCount=2

[GitHub] [hadoop] jianghuazhu opened a new pull request #2913: HDFS-15978.Solve DatanodeManager#getBlockRecoveryCommand() printing IOException.

2021-04-15 Thread GitBox
jianghuazhu opened a new pull request #2913: URL: https://github.com/apache/hadoop/pull/2913 …OException. ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding

[GitHub] [hadoop] fengnanli commented on a change in pull request #2910: HDFS-15810. RBF: Use BigInteger for Router capacity metrics

2021-04-15 Thread GitBox
fengnanli commented on a change in pull request #2910: URL: https://github.com/apache/hadoop/pull/2910#discussion_r613812428 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/metrics/RBFMetrics.java ## @@ -371,13 +372,13

  1   2   >