[jira] [Work started] (HADOOP-17471) ABFS to collect IOStatistics

2021-02-22 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17471 started by Mehakmeet Singh. > ABFS to collect IOStatistics > > >

[jira] [Assigned] (HADOOP-17471) ABFS to collect IOStatistics

2021-02-22 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehakmeet Singh reassigned HADOOP-17471: Assignee: Mehakmeet Singh > ABFS to collect IOStatistics >

[jira] [Commented] (HADOOP-17471) ABFS to collect IOStatistics

2021-02-22 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288871#comment-17288871 ] Mehakmeet Singh commented on HADOOP-17471: -- I have a little patch for this already, so I can

[GitHub] [hadoop] tasanuma commented on pull request #2714: HDFS-15845. RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance.

2021-02-22 Thread GitBox
tasanuma commented on pull request #2714: URL: https://github.com/apache/hadoop/pull/2714#issuecomment-783937302 Thanks for your reviews, @goiri and @wojiaodoubao. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] tasanuma merged pull request #2714: HDFS-15845. RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance.

2021-02-22 Thread GitBox
tasanuma merged pull request #2714: URL: https://github.com/apache/hadoop/pull/2714 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=556173=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556173 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-22 Thread GitBox
sumangala-patki commented on pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#issuecomment-783877840 TEST RESULTS HNS Account Location: East US 2 NonHNS Account Location: East US 2, Central US ``` HNS-OAuth [INFO] Tests run: 93, Failures: 0,

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=556172=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556172 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet edited a comment on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-22 Thread GitBox
mehakmeet edited a comment on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-783802582 Also on that note, I figured something in the aws-sdk while doing a put request we have this in S3CryptoModuleBase.java: ``` // Record the original, unencrypted

[jira] [Commented] (HADOOP-17541) Yetus does not run qbt-trunk

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288815#comment-17288815 ] Akira Ajisaka commented on HADOOP-17541: Updated the config and ran manually:

[GitHub] [hadoop] ferhui commented on pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-02-22 Thread GitBox
ferhui commented on pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#issuecomment-783850311 @jojochuang Thanks for ping. @touchida Thanks for contribution, overall looks good. Will have a detail review later. Minor comments -

[GitHub] [hadoop] wojiaodoubao commented on pull request #2714: HDFS-15845. RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance.

2021-02-22 Thread GitBox
wojiaodoubao commented on pull request #2714: URL: https://github.com/apache/hadoop/pull/2714#issuecomment-783840048 The change looks good to me ! +1. This is an automated message from the Apache Git Service. To respond to

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=556130=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556130 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-22 Thread GitBox
mehakmeet commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-783802582 How, exactly do we get the content length without doing a head call? isn’t content length in the metadata as well? Also on that note, I figured something in the aws-sdk

[GitHub] [hadoop] tomscut commented on pull request #2668: HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time

2021-02-22 Thread GitBox
tomscut commented on pull request #2668: URL: https://github.com/apache/hadoop/pull/2668#issuecomment-783798764 Failed junit tests hadoop.hdfs.server.namenode.ha.TestHAAppend hadoop.hdfs.qjournal.server.TestJournalNodeSync

[GitHub] [hadoop] tomscut removed a comment on pull request #2668: HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time

2021-02-22 Thread GitBox
tomscut removed a comment on pull request #2668: URL: https://github.com/apache/hadoop/pull/2668#issuecomment-780595016 > This message was automatically generated. Hi @anuengineer, the failed check looks unrelated to the change. May I ask how I should deal with it?

[GitHub] [hadoop] tomscut removed a comment on pull request #2668: HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time

2021-02-22 Thread GitBox
tomscut removed a comment on pull request #2668: URL: https://github.com/apache/hadoop/pull/2668#issuecomment-780991248 I found this JIRA in the log. https://issues.apache.org/jira/browse/HADOOP-16870 Hi @aajisaka , Could you please help to take a look at this problem? And how I should

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=556095=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556095 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ravwojdyla commented on a change in pull request #2638: HADOOP-17402. Add GCS config to the core-site

2021-02-22 Thread GitBox
ravwojdyla commented on a change in pull request #2638: URL: https://github.com/apache/hadoop/pull/2638#discussion_r580686365 ## File path: hadoop-common-project/hadoop-common/src/main/resources/core-default.xml ## @@ -1062,6 +1065,14 @@ + +

[GitHub] [hadoop] LeonGao91 closed pull request #2666: HDFS-15807. RefreshVolume fails when replacing DISK/ARCHIVE vol on same mount.

2021-02-22 Thread GitBox
LeonGao91 closed pull request #2666: URL: https://github.com/apache/hadoop/pull/2666 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (HADOOP-17541) Yetus does not run qbt-trunk

2021-02-22 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17541: -- Summary: Yetus does not run qbt-trunk Key: HADOOP-17541 URL: https://issues.apache.org/jira/browse/HADOOP-17541 Project: Hadoop Common Issue Type: Bug

[GitHub] [hadoop] sumangala-patki commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-02-22 Thread GitBox
sumangala-patki commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-783557071 TEST RESULTS HNS Account Location: East US 2 NonHNS Account Location: East US 2, Central US ``` HNS OAuth [INFO] Tests run: 101, Failures: 0,

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=555916=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555916 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-02-22 Thread GitBox
hadoop-yetus removed a comment on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-780794206 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=555903=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555903 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-22 Thread GitBox
steveloughran commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-783532925 we've discussed using that header before -but not gone with because, as you note: LIST operations don't pick up the header. All code which uses the list to determine

[jira] [Updated] (HADOOP-17540) hadoop-client-runtime-3.3.0 not properly shading javax.xml.bind

2021-02-22 Thread Lorie (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lorie updated HADOOP-17540: --- Description: In the file hadoop-client-modules/hadoop-client-runtime/pom.xml, it excludes javax.xml.bind

[jira] [Created] (HADOOP-17540) hadoop-client-runtime-3.3.0 not properly shading javax.xml.bind

2021-02-22 Thread Lorie (Jira)
Lorie created HADOOP-17540: -- Summary: hadoop-client-runtime-3.3.0 not properly shading javax.xml.bind Key: HADOOP-17540 URL: https://issues.apache.org/jira/browse/HADOOP-17540 Project: Hadoop Common

[jira] [Commented] (HADOOP-17539) ABFS test setup failing "The specified filesystem already exists"

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288418#comment-17288418 ] Steve Loughran commented on HADOOP-17539: - my plan to fix this is also to move off the hadoop

[jira] [Commented] (HADOOP-17539) ABFS test setup failing "The specified filesystem already exists"

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288415#comment-17288415 ] Steve Loughran commented on HADOOP-17539: - {code} [ERROR]

[jira] [Created] (HADOOP-17539) ABFS test setup failing "The specified filesystem already exists"

2021-02-22 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17539: --- Summary: ABFS test setup failing "The specified filesystem already exists" Key: HADOOP-17539 URL: https://issues.apache.org/jira/browse/HADOOP-17539 Project:

[jira] [Work logged] (HADOOP-16810) Increase entropy to improve cryptographic randomness on precommit Linux VMs

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16810?focusedWorklogId=555846=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555846 ] ASF GitHub Bot logged work on HADOOP-16810: --- Author: ASF GitHub Bot

[GitHub] [hadoop] asf-cloudbees-jenkins-ci-hadoop[bot] commented on pull request #2697: HADOOP-16810. Increase entropy on precommit Linux VMs

2021-02-22 Thread GitBox
asf-cloudbees-jenkins-ci-hadoop[bot] commented on pull request #2697: URL: https://github.com/apache/hadoop/pull/2697#issuecomment-783426974 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=555843=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555843 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2294: HADOOP-17195. ABFS Store thread pool for stream IO.

2021-02-22 Thread GitBox
steveloughran commented on pull request #2294: URL: https://github.com/apache/hadoop/pull/2294#issuecomment-783426138 Maybe I was being pessimistic there. If the #of active writes a single stream can have active is throttled, the #of open blocks a single stream can have allocated is also

[jira] [Work logged] (HADOOP-17536) Suport for customer provided encrption key

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=555833=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555833 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2707: DRAFT PR: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-02-22 Thread GitBox
steveloughran commented on a change in pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#discussion_r580296243 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -88,6 +96,21 @@ private

[jira] [Updated] (HADOOP-16052) Remove Subversion and Forrest from Dockerfile

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16052: --- Fix Version/s: 2.10.2 Backported to branch-2.10. > Remove Subversion and Forrest from

[jira] [Commented] (HADOOP-16052) Remove Subversion and Forrest from Dockerfile

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288405#comment-17288405 ] Akira Ajisaka commented on HADOOP-16052: Backported to branch-3.1. > Remove Subversion and

[jira] [Updated] (HADOOP-16052) Remove Subversion and Forrest from Dockerfile

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16052: --- Fix Version/s: 3.1.5 > Remove Subversion and Forrest from Dockerfile >

[jira] [Work logged] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?focusedWorklogId=555829=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555829 ] ASF GitHub Bot logged work on HADOOP-16748: --- Author: ASF GitHub Bot

[GitHub] [hadoop] asf-cloudbees-jenkins-ci-hadoop[bot] commented on pull request #2717: HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2)

2021-02-22 Thread GitBox
asf-cloudbees-jenkins-ci-hadoop[bot] commented on pull request #2717: URL: https://github.com/apache/hadoop/pull/2717#issuecomment-783414782 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is

[jira] [Updated] (HADOOP-16052) Remove Subversion and Forrest from Dockerfile

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16052: --- Fix Version/s: 3.2.3 Backported to branch-3.2. > Remove Subversion and Forrest from

[jira] [Work logged] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?focusedWorklogId=555828=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555828 ] ASF GitHub Bot logged work on HADOOP-16748: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka opened a new pull request #2717: HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2)

2021-02-22 Thread GitBox
aajisaka opened a new pull request #2717: URL: https://github.com/apache/hadoop/pull/2717 - Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts. - Removed determine-flaky-tests-hadoop.py. - Temporarily disabled shelldocs check due to YETUS-1099. Reviewed-by:

[GitHub] [hadoop] aajisaka commented on pull request #2712: MAPREDUCE-7323. Remove job_history_summary.py.

2021-02-22 Thread GitBox
aajisaka commented on pull request #2712: URL: https://github.com/apache/hadoop/pull/2712#issuecomment-783405188 Merged. Thank you @tasanuma This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] aajisaka merged pull request #2712: MAPREDUCE-7323. Remove job_history_summary.py.

2021-02-22 Thread GitBox
aajisaka merged pull request #2712: URL: https://github.com/apache/hadoop/pull/2712 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-17428) ABFS: Implementation for getContentSummary

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288395#comment-17288395 ] Steve Loughran commented on HADOOP-17428: - I'd consider this very low priority...not aware of

[jira] [Work logged] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?focusedWorklogId=555807=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555807 ] ASF GitHub Bot logged work on HADOOP-17538: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2716: HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index.

2021-02-22 Thread GitBox
ayushtkn commented on a change in pull request #2716: URL: https://github.com/apache/hadoop/pull/2716#discussion_r580259614 ## File path: hadoop-project/src/site/site.xml ## @@ -216,6 +216,8 @@ + + Review comment: Just to be sure,

[jira] [Updated] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-22 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17538: -- Status: Patch Available (was: Open) > Add kms-default.xml and httpfs-default.xml to

[jira] [Updated] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17538: Labels: pull-request-available (was: ) > Add kms-default.xml and httpfs-default.xml to

[jira] [Work logged] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?focusedWorklogId=555801=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555801 ] ASF GitHub Bot logged work on HADOOP-17538: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims opened a new pull request #2716: HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index.

2021-02-22 Thread GitBox
iwasakims opened a new pull request #2716: URL: https://github.com/apache/hadoop/pull/2716 https://issues.apache.org/jira/browse/HADOOP-17538 While there are links to *-default.xml in the site index, kms-default.xml and httpfs-default.xml are not included. Adding them could be

[jira] [Created] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-22 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17538: - Summary: Add kms-default.xml and httpfs-default.xml to site index Key: HADOOP-17538 URL: https://issues.apache.org/jira/browse/HADOOP-17538 Project: Hadoop

[jira] [Commented] (HADOOP-17537) Correct abfs test assertion reversed in HADOOP-13327

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288360#comment-17288360 ] Steve Loughran commented on HADOOP-17537: - thanks, merged in. we should think about moving

[jira] [Updated] (HADOOP-17537) Correct abfs test assertion reversed in HADOOP-13327

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17537: Fix Version/s: 3.3.1 > Correct abfs test assertion reversed in HADOOP-13327 >

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=555772=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555772 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=555771=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555771 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-22 Thread GitBox
mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r578586956 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AEncryptionCSESymmetric.java ## @@ -0,0 +1,86 @@ +package

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-22 Thread GitBox
mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r578587149 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ACSEMaterialProviderConfig.java ## @@ -0,0 +1,14 @@ +package

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=555770=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555770 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-22 Thread GitBox
mehakmeet commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-783336386 Added the "UNENCRYPTED_CONTENT_LENGTH" header in getFileStatus calls and replaced the content length with it if client-side encryption(CSE) is enabled. This helped pass the

[jira] [Assigned] (HADOOP-17537) Correct abfs test assertion reversed in HADOOP-13327

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17537: --- Assignee: Sumangala Patki (was: Steve Loughran) > Correct abfs test assertion

[jira] [Updated] (HADOOP-17537) Correct abfs test assertion reversed in HADOOP-13327

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17537: Component/s: test > Correct abfs test assertion reversed in HADOOP-13327 >

[jira] [Updated] (HADOOP-17537) Correct abfs test assertion reversed in HADOOP-13327

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17537: Affects Version/s: (was: 3.3.0) 3.3.1 > Correct abfs test

[jira] [Commented] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288349#comment-17288349 ] Steve Loughran commented on HADOOP-17527: - running joke in code: nobody gets seek() right >

[jira] [Updated] (HADOOP-17537) Correct abfs test assertion reversed in HADOOP-13327

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17537: Summary: Correct abfs test assertion reversed in HADOOP-13327 (was: Correct assertion

[jira] [Assigned] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17537: --- Assignee: Steve Loughran > Correct assertion reversed in HADOOP-13327 >

[jira] [Updated] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

2021-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17038: Fix Version/s: 3.3.1 > Support disabling buffered reads in ABFS positional reads >

[jira] [Work logged] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?focusedWorklogId=555760=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555760 ] ASF GitHub Bot logged work on HADOOP-17537: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #2715: HADOOP-17537. ABFS: Correct assertion reversed in HADOOP-13327

2021-02-22 Thread GitBox
steveloughran merged pull request #2715: URL: https://github.com/apache/hadoop/pull/2715 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] jojochuang commented on pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2021-02-22 Thread GitBox
jojochuang commented on pull request #2559: URL: https://github.com/apache/hadoop/pull/2559#issuecomment-783263270 For future reference, I reverted the commit and cherrypicked again to fix the commit message (needed to add the jira id and summary to the commit message)

[jira] [Work logged] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?focusedWorklogId=555740=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555740 ] ASF GitHub Bot logged work on HADOOP-17537: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?focusedWorklogId=555738=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555738 ] ASF GitHub Bot logged work on HADOOP-17537: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki edited a comment on pull request #2715: HADOOP-17537. ABFS: Correct assertion reversed in HADOOP-13327

2021-02-22 Thread GitBox
sumangala-patki edited a comment on pull request #2715: URL: https://github.com/apache/hadoop/pull/2715#issuecomment-783262331 TEST RESULTS HNS Account Location: East US 2 NonHNS Account Location: East US 2, Central US ``` HNS-OAuth [INFO] Tests run: 93, Failures:

[GitHub] [hadoop] sumangala-patki commented on pull request #2715: HADOOP-17537. ABFS: Correct assertion reversed in HADOOP-13327

2021-02-22 Thread GitBox
sumangala-patki commented on pull request #2715: URL: https://github.com/apache/hadoop/pull/2715#issuecomment-783262331 TEST RESULTS HNS Account Location: East US 2 NonHNS Account Location: East US 2, Central US ``` HNS-OAuth [INFO] Tests run: 93, Failures: 0, Errors:

[GitHub] [hadoop] jojochuang merged pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2021-02-22 Thread GitBox
jojochuang merged pull request #2559: URL: https://github.com/apache/hadoop/pull/2559 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread Sumangala Patki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumangala Patki updated HADOOP-17537: - Description: HADOOP-13327 introduces, among other changes, functions to simplify

[jira] [Work logged] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?focusedWorklogId=555722=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555722 ] ASF GitHub Bot logged work on HADOOP-17537: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17537: Labels: pull-request-available (was: ) > Correct assertion reversed in HADOOP-13327 >

[GitHub] [hadoop] sumangala-patki opened a new pull request #2715: HADOOP-17537. ABFS: Correct assertion reversed in HADOOP-13327

2021-02-22 Thread GitBox
sumangala-patki opened a new pull request #2715: URL: https://github.com/apache/hadoop/pull/2715 HADOOP-13327 introduces, among other changes, functions to simplify assert for checking stream capabilities. This change fixes (originally) assertFalse statements whose logic has been reversed

[jira] [Commented] (HADOOP-16917) Update dependency in branch-3.1

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288270#comment-17288270 ] Akira Ajisaka commented on HADOOP-16917: I think upgrading the Jackson version makes sense.

[jira] [Comment Edited] (HADOOP-16917) Update dependency in branch-3.1

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288270#comment-17288270 ] Akira Ajisaka edited comment on HADOOP-16917 at 2/22/21, 9:19 AM: -- I

[jira] [Work logged] (HADOOP-17529) Update os-maven-plugin to version 1.7.0, to support RISC-V architecture (JDK11)

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17529?focusedWorklogId=555708=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555708 ] ASF GitHub Bot logged work on HADOOP-17529: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2700: HADOOP-17529. Upgrade os-maven-plugin to 1.7.0

2021-02-22 Thread GitBox
aajisaka commented on pull request #2700: URL: https://github.com/apache/hadoop/pull/2700#issuecomment-783219889 @advancedwebdeveloper > So what should be done next? You need to remove the two lines commented in

[GitHub] [hadoop] smengcl edited a comment on pull request #2710: HDFS-15843. Make write cross-platform

2021-02-22 Thread GitBox
smengcl edited a comment on pull request #2710: URL: https://github.com/apache/hadoop/pull/2710#issuecomment-783214670 Thanks @GauthamBanasandra for the patch. I'm wondering if the [author](https://issues.apache.org/jira/browse/HDFS-11028) uses syscall write on purpose. According

[GitHub] [hadoop] smengcl commented on pull request #2710: HDFS-15843. Make write cross-platform

2021-02-22 Thread GitBox
smengcl commented on pull request #2710: URL: https://github.com/apache/hadoop/pull/2710#issuecomment-783214670 Thanks @GauthamBanasandra for the patch. I'm wondering if the [author](https://issues.apache.org/jira/browse/HDFS-11028) uses syscall write for a reason. According to the

[jira] [Created] (HADOOP-17537) Correct assertion reversed in HADOOP-13327

2021-02-22 Thread Sumangala Patki (Jira)
Sumangala Patki created HADOOP-17537: Summary: Correct assertion reversed in HADOOP-13327 Key: HADOOP-17537 URL: https://issues.apache.org/jira/browse/HADOOP-17537 Project: Hadoop Common

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=555688=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555688 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on a change in pull request #2638: HADOOP-17402. Add GCS config to the core-site

2021-02-22 Thread GitBox
jojochuang commented on a change in pull request #2638: URL: https://github.com/apache/hadoop/pull/2638#discussion_r580072781 ## File path: hadoop-common-project/hadoop-common/src/main/resources/core-default.xml ## @@ -1062,6 +1065,14 @@ + +

[jira] [Commented] (HADOOP-16917) Update dependency in branch-3.1

2021-02-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288256#comment-17288256 ] Wei-Chiu Chuang commented on HADOOP-16917: -- There's no jackson-databind 2.13. Our trunk is on

[jira] [Updated] (HADOOP-17534) Upgrade Jackson databind to 2.10.5.1

2021-02-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17534: --- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Status:

[jira] [Work logged] (HADOOP-17534) Upgrade Jackson databind to 2.10.5.1

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17534?focusedWorklogId=555682=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555682 ] ASF GitHub Bot logged work on HADOOP-17534: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2708: HADOOP-17534. Update Jackson to 2.10.5 and Jackson databind to 2.10.5.1

2021-02-22 Thread GitBox
aajisaka commented on pull request #2708: URL: https://github.com/apache/hadoop/pull/2708#issuecomment-783194503 I ran TestZKFailoverController locally and it passed. This is an automated message from the Apache Git Service.

[jira] [Work logged] (HADOOP-17534) Upgrade Jackson databind to 2.10.5.1

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17534?focusedWorklogId=555681=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555681 ] ASF GitHub Bot logged work on HADOOP-17534: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17534) Upgrade Jackson databind to 2.10.5.1

2021-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17534?focusedWorklogId=555680=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-555680 ] ASF GitHub Bot logged work on HADOOP-17534: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2708: HADOOP-17534. Update Jackson to 2.10.5 and Jackson databind to 2.10.5.1

2021-02-22 Thread GitBox
aajisaka commented on pull request #2708: URL: https://github.com/apache/hadoop/pull/2708#issuecomment-783194225 Merged. Thank you @jojochuang This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] tasanuma opened a new pull request #2714: HDFS-15845. RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance.

2021-02-22 Thread GitBox
tasanuma opened a new pull request #2714: URL: https://github.com/apache/hadoop/pull/2714 JIRA: https://issues.apache.org/jira/browse/HDFS-15845 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] aajisaka merged pull request #2708: HADOOP-17534. Update Jackson to 2.10.5 and Jackson databind to 2.10.5.1

2021-02-22 Thread GitBox
aajisaka merged pull request #2708: URL: https://github.com/apache/hadoop/pull/2708 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

  1   2   >