[jira] [Work logged] (HADOOP-17287) Support new Instance by non default constructor by ReflectionUtils

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17287?focusedWorklogId=492790&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492790 ] ASF GitHub Bot logged work on HADOOP-17287: --- Author: ASF GitHub B

[GitHub] [hadoop] maobaolong commented on pull request #2341: HADOOP-17287. Support new Instance by non default constructor by ReflectionUtils

2020-09-29 Thread GitBox
maobaolong commented on pull request #2341: URL: https://github.com/apache/hadoop/pull/2341#issuecomment-701162354 @sunchao Thanks for the review and point a lost import for me. Now I add an argument num check and a new test case. And, I test the two tests which added by me, both ar

[jira] [Work logged] (HADOOP-17287) Support new Instance by non default constructor by ReflectionUtils

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17287?focusedWorklogId=492788&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492788 ] ASF GitHub Bot logged work on HADOOP-17287: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17287) Support new Instance by non default constructor by ReflectionUtils

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17287?focusedWorklogId=492789&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492789 ] ASF GitHub Bot logged work on HADOOP-17287: --- Author: ASF GitHub B

[GitHub] [hadoop] maobaolong commented on a change in pull request #2341: HADOOP-17287. Support new Instance by non default constructor by ReflectionUtils

2020-09-29 Thread GitBox
maobaolong commented on a change in pull request #2341: URL: https://github.com/apache/hadoop/pull/2341#discussion_r497248700 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ReflectionUtils.java ## @@ -124,15 +124,29 @@ private static voi

[GitHub] [hadoop] maobaolong commented on a change in pull request #2341: HADOOP-17287. Support new Instance by non default constructor by ReflectionUtils

2020-09-29 Thread GitBox
maobaolong commented on a change in pull request #2341: URL: https://github.com/apache/hadoop/pull/2341#discussion_r497248808 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestReflectionUtils.java ## @@ -168,6 +168,13 @@ public void tes

[jira] [Updated] (HADOOP-17280) Service-user cost shouldn't be accumulated to totalDecayedCallCost and totalRawCallCost.

2020-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-17280: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Res

[GitHub] [hadoop] jianghuazhu opened a new pull request #2351: HDFS-15608.Reset the DistCp#CLEANUP variable definition.

2020-09-29 Thread GitBox
jianghuazhu opened a new pull request #2351: URL: https://github.com/apache/hadoop/pull/2351 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Commented] (HADOOP-17280) Service-user cost shouldn't be accumulated to totalDecayedCallCost and totalRawCallCost.

2020-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204419#comment-17204419 ] Xiaoqiao He commented on HADOOP-17280: -- Thanks [~LiJinglun],[~tasanuma]. +1 on [^

[jira] [Updated] (HADOOP-17284) Support BCFKS keystores for Hadoop Credential Provider

2020-09-29 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-17284: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resol

[jira] [Work logged] (HADOOP-17284) Support BCFKS keystores for Hadoop Credential Provider

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17284?focusedWorklogId=492775&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492775 ] ASF GitHub Bot logged work on HADOOP-17284: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17284) Support BCFKS keystores for Hadoop Credential Provider

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17284?focusedWorklogId=492776&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492776 ] ASF GitHub Bot logged work on HADOOP-17284: --- Author: ASF GitHub B

[GitHub] [hadoop] xiaoyuyao merged pull request #2334: HADOOP-17284. Support BCFKS keystores for Hadoop Credential Provider.

2020-09-29 Thread GitBox
xiaoyuyao merged pull request #2334: URL: https://github.com/apache/hadoop/pull/2334 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] xiaoyuyao commented on pull request #2334: HADOOP-17284. Support BCFKS keystores for Hadoop Credential Provider.

2020-09-29 Thread GitBox
xiaoyuyao commented on pull request #2334: URL: https://github.com/apache/hadoop/pull/2334#issuecomment-701131895 Thanks @arp7 for the review. PR has been merged. This is an automated message from the Apache Git Service. To

[jira] [Commented] (HADOOP-17280) Service-user cost shouldn't be accumulated to totalDecayedCallCost and totalRawCallCost.

2020-09-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204414#comment-17204414 ] Takanobu Asanuma commented on HADOOP-17280: --- [~LiJinglun] Thanks for updating

[GitHub] [hadoop] goiri merged pull request #2347: HDFS-15600 Fix TestRouterQuota#testStorageTypeQuota

2020-09-29 Thread GitBox
goiri merged pull request #2347: URL: https://github.com/apache/hadoop/pull/2347 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] liuml07 commented on pull request #2347: HDFS-15600 Fix TestRouterQuota#testStorageTypeQuota

2020-09-29 Thread GitBox
liuml07 commented on pull request #2347: URL: https://github.com/apache/hadoop/pull/2347#issuecomment-701113470 Thanks for fixing this. This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hadoop] goiri commented on pull request #2347: HDFS-15600 Fix TestRouterQuota#testStorageTypeQuota

2020-09-29 Thread GitBox
goiri commented on pull request #2347: URL: https://github.com/apache/hadoop/pull/2347#issuecomment-701113210 @liuml07 OK to merge? This is an automated message from the Apache Git Service. To respond to the message, please l

[jira] [Work logged] (HADOOP-17276) Extend CallerContext to make it include many items

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17276?focusedWorklogId=492765&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492765 ] ASF GitHub Bot logged work on HADOOP-17276: --- Author: ASF GitHub B

[GitHub] [hadoop] ferhui commented on pull request #2327: HADOOP-17276. Extend CallerContext to make it include many items

2020-09-29 Thread GitBox
ferhui commented on pull request #2327: URL: https://github.com/apache/hadoop/pull/2327#issuecomment-701107639 https://ci-hadoop.apache.org/blue/organizations/jenkins/hadoop-multibranch/detail/PR-2327/10/pipeline Failed tests passed locally. Will fix the checkstyle --

[jira] [Commented] (HADOOP-17284) Support BCFKS keystores for Hadoop Credential Provider

2020-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204372#comment-17204372 ] Hadoop QA commented on HADOOP-17284: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492716&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492716 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
viirya commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-701041484 @sunchao Thanks for review. I addressed your comments. Please let me know if you have more comments. This is an a

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492701&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492701 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r497099812 ## File path: hadoop-project-dist/pom.xml ## @@ -341,7 +340,6 @@ --openssllib=${openssl.lib} --opensslbinbundle=$

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492699&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492699 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r497093683 ## File path: hadoop-project-dist/pom.xml ## @@ -341,7 +340,6 @@ --openssllib=${openssl.lib} --opensslbinbundle=$

[GitHub] [hadoop] jbrennan333 commented on pull request #2204: YARN-10393. Make the heartbeat request from NM to RM consistent across heartbeat ID.

2020-09-29 Thread GitBox
jbrennan333 commented on pull request #2204: URL: https://github.com/apache/hadoop/pull/2204#issuecomment-701023714 See discussion and new patch in YARN-10393. Closing this original PR. This is an automated message fro

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492697&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492697 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r497093683 ## File path: hadoop-project-dist/pom.xml ## @@ -341,7 +340,6 @@ --openssllib=${openssl.lib} --opensslbinbundle=$

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492689&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492689 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r497078103 ## File path: hadoop-common-project/hadoop-common/src/main/native/native.vcxproj ## @@ -68,30 +68,13 @@ ..\..\..\target\native\$(Configuration)\ h

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492687&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492687 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
sunchao commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r497073278 ## File path: hadoop-common-project/hadoop-common/src/main/native/native.vcxproj ## @@ -68,30 +68,13 @@ ..\..\..\target\native\$(Configuration)\

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492682&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492682 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r497068326 ## File path: hadoop-common-project/hadoop-common/src/main/native/native.vcxproj ## @@ -68,30 +68,13 @@ ..\..\..\target\native\$(Configuration)\ h

[jira] [Updated] (HADOOP-17284) Support BCFKS keystores for Hadoop Credential Provider

2020-09-29 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-17284: Attachment: HADOOP-17284.002.patch > Support BCFKS keystores for Hadoop Credential Provider > ---

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492648&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492648 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] saintstack commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
saintstack commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-700960375 > happy with that? Thanks @steveloughran If I understand you correctly, because you figured we actually already include snappy-java and that snappy is already a hadoop-c

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492645&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492645 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
sunchao commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r497009027 ## File path: hadoop-common-project/hadoop-common/src/main/native/native.vcxproj ## @@ -68,30 +68,13 @@ ..\..\..\target\native\$(Configuration)\

[jira] [Work logged] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?focusedWorklogId=492638&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492638 ] ASF GitHub Bot logged work on HADOOP-17292: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #2350: HADOOP-17292. Using lz4-java in Lz4Codec

2020-09-29 Thread GitBox
viirya commented on a change in pull request #2350: URL: https://github.com/apache/hadoop/pull/2350#discussion_r497004500 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/CompressDecompressTester.java ## @@ -494,8 +494,7 @@ public S

[jira] [Work logged] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?focusedWorklogId=492637&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492637 ] ASF GitHub Bot logged work on HADOOP-17292: --- Author: ASF GitHub B

[GitHub] [hadoop] dbtsai commented on a change in pull request #2350: HADOOP-17292. Using lz4-java in Lz4Codec

2020-09-29 Thread GitBox
dbtsai commented on a change in pull request #2350: URL: https://github.com/apache/hadoop/pull/2350#discussion_r49626 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/lz4/Lz4Compressor.java ## @@ -236,7 +237,7 @@ public synchron

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492635&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492635 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r496997774 ## File path: hadoop-common-project/hadoop-common/src/main/native/native.vcxproj ## @@ -68,30 +68,13 @@ ..\..\..\target\native\$(Configuration)\ h

[jira] [Work logged] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?focusedWorklogId=492632&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492632 ] ASF GitHub Bot logged work on HADOOP-17292: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on pull request #2350: HADOOP-17292. Using lz4-java in Lz4Codec

2020-09-29 Thread GitBox
viirya commented on pull request #2350: URL: https://github.com/apache/hadoop/pull/2350#issuecomment-700934519 cc @dbtsai @sunchao This is an automated message from the Apache Git Service. To respond to the message, please l

[jira] [Updated] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17292: Labels: pull-request-available (was: ) > Using lz4-java in Lz4Codec > --

[jira] [Work logged] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?focusedWorklogId=492628&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492628 ] ASF GitHub Bot logged work on HADOOP-17292: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya opened a new pull request #2350: HADOOP-17292. Using snappy-java in Lz4Codec

2020-09-29 Thread GitBox
viirya opened a new pull request #2350: URL: https://github.com/apache/hadoop/pull/2350 See https://issues.apache.org/jira/browse/HADOOP-17292 for details. This is an automated message from the Apache Git Service. To respond

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492626&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492626 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
sunchao commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-700927518 > bad: doesn't work so well if things (hadoop-client?) shade the snappy jar references. Since this dependency is new, as long we make sure it is not shaded in the client m

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492625&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492625 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
sunchao commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r496960563 ## File path: hadoop-common-project/hadoop-common/src/main/native/native.vcxproj ## @@ -68,30 +68,13 @@ ..\..\..\target\native\$(Configuration)\

[jira] [Updated] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-09-29 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated HADOOP-17292: - Description: In Hadoop, we use native libs for lz4 codec which has several disadvantages: It r

[jira] [Created] (HADOOP-17292) Using lz4-java in Lz4Codec

2020-09-29 Thread L. C. Hsieh (Jira)
L. C. Hsieh created HADOOP-17292: Summary: Using lz4-java in Lz4Codec Key: HADOOP-17292 URL: https://issues.apache.org/jira/browse/HADOOP-17292 Project: Hadoop Common Issue Type: New Feature

[GitHub] [hadoop] jbrennan333 commented on a change in pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-09-29 Thread GitBox
jbrennan333 commented on a change in pull request #2349: URL: https://github.com/apache/hadoop/pull/2349#discussion_r496954586 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCom

[jira] [Commented] (HADOOP-17280) Service-user cost shouldn't be accumulated to totalDecayedCallCost and totalRawCallCost.

2020-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204183#comment-17204183 ] Hadoop QA commented on HADOOP-17280: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Work logged] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?focusedWorklogId=492573&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492573 ] ASF GitHub Bot logged work on HADOOP-16794: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #1875: HADOOP-16794. S3A reverts KMS encryption to the bucket's default KMS …

2020-09-29 Thread GitBox
steveloughran commented on pull request #1875: URL: https://github.com/apache/hadoop/pull/1875#issuecomment-700862736 3.2 and 3.3 have diverged so much in s3a. I tried a bit of a backport and gave up. Now, internally, CDH 7/CDP is built on the 3.1+ codebase, with much of the s3a cha

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=492567&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492567 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-29 Thread GitBox
steveloughran commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-700859880 Having checked up on those dependencies myself, yes, we are already shipping snappy-java 1.0.5 as a dependency of hadoop-common, by way of avro. Which makes a strong case f

[GitHub] [hadoop] steveloughran opened a new pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2020-09-29 Thread GitBox
steveloughran opened a new pull request #2349: URL: https://github.com/apache/hadoop/pull/2349 * Default to v1 commit algorithm * log at WARN on job set up when v2 is used * use a special log for that so people who know what they are doing can tell it to be quiet ---

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=492549&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492549 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-09-29 Thread GitBox
steveloughran commented on pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#issuecomment-700834358 made slightly less "clean" by retaining use of S3AInstrumentation and implementation classes in some places. Less of a switch to the interfaces, but let's be honest: except

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-09-29 Thread GitBox
hadoop-yetus removed a comment on pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#issuecomment-696850402 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=492545&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492545 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=492544&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492544 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=492543&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492543 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-09-29 Thread GitBox
hadoop-yetus removed a comment on pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#issuecomment-697395565 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-09-29 Thread GitBox
hadoop-yetus removed a comment on pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#issuecomment-696415310 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec |

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=492542&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492542 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-09-29 Thread GitBox
steveloughran commented on a change in pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#discussion_r496880269 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/statistics/impl/IOStatisticsStoreImpl.java ## @@ -0,0 +1,424 @@

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=492539&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492539 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-09-29 Thread GitBox
steveloughran commented on a change in pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#discussion_r496866549 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/statistics/impl/IOStatisticsStoreImpl.java ## @@ -0,0 +1,424 @@

[GitHub] [hadoop] aajisaka commented on pull request #2348: [WIP] Use asf-ci token for GitHub.

2020-09-29 Thread GitBox
aajisaka commented on pull request #2348: URL: https://github.com/apache/hadoop/pull/2348#issuecomment-700806043 Jenkins can add commit statuses successfully. I think that's okay. I hope Yetus will be able to add commit status as well. (it's better) -

[jira] [Commented] (HADOOP-17241) s3a: bucket names which aren't parseable hostnames unsupported

2020-09-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204041#comment-17204041 ] Steve Loughran commented on HADOOP-17241: - bq. going forward s3a support for b

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=492504&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492504 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-09-29 Thread GitBox
steveloughran commented on pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#issuecomment-700777072 Update: you will get the ability to wrap a Callable, CallableRaisingIOE or functionRaisingIOE with a duration tracking, which then returns a new instance of the same

[GitHub] [hadoop] steveloughran closed pull request #2320: MAPREDUCE-7282: remove v2 commit algorithm for correctness reasons.

2020-09-29 Thread GitBox
steveloughran closed pull request #2320: URL: https://github.com/apache/hadoop/pull/2320 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Resolved] (HADOOP-17267) Add debug-level logs in Filesystem#close

2020-09-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17267. - Fix Version/s: 3.3.1 Resolution: Fixed +1, merged to trunk. Thanks! > Add debug

[jira] [Work logged] (HADOOP-17267) Add debug-level logs in Filesystem#close

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17267?focusedWorklogId=492501&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492501 ] ASF GitHub Bot logged work on HADOOP-17267: --- Author: ASF GitHub B

[GitHub] [hadoop] klcopp commented on pull request #2321: HADOOP-17267: Add debug-level logs in Filesystem#close

2020-09-29 Thread GitBox
klcopp commented on pull request #2321: URL: https://github.com/apache/hadoop/pull/2321#issuecomment-700770054 Sweet, thanks! This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Work logged] (HADOOP-17267) Add debug-level logs in Filesystem#close

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17267?focusedWorklogId=492500&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492500 ] ASF GitHub Bot logged work on HADOOP-17267: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran merged pull request #2321: HADOOP-17267: Add debug-level logs in Filesystem#close

2020-09-29 Thread GitBox
steveloughran merged pull request #2321: URL: https://github.com/apache/hadoop/pull/2321 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Work logged] (HADOOP-17267) Add debug-level logs in Filesystem#close

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17267?focusedWorklogId=492498&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492498 ] ASF GitHub Bot logged work on HADOOP-17267: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2321: HADOOP-17267: Add debug-level logs in Filesystem#close

2020-09-29 Thread GitBox
steveloughran commented on pull request #2321: URL: https://github.com/apache/hadoop/pull/2321#issuecomment-700767946 we could go round in circles worrying about nuances here. Key thing: better insight into when FS instances were closed can help debug some issues, and while there are now a

[jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=492495&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492495 ] ASF GitHub Bot logged work on HADOOP-17242: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2273: HADOOP-17242. S3A ObjectListingIterator to block in hasNext() for results

2020-09-29 Thread GitBox
hadoop-yetus removed a comment on pull request #2273: URL: https://github.com/apache/hadoop/pull/2273#issuecomment-687234185 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec |

[jira] [Commented] (HADOOP-17280) Service-user cost shouldn't be accumulated to totalDecayedCallCost and totalRawCallCost.

2020-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204004#comment-17204004 ] Jinglun commented on HADOOP-17280: -- Hi [~tasanuma], thanks your explanation ! Fix it a

[jira] [Updated] (HADOOP-17280) Service-user cost shouldn't be accumulated to totalDecayedCallCost and totalRawCallCost.

2020-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HADOOP-17280: - Attachment: HADOOP-17280.006.patch > Service-user cost shouldn't be accumulated to totalDecayedCallCost

[jira] [Updated] (HADOOP-17291) Variable url is declared twice in github_finalreport function

2020-09-29 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17291: --- Labels: newbie (was: ) > Variable url is declared twice in github_finalreport function > -

[jira] [Created] (HADOOP-17291) Variable url is declared twice in github_finalreport function

2020-09-29 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17291: -- Summary: Variable url is declared twice in github_finalreport function Key: HADOOP-17291 URL: https://issues.apache.org/jira/browse/HADOOP-17291 Project: Hadoop C

[jira] [Commented] (HADOOP-17288) Use shaded guava from thirdparty

2020-09-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203973#comment-17203973 ] Ayush Saxena commented on HADOOP-17288: --- Thanx [~weichiu] for following this up.

[jira] [Updated] (HADOOP-16924) Shade & Update guava version to 29.0-jre

2020-09-29 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16924: --- Summary: Shade & Update guava version to 29.0-jre (was: Shade & Update guava version to 28

[jira] [Work logged] (HADOOP-17288) Use shaded guava from thirdparty

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?focusedWorklogId=492481&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492481 ] ASF GitHub Bot logged work on HADOOP-17288: --- Author: ASF GitHub B

[GitHub] [hadoop] ayushtkn commented on pull request #2342: HADOOP-17288. Use shaded guava from thirdparty.

2020-09-29 Thread GitBox
ayushtkn commented on pull request #2342: URL: https://github.com/apache/hadoop/pull/2342#issuecomment-700733022 The Jenkins result https://ci-hadoop.apache.org/view/Hadoop/job/hadoop-multibranch/view/change-requests/job/PR-2342/2/ --

[GitHub] [hadoop] aajisaka merged pull request #2338: MAPREDUCE-7289. Fix wrong comment in LongLong.java

2020-09-29 Thread GitBox
aajisaka merged pull request #2338: URL: https://github.com/apache/hadoop/pull/2338 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

  1   2   >