[jira] [Commented] (HADOOP-17119) Jetty upgrade to 9.4.x causes MR app fail with IOException

2020-07-13 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157146#comment-17157146 ] Surendra Singh Lilhore commented on HADOOP-17119: - +1 for v2. > Jetty

[GitHub] [hadoop] snvijaya commented on pull request #2123: ABFS: Making AzureADAuthenticator.getToken() throw HttpException if a…

2020-07-13 Thread GitBox
snvijaya commented on pull request #2123: URL: https://github.com/apache/hadoop/pull/2123#issuecomment-657955245 Maybe track in different JIRA, but test/fixes to ensure token fetch code is identifying recoverable (i.e 'should retry') and non-recoverable scenarios correctly. non-recoverable

[jira] [Commented] (HADOOP-17099) Replace Guava Predicate with Java8+ Predicate

2020-07-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157092#comment-17157092 ] Hadoop QA commented on HADOOP-17099: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-17127) Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime

2020-07-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157045#comment-17157045 ] Hadoop QA commented on HADOOP-17127: | (/) *{color:green}+1 overall{color}* | \\ \\

[GitHub] [hadoop] hadoop-yetus commented on pull request #2083: HADOOP-17077. S3A delegation token binding to support secondary binding list

2020-07-13 Thread GitBox
hadoop-yetus commented on pull request #2083: URL: https://github.com/apache/hadoop/pull/2083#issuecomment-657892682 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 38

[GitHub] [hadoop] hadoop-yetus commented on pull request #2083: HADOOP-17077. S3A delegation token binding to support secondary binding list

2020-07-13 Thread GitBox
hadoop-yetus commented on pull request #2083: URL: https://github.com/apache/hadoop/pull/2083#issuecomment-657880743 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 29

[jira] [Commented] (HADOOP-17101) Replace Guava Function with Java8+ Function

2020-07-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157031#comment-17157031 ] Hadoop QA commented on HADOOP-17101: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Updated] (HADOOP-17127) Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HADOOP-17127: - Attachment: HADOOP-17127.001.patch > Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and pr

[jira] [Updated] (HADOOP-17127) Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HADOOP-17127: - Status: Patch Available (was: Open) > Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and

[jira] [Created] (HADOOP-17127) Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime

2020-07-13 Thread Jim Brennan (Jira)
Jim Brennan created HADOOP-17127: Summary: Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime Key: HADOOP-17127 URL: https://issues.apache.org/jira/browse/HADOOP-17127 Project: Had

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-07-13 Thread GitBox
hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-657806727 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 25m 18

[jira] [Created] (HADOOP-17126) implement non-guava Precondition checkNotNull

2020-07-13 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17126: -- Summary: implement non-guava Precondition checkNotNull Key: HADOOP-17126 URL: https://issues.apache.org/jira/browse/HADOOP-17126 Project: Hadoop Common I

[jira] [Updated] (HADOOP-17116) Skip Retry INFO logging on first failover from a proxy

2020-07-13 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HADOOP-17116: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Ava

[jira] [Updated] (HADOOP-17099) Replace Guava Predicate with Java8+ Predicate

2020-07-13 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17099: --- Attachment: HADOOP-17099.004.patch > Replace Guava Predicate with Java8+ Predicate > --

[GitHub] [hadoop] steveloughran commented on a change in pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-07-13 Thread GitBox
steveloughran commented on a change in pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#discussion_r453910200 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @@ -4181,79 +4181,114 @@ public LocatedFileStatus

[jira] [Commented] (HADOOP-17116) Skip Retry INFO logging on first failover from a proxy

2020-07-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156956#comment-17156956 ] Hudson commented on HADOOP-17116: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] steveloughran commented on a change in pull request #2134: HADOOP-17123. remove guava Preconditions from Hadoop-common module

2020-07-13 Thread GitBox
steveloughran commented on a change in pull request #2134: URL: https://github.com/apache/hadoop/pull/2134#discussion_r453902358 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/noguava/Preconditions.java ## @@ -0,0 +1,138 @@ +/** + * Lice

[GitHub] [hadoop] steveloughran closed pull request #2137: Branch1

2020-07-13 Thread GitBox
steveloughran closed pull request #2137: URL: https://github.com/apache/hadoop/pull/2137 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop] steveloughran commented on a change in pull request #2046: HADOOP-16202 Enhance S3A openFile()

2020-07-13 Thread GitBox
steveloughran commented on a change in pull request #2046: URL: https://github.com/apache/hadoop/pull/2046#discussion_r453894382 ## File path: hadoop-common-project/hadoop-common/src/site/markdown/filesystem/fsdatainputstreambuilder.md ## @@ -68,6 +68,11 @@ This is relevant wi

[jira] [Commented] (HADOOP-17116) Skip Retry INFO logging on first failover from a proxy

2020-07-13 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156934#comment-17156934 ] Hanisha Koneru commented on HADOOP-17116: - Thanks [~arp] and [~ayushtkn] for th

[GitHub] [hadoop] hadoop-yetus commented on pull request #2137: Branch1

2020-07-13 Thread GitBox
hadoop-yetus commented on pull request #2137: URL: https://github.com/apache/hadoop/pull/2137#issuecomment-657750934 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 21m 31

[jira] [Commented] (HADOOP-17105) S3AFS globStatus attempts to resolve symlinks

2020-07-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156913#comment-17156913 ] Hudson commented on HADOOP-17105: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Updated] (HADOOP-17101) Replace Guava Function with Java8+ Function

2020-07-13 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17101: --- Attachment: HADOOP-17101.005.patch > Replace Guava Function with Java8+ Function >

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-07-13 Thread GitBox
hadoop-yetus removed a comment on pull request #1679: URL: https://github.com/apache/hadoop/pull/1679#issuecomment-639598730 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-07-13 Thread GitBox
hadoop-yetus removed a comment on pull request #1679: URL: https://github.com/apache/hadoop/pull/1679#issuecomment-638998521 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Resolved] (HADOOP-17105) S3AFS globStatus attempts to resolve symlinks

2020-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17105. - Fix Version/s: 3.3.1 Resolution: Fixed patch merged to 3.3 and trunk branches. T

[jira] [Assigned] (HADOOP-17105) S3AFS globStatus attempts to resolve symlinks

2020-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17105: --- Assignee: Jimmy Zuber > S3AFS globStatus attempts to resolve symlinks > --

[GitHub] [hadoop] steveloughran commented on pull request #2113: HADOOP-17105: S3AFS - Do not attempt to resolve symlinks in globStatus

2020-07-13 Thread GitBox
steveloughran commented on pull request #2113: URL: https://github.com/apache/hadoop/pull/2113#issuecomment-657709962 +1 -merged to trunk. nice catch This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] steveloughran merged pull request #2113: HADOOP-17105: S3AFS - Do not attempt to resolve symlinks in globStatus

2020-07-13 Thread GitBox
steveloughran merged pull request #2113: URL: https://github.com/apache/hadoop/pull/2113 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-657693238 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
GauthamBanasandra commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-657676757 @aajisaka I've rebased and addressed the comments. This is an automated message from the Apache Git Ser

[GitHub] [hadoop] GauthamBanasandra commented on a change in pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
GauthamBanasandra commented on a change in pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#discussion_r453794706 ## File path: dev-support/docker/Dockerfile ## @@ -84,6 +84,16 @@ RUN apt-get -q update \ && apt-get clean \ && rm -rf /var/lib/apt/lis

[GitHub] [hadoop] hadoop-yetus commented on pull request #2136: MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails

2020-07-13 Thread GitBox
hadoop-yetus commented on pull request #2136: URL: https://github.com/apache/hadoop/pull/2136#issuecomment-657675085 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31

[jira] [Commented] (HADOOP-17101) Replace Guava Function with Java8+ Function

2020-07-13 Thread Jonathan Turner Eagles (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156839#comment-17156839 ] Jonathan Turner Eagles commented on HADOOP-17101: - Let's make the Multi

[GitHub] [hadoop] pranshukk33 opened a new pull request #2137: Branch1

2020-07-13 Thread GitBox
pranshukk33 opened a new pull request #2137: URL: https://github.com/apache/hadoop/pull/2137 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[GitHub] [hadoop] GauthamBanasandra commented on a change in pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
GauthamBanasandra commented on a change in pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#discussion_r453722394 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/main/native/src/util/StringUtil.cc ## @@ -

[GitHub] [hadoop] steveloughran closed pull request #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-07-13 Thread GitBox
steveloughran closed pull request #1679: URL: https://github.com/apache/hadoop/pull/1679 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop] steveloughran commented on pull request #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-07-13 Thread GitBox
steveloughran commented on pull request #1679: URL: https://github.com/apache/hadoop/pull/1679#issuecomment-657531015 thanks! This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] snvijaya commented on a change in pull request #2123: ABFS: Making AzureADAuthenticator.getToken() throw HttpException if a…

2020-07-13 Thread GitBox
snvijaya commented on a change in pull request #2123: URL: https://github.com/apache/hadoop/pull/2123#discussion_r453584579 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/oauth2/AzureADAuthenticator.java ## @@ -77,11 +77,14 @@ private Azure

[GitHub] [hadoop] aajisaka opened a new pull request #2136: MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails

2020-07-13 Thread GitBox
aajisaka opened a new pull request #2136: URL: https://github.com/apache/hadoop/pull/2136 JIRA: https://issues.apache.org/jira/browse/MAPREDUCE-7284 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] aajisaka edited a comment on pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
aajisaka edited a comment on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-657416339 Hi @GauthamBanasandra Thank you for your update. The patch mostly looks good. Would you rebase for the latest trunk and address the above comments from me? I'm

[GitHub] [hadoop] aajisaka edited a comment on pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
aajisaka edited a comment on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-657416339 Hi @GauthamBanasandra Thank you for your update. The patch mostly looks good. Would you rebase to the latest trunk and address the above comments from me? I'm +

[GitHub] [hadoop] aajisaka commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
aajisaka commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-657416339 Hi @GauthamBanasandra Thank you for your update. The patch mostly looks good. Would you rebase the latest patch and address the above comments from me? I'm +1 those ar

[GitHub] [hadoop] aajisaka commented on a change in pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
aajisaka commented on a change in pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#discussion_r453490640 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/main/native/src/util/StringUtil.cc ## @@ -36,19 +36

[GitHub] [hadoop] aajisaka commented on a change in pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
aajisaka commented on a change in pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#discussion_r453490640 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/main/native/src/util/StringUtil.cc ## @@ -36,19 +36

[jira] [Updated] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-07-13 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated HADOOP-17125: - Description: In Hadoop, we use native libs for snappy codec which has several disadvantages: * It requ

[GitHub] [hadoop] aajisaka commented on a change in pull request #2051: HDFS-15385 Upgrade boost library

2020-07-13 Thread GitBox
aajisaka commented on a change in pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#discussion_r453468716 ## File path: dev-support/docker/Dockerfile ## @@ -84,6 +84,16 @@ RUN apt-get -q update \ && apt-get clean \ && rm -rf /var/lib/apt/lists/* +#