[GitHub] [hadoop] aajisaka commented on pull request #2049: HADOOP-17062. Fix shelldocs path in Jenkinsfile

2020-06-02 Thread GitBox
aajisaka commented on pull request #2049: URL: https://github.com/apache/hadoop/pull/2049#issuecomment-637996103 Looks good https://builds.apache.org/job/hadoop-multibranch/job/PR-2049/1/console ``` 15:49:29 ===

[jira] [Updated] (HADOOP-17062) Fix "shelldocs was not available" warning in the precommit job

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17062: --- Status: Patch Available (was: Open) > Fix "shelldocs was not available" warning in the pre

[GitHub] [hadoop] aajisaka opened a new pull request #2049: HADOOP-17062. Fix shelldocs path in Jenkinsfile

2020-06-02 Thread GitBox
aajisaka opened a new pull request #2049: URL: https://github.com/apache/hadoop/pull/2049 JIRA: https://issues.apache.org/jira/browse/HADOOP-17062 If this PR is merged. I'll update the config in the PreCommit-(HADOOP|HDFS|MAPREDUCE|YARN)-Build Jenkins jobs.

[GitHub] [hadoop] abhishekdas99 commented on a change in pull request #2019: HADOOP-17029. Return correct permission and owner for listing on internal directories in ViewFs

2020-06-02 Thread GitBox
abhishekdas99 commented on a change in pull request #2019: URL: https://github.com/apache/hadoop/pull/2019#discussion_r434341316 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -1211,13 +1211,29 @@ public Fi

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124649#comment-17124649 ] Ayush Saxena commented on HADOOP-17056: --- Thanx [~aajisaka] for fixing this. Seems

[GitHub] [hadoop] abhishekdas99 commented on a change in pull request #2019: HADOOP-17029. Return correct permission and owner for listing on internal directories in ViewFs

2020-06-02 Thread GitBox
abhishekdas99 commented on a change in pull request #2019: URL: https://github.com/apache/hadoop/pull/2019#discussion_r434340756 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -1211,13 +1211,29 @@ public Fi

[jira] [Assigned] (HADOOP-17062) Fix "shelldocs was not available" warning in the precommit job

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-17062: -- Assignee: Akira Ajisaka > Fix "shelldocs was not available" warning in the precommit

[jira] [Updated] (HADOOP-17062) Fix "shelldocs was not available" warning in the precommit job

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17062: --- Description: Shelldocs check is not enabled in the precommit jobs. |{color:#FF}0{color}

[GitHub] [hadoop] aajisaka commented on pull request #2045: HADOOP-17056. shelldoc fails in hadoop-common.

2020-06-02 Thread GitBox
aajisaka commented on pull request #2045: URL: https://github.com/apache/hadoop/pull/2045#issuecomment-637986272 Filed https://issues.apache.org/jira/browse/HADOOP-17062 for tracking the issue. This is an automated message f

[jira] [Created] (HADOOP-17062) Fix "shelldocs was not available" warning in the precommit job

2020-06-02 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17062: -- Summary: Fix "shelldocs was not available" warning in the precommit job Key: HADOOP-17062 URL: https://issues.apache.org/jira/browse/HADOOP-17062 Project: Hadoop

[GitHub] [hadoop] hadoop-yetus commented on pull request #2019: HADOOP-17029. Return correct permission and owner for listing on internal directories in ViewFs

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2019: URL: https://github.com/apache/hadoop/pull/2019#issuecomment-637981990 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 0

[jira] [Comment Edited] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124629#comment-17124629 ] Akira Ajisaka edited comment on HADOOP-17056 at 6/3/20, 6:11 AM:

[GitHub] [hadoop] aajisaka edited a comment on pull request #2045: HADOOP-17056. shelldoc fails in hadoop-common.

2020-06-02 Thread GitBox
aajisaka edited a comment on pull request #2045: URL: https://github.com/apache/hadoop/pull/2045#issuecomment-637974532 Thank @iwasakims for your comment. I think this output is not related to the patch. The warning has been there since at least May. Ref: * https://github.com/a

[GitHub] [hadoop] aajisaka commented on pull request #2045: HADOOP-17056. shelldoc fails in hadoop-common.

2020-06-02 Thread GitBox
aajisaka commented on pull request #2045: URL: https://github.com/apache/hadoop/pull/2045#issuecomment-637974532 Thank @iwasakims for your comment. I think this output is not related to the patch. The warning has been there since at least May https://github.com/apache/hadoop/pull/18

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124630#comment-17124630 ] Akira Ajisaka commented on HADOOP-17056: bq. +1 mvnsite 17m 59s the patch pass

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124629#comment-17124629 ] Akira Ajisaka commented on HADOOP-17056: Deleted the output of #16962 precommit

[jira] [Issue Comment Deleted] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17056: --- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsyste

[jira] [Assigned] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-17056: -- Assignee: Akira Ajisaka > shelldoc fails in hadoop-common >

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

2020-06-02 Thread GitBox
vinayakumarb commented on a change in pull request #2026: URL: https://github.com/apache/hadoop/pull/2026#discussion_r434322138 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java ## @@ -1295,6 +1296,22 @@ static URI trimUri(URI uri)

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

2020-06-02 Thread GitBox
vinayakumarb commented on a change in pull request #2026: URL: https://github.com/apache/hadoop/pull/2026#discussion_r434320866 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/ProtobufRpcEngineCallback.java ## @@ -18,7 +18,7 @@ package

[GitHub] [hadoop] abhishekdas99 commented on a change in pull request #2019: HADOOP-17029. Return correct permission and owner for listing on internal directories in ViewFs

2020-06-02 Thread GitBox
abhishekdas99 commented on a change in pull request #2019: URL: https://github.com/apache/hadoop/pull/2019#discussion_r434320447 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestViewfsFileStatus.java ## @@ -56,38 +69,71 @@ public

[GitHub] [hadoop] abhishekdas99 commented on a change in pull request #2019: HADOOP-17029. Return correct permission and owner for listing on internal directories in ViewFs

2020-06-02 Thread GitBox
abhishekdas99 commented on a change in pull request #2019: URL: https://github.com/apache/hadoop/pull/2019#discussion_r434320391 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -1211,13 +1211,29 @@ public Fi

[jira] [Comment Edited] (HADOOP-17029) ViewFS does not return correct user/group and ACL

2020-06-02 Thread Abhishek Das (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124612#comment-17124612 ] Abhishek Das edited comment on HADOOP-17029 at 6/3/20, 5:37 AM: -

[jira] [Commented] (HADOOP-17029) ViewFS does not return correct user/group and ACL

2020-06-02 Thread Abhishek Das (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124612#comment-17124612 ] Abhishek Das commented on HADOOP-17029: --- Sorry [~umamaheswararao] for responding

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2020-06-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124595#comment-17124595 ] Xiaoqiao He commented on HADOOP-16254: -- [~John Smith] Sure, you are correct. `prox

[GitHub] [hadoop] mehakmeet commented on a change in pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-06-02 Thread GitBox
mehakmeet commented on a change in pull request #1991: URL: https://github.com/apache/hadoop/pull/1991#discussion_r434262848 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsStatistics.java ## @@ -202,16 +182,13 @@ public void testOp

[GitHub] [hadoop] billonahill commented on pull request #2044: YARN-10302. Make FairScheduler node comparator configurable

2020-06-02 Thread GitBox
billonahill commented on pull request #2044: URL: https://github.com/apache/hadoop/pull/2044#issuecomment-637882580 Regarding the test4tests failure, this patch preserves backward compatibility and effects lines of code already tested, hence no new tests are added. It seems like all

[GitHub] [hadoop] hadoop-yetus commented on pull request #2044: YARN-10302. Make FairScheduler node comparator configurable

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2044: URL: https://github.com/apache/hadoop/pull/2044#issuecomment-637879984 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 22m 45

[GitHub] [hadoop] hadoop-yetus commented on pull request #2047: HDFS-15383 Add support for router delegation token without watch

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2047: URL: https://github.com/apache/hadoop/pull/2047#issuecomment-637873886 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 27

[GitHub] [hadoop] hadoop-yetus commented on pull request #2048: HADOOP-17061. Fix broken links in AWS documentation.

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2048: URL: https://github.com/apache/hadoop/pull/2048#issuecomment-637849344 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 4

[jira] [Created] (HADOOP-17061) Fix broken links in AWS documentation

2020-06-02 Thread Jeremie Piotte (Jira)
Jeremie Piotte created HADOOP-17061: --- Summary: Fix broken links in AWS documentation Key: HADOOP-17061 URL: https://issues.apache.org/jira/browse/HADOOP-17061 Project: Hadoop Common Issue T

[GitHub] [hadoop] piotte13 opened a new pull request #2048: HADOOP-17061. Fix broken links in AWS documentation.

2020-06-02 Thread GitBox
piotte13 opened a new pull request #2048: URL: https://github.com/apache/hadoop/pull/2048 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-06-02 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124316#comment-17124316 ] Fengnan Li commented on HADOOP-16828: - [~xyao] Thanks very much for the review and

[GitHub] [hadoop] fengnanli opened a new pull request #2047: Add support for router delegation token without watch

2020-06-02 Thread GitBox
fengnanli opened a new pull request #2047: URL: https://github.com/apache/hadoop/pull/2047 Summary: This patch is targeting improving router's performance for delegation tokens related operations. It achieves the goal by removing watchers from router on tokens since based on our

[GitHub] [hadoop] hadoop-yetus commented on pull request #2041: HDFS-15321. Make DFSAdmin tool to work with ViewFileSystemOverloadScheme

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2041: URL: https://github.com/apache/hadoop/pull/2041#issuecomment-637803389 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 23m 54

[GitHub] [hadoop] goiri commented on a change in pull request #2035: HDFS-15374. Add documentation for command `fedbalance`.

2020-06-02 Thread GitBox
goiri commented on a change in pull request #2035: URL: https://github.com/apache/hadoop/pull/2035#discussion_r434157276 ## File path: hadoop-tools/hadoop-federation-balance/src/site/markdown/FederationBalance.md ## @@ -0,0 +1,177 @@ + + +Federation Balance Guide +

[GitHub] [hadoop] goiri commented on a change in pull request #2035: HDFS-15374. Add documentation for command `fedbalance`.

2020-06-02 Thread GitBox
goiri commented on a change in pull request #2035: URL: https://github.com/apache/hadoop/pull/2035#discussion_r434154368 ## File path: hadoop-tools/hadoop-federation-balance/src/site/markdown/FederationBalance.md ## @@ -0,0 +1,156 @@ + + +Federation Balance Guide +

[GitHub] [hadoop] goiri commented on a change in pull request #2035: HDFS-15374. Add documentation for command `fedbalance`.

2020-06-02 Thread GitBox
goiri commented on a change in pull request #2035: URL: https://github.com/apache/hadoop/pull/2035#discussion_r434154368 ## File path: hadoop-tools/hadoop-federation-balance/src/site/markdown/FederationBalance.md ## @@ -0,0 +1,156 @@ + + +Federation Balance Guide +

[jira] [Commented] (HADOOP-15167) [viewfs] ls will fail when user doesn't exist

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124258#comment-17124258 ] Hadoop QA commented on HADOOP-15167: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-06-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124241#comment-17124241 ] Hudson commented on HADOOP-16828: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Updated] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-06-02 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-16828: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resol

[jira] [Commented] (HADOOP-17029) ViewFS does not return correct user/group and ACL

2020-06-02 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124220#comment-17124220 ] Uma Maheswara Rao G commented on HADOOP-17029: -- Hey [~abhishekd], HADOOP-1

[jira] [Commented] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-06-02 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124208#comment-17124208 ] Xiaoyu Yao commented on HADOOP-16828: - Patch v2 LGTM, +1. I will merge it shortly.

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-06-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124202#comment-17124202 ] Mingliang Liu commented on HADOOP-17047: {quote} In summary, should I change th

[GitHub] [hadoop] hadoop-yetus commented on pull request #2046: HADOOP-16202 Enhance S3A openFile()

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2046: URL: https://github.com/apache/hadoop/pull/2046#issuecomment-637726275 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27

[GitHub] [hadoop] umamaheswararao merged pull request #2041: HDFS-15321. Make DFSAdmin tool to work with ViewFileSystemOverloadScheme

2020-06-02 Thread GitBox
umamaheswararao merged pull request #2041: URL: https://github.com/apache/hadoop/pull/2041 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] umamaheswararao commented on pull request #2041: HDFS-15321. Make DFSAdmin tool to work with ViewFileSystemOverloadScheme

2020-06-02 Thread GitBox
umamaheswararao commented on pull request #2041: URL: https://github.com/apache/hadoop/pull/2041#issuecomment-637715880 Thank you @rakeshadr for the reviews! This is an automated message from the Apache Git Service. To respon

[GitHub] [hadoop] rakeshadr commented on pull request #2041: HDFS-15321. Make DFSAdmin tool to work with ViewFileSystemOverloadScheme

2020-06-02 Thread GitBox
rakeshadr commented on pull request #2041: URL: https://github.com/apache/hadoop/pull/2041#issuecomment-637713458 Thanks @umamaheswararao for the contribution. Unit tests are really good. +1 LGTM This is an automated m

[GitHub] [hadoop] umamaheswararao commented on pull request #2041: HDFS-15321. Make DFSAdmin tool to work with ViewFileSystemOverloadScheme

2020-06-02 Thread GitBox
umamaheswararao commented on pull request #2041: URL: https://github.com/apache/hadoop/pull/2041#issuecomment-637712010 Test failures are unrelated to this change. This is an automated message from the Apache Git Service. To

[jira] [Moved] (HADOOP-17060) listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-02 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G moved HDFS-15370 to HADOOP-17060: - Component/s: (was: hdfs)

[jira] [Commented] (HADOOP-17016) Adding Common Counters in ABFS

2020-06-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124137#comment-17124137 ] Hudson commented on HADOOP-17016: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Commented] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124133#comment-17124133 ] Ayush Saxena commented on HADOOP-17059: --- Seems problem with user name as well, As

[jira] [Resolved] (HADOOP-17016) Adding Common Counters in ABFS

2020-06-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17016. - Fix Version/s: 3.4.0 Resolution: Fixed +1, merged to trunk if you want it in br

[GitHub] [hadoop] steveloughran commented on pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-06-02 Thread GitBox
steveloughran commented on pull request #1991: URL: https://github.com/apache/hadoop/pull/1991#issuecomment-637698439 merged to trunk This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] steveloughran closed pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-06-02 Thread GitBox
steveloughran closed pull request #1991: URL: https://github.com/apache/hadoop/pull/1991 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop] steveloughran commented on pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-06-02 Thread GitBox
steveloughran commented on pull request #1991: URL: https://github.com/apache/hadoop/pull/1991#issuecomment-637696461 Ok, all is good. I'd point you at ContractTestUtils for future rename/exists checks in tests, as it has better error reporting. +1

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-06-02 Thread GitBox
hadoop-yetus removed a comment on pull request #1991: URL: https://github.com/apache/hadoop/pull/1991#issuecomment-630766152 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] steveloughran commented on a change in pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-06-02 Thread GitBox
steveloughran commented on a change in pull request #1991: URL: https://github.com/apache/hadoop/pull/1991#discussion_r434046740 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsStatistics.java ## @@ -202,16 +182,13 @@ public void te

[jira] [Updated] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-02 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HADOOP-17059: --- Description: In Viewfilesystem#listStatus , we get groupnames of ugi , If groupnames doesn'

[jira] [Created] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-02 Thread hemanthboyina (Jira)
hemanthboyina created HADOOP-17059: -- Summary: ArrayIndexOfboundsException in ViewFileSystem#listStatus Key: HADOOP-17059 URL: https://issues.apache.org/jira/browse/HADOOP-17059 Project: Hadoop Common

[GitHub] [hadoop] steveloughran opened a new pull request #2046: HADOOP-16202 Enhance S3A openFile()

2020-06-02 Thread GitBox
steveloughran opened a new pull request #2046: URL: https://github.com/apache/hadoop/pull/2046 * s3a fs will use any FileStatus passed in to openFile...needed for mount/wrapped FS * and supports an option "fs.s3a.open.option.length" to set the length -which will also trigger the HEAD be

[jira] [Updated] (HADOOP-16202) S3A openFile() operation to support explicit length parameter

2020-06-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Description: The {{openFile()}} builder API lets us add new options when reading a file

[GitHub] [hadoop] hadoop-yetus commented on pull request #1999: HADOOP-14566. Add seek support for SFTP FileSystem.

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #1999: URL: https://github.com/apache/hadoop/pull/1999#issuecomment-637645991 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 3

[jira] [Updated] (HADOOP-16202) S3A openFile() operation to support explicit length parameter

2020-06-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Summary: S3A openFile() operation to support explicit length parameter (was: S3A openFil

[GitHub] [hadoop] hadoop-yetus commented on pull request #1441: HADOOP-16568. S3A FullCredentialsTokenBinding fails if local credentials are unset

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #1441: URL: https://github.com/apache/hadoop/pull/1441#issuecomment-637578388 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 19

[GitHub] [hadoop] hadoop-yetus commented on pull request #1041: HADOOP-15844. Tag S3GuardTool entry points as LimitedPrivate/Evolving

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #1041: URL: https://github.com/apache/hadoop/pull/1041#issuecomment-637574752 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 8

[GitHub] [hadoop] hadoop-yetus commented on pull request #1963: HADOOP-16798. S3A Committer thread pool shutdown problems.

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #1963: URL: https://github.com/apache/hadoop/pull/1963#issuecomment-637572452 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 20m 5

[GitHub] [hadoop] mpryahin commented on a change in pull request #1999: HADOOP-14566. Add seek support for SFTP FileSystem.

2020-06-02 Thread GitBox
mpryahin commented on a change in pull request #1999: URL: https://github.com/apache/hadoop/pull/1999#discussion_r433891389 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractFSContract.java ## @@ -69,6 +69,14 @@ public void i

[GitHub] [hadoop] steveloughran commented on a change in pull request #1999: HADOOP-14566. Add seek support for SFTP FileSystem.

2020-06-02 Thread GitBox
steveloughran commented on a change in pull request #1999: URL: https://github.com/apache/hadoop/pull/1999#discussion_r433416794 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractFSContract.java ## @@ -69,6 +69,14 @@ public v

[jira] [Updated] (HADOOP-16202) S3A openFile() operation to support explicit versionID, etag, length parameters

2020-06-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Summary: S3A openFile() operation to support explicit versionID, etag, length parameters

[jira] [Updated] (HADOOP-16202) S3A openFile() operation to support explicit versionID, etag, lengthparameters

2020-06-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Summary: S3A openFile() operation to support explicit versionID, etag, lengthparameters

[jira] [Assigned] (HADOOP-16202) S3A openFile() operation to support explicit versionID, etag parameters

2020-06-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16202: --- Assignee: Steve Loughran > S3A openFile() operation to support explicit versionID,

[jira] [Updated] (HADOOP-16090) S3A Client to add explicit support for versioned stores

2020-06-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16090: Resolution: Abandoned Status: Resolved (was: Patch Available) hadoop-13230 will

[GitHub] [hadoop] steveloughran closed pull request #1627: HADOOP-16644. Do a HEAD after a PUT to get the modtime.

2020-06-02 Thread GitBox
steveloughran closed pull request #1627: URL: https://github.com/apache/hadoop/pull/1627 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop] steveloughran commented on pull request #1963: HADOOP-16798. S3A Committer thread pool shutdown problems.

2020-06-02 Thread GitBox
steveloughran commented on pull request #1963: URL: https://github.com/apache/hadoop/pull/1963#issuecomment-637521825 yetus didnt run the last patch. i will rebase and resubmit to force it This is an automated message from th

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1963: HADOOP-16798. S3A Committer thread pool shutdown problems.

2020-06-02 Thread GitBox
hadoop-yetus removed a comment on pull request #1963: URL: https://github.com/apache/hadoop/pull/1963#issuecomment-631069895 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] iwasakims commented on pull request #2045: HADOOP-17056. shelldoc fails in hadoop-common.

2020-06-02 Thread GitBox
iwasakims commented on pull request #2045: URL: https://github.com/apache/hadoop/pull/2045#issuecomment-637521388 Is this message in cosole output relevant? ``` 17:33:05 WARNING: shellcheck needs UTF-8 locale support. Forcing C.UTF-8. 17:33:05 executable '/testptch/hadoop/dev-supp

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123739#comment-17123739 ] Hadoop QA commented on HADOOP-16254: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2020-06-02 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123736#comment-17123736 ] Yuxuan Wang commented on HADOOP-16254: -- [~hexiaoqiao] {quote}Do you mean one conne

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2020-06-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123692#comment-17123692 ] Xiaoqiao He commented on HADOOP-16254: -- Thanks [~zhengchenyu] and [~John Smith] fo

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2020-06-02 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123635#comment-17123635 ] Yuxuan Wang commented on HADOOP-16254: -- Long time no see. And I find the HADOOP-16

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123630#comment-17123630 ] Hadoop QA commented on HADOOP-17056: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123625#comment-17123625 ] Hadoop QA commented on HADOOP-17056: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2020-06-02 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123603#comment-17123603 ] zhengchenyu commented on HADOOP-16254: -- For security problem, I think this methods

[jira] [Assigned] (HADOOP-17058) Support for Appendblob in abfs driver

2020-06-02 Thread Ishani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishani reassigned HADOOP-17058: --- Assignee: Ishani > Support for Appendblob in abfs driver > - >

[jira] [Created] (HADOOP-17058) Support for Appendblob in abfs driver

2020-06-02 Thread Ishani (Jira)
Ishani created HADOOP-17058: --- Summary: Support for Appendblob in abfs driver Key: HADOOP-17058 URL: https://issues.apache.org/jira/browse/HADOOP-17058 Project: Hadoop Common Issue Type: Sub-task

[GitHub] [hadoop] hadoop-yetus commented on pull request #2045: HADOOP-17056. shelldoc fails in hadoop-common.

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2045: URL: https://github.com/apache/hadoop/pull/2045#issuecomment-637403880 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 2

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123511#comment-17123511 ] Hadoop QA commented on HADOOP-17056: (!) A patch to the testing environment has bee

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123504#comment-17123504 ] Akira Ajisaka commented on HADOOP-17056: test-02 patch: Create gpg homedir unde

[jira] [Comment Edited] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123504#comment-17123504 ] Akira Ajisaka edited comment on HADOOP-17056 at 6/2/20, 8:34 AM:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2045: HADOOP-17056. shelldoc fails in hadoop-common.

2020-06-02 Thread GitBox
hadoop-yetus commented on pull request #2045: URL: https://github.com/apache/hadoop/pull/2045#issuecomment-637381762 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.

[jira] [Updated] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17056: --- Attachment: HADOOP-17056-test-03.patch > shelldoc fails in hadoop-common >

[GitHub] [hadoop] aajisaka opened a new pull request #2045: HADOOP-17056. shelldoc fails in hadoop-common.

2020-06-02 Thread GitBox
aajisaka opened a new pull request #2045: URL: https://github.com/apache/hadoop/pull/2045 JIRA: https://issues.apache.org/jira/browse/HADOOP-17056 Skip GPG verification in the docker build image. This is an automated m

[jira] [Updated] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17056: --- Attachment: HADOOP-17056-test-02.patch > shelldoc fails in hadoop-common >

[jira] [Updated] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17056: --- Attachment: HADOOP-17056-test-01.patch > shelldoc fails in hadoop-common >

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123445#comment-17123445 ] Akira Ajisaka commented on HADOOP-17056: Thanks [~iwasakims] for your comment.

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123433#comment-17123433 ] Hadoop QA commented on HADOOP-17056: | (x) *{color:red}-1 overall{color}* | \\ \\ |