[GitHub] [hadoop] mukund-thakur commented on a change in pull request #1897: HADOOP-16319 skip invalid tests when default encryption enabled

2020-03-17 Thread GitBox
mukund-thakur commented on a change in pull request #1897: HADOOP-16319 skip invalid tests when default encryption enabled URL: https://github.com/apache/hadoop/pull/1897#discussion_r394126196 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AMisc

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #1881: HADOOP-16910 Adding file system counters in ABFS

2020-03-17 Thread GitBox
mukund-thakur commented on a change in pull request #1881: HADOOP-16910 Adding file system counters in ABFS URL: https://github.com/apache/hadoop/pull/1881#discussion_r394122012 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/AbstractAbfsTestWith

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #1881: HADOOP-16910 Adding file system counters in ABFS

2020-03-17 Thread GitBox
mukund-thakur commented on a change in pull request #1881: HADOOP-16910 Adding file system counters in ABFS URL: https://github.com/apache/hadoop/pull/1881#discussion_r394121291 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsStreamStati

[jira] [Commented] (HADOOP-16454) Document how to share delegation tokens between multiple HttpFS servers

2020-03-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061375#comment-17061375 ] Akira Ajisaka commented on HADOOP-16454: Unassigned. Please feel free to reassi

[jira] [Assigned] (HADOOP-16454) Document how to share delegation tokens between multiple HttpFS servers

2020-03-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-16454: -- Assignee: (was: Akira Ajisaka) > Document how to share delegation tokens between

[jira] [Commented] (HADOOP-16454) Document how to share delegation tokens between multiple HttpFS servers

2020-03-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061374#comment-17061374 ] Akira Ajisaka commented on HADOOP-16454: Thank you for pinging me. No updates.

[GitHub] [hadoop] bilaharith commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable

2020-03-17 Thread GitBox
bilaharith commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable URL: https://github.com/apache/hadoop/pull/1893#issuecomment-600399154 > LGTM. Final question before I merge: which Azur endpoint did you test this against? I don't need the results, just the name of t

[jira] [Comment Edited] (HADOOP-16454) Document how to share delegation tokens between multiple HttpFS servers

2020-03-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061264#comment-17061264 ] Wei-Chiu Chuang edited comment on HADOOP-16454 at 3/18/20, 12:03 AM:

[jira] [Comment Edited] (HADOOP-16454) Document how to share delegation tokens between multiple HttpFS servers

2020-03-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061264#comment-17061264 ] Wei-Chiu Chuang edited comment on HADOOP-16454 at 3/18/20, 12:02 AM:

[jira] [Commented] (HADOOP-16454) Document how to share delegation tokens between multiple HttpFS servers

2020-03-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061264#comment-17061264 ] Wei-Chiu Chuang commented on HADOOP-16454: -- Hi [~aajisaka] any updates on this

[GitHub] [hadoop] hadoop-yetus commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable

2020-03-17 Thread GitBox
hadoop-yetus commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable URL: https://github.com/apache/hadoop/pull/1893#issuecomment-600247677 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[GitHub] [hadoop] hadoop-yetus commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable

2020-03-17 Thread GitBox
hadoop-yetus commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable URL: https://github.com/apache/hadoop/pull/1893#issuecomment-600204454 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|

[GitHub] [hadoop] steveloughran commented on issue #1857: HADOOP-16878. Copy command in FileUtil to LOG at warn level if the source and destination is the same

2020-03-17 Thread GitBox
steveloughran commented on issue #1857: HADOOP-16878. Copy command in FileUtil to LOG at warn level if the source and destination is the same URL: https://github.com/apache/hadoop/pull/1857#issuecomment-600200242 Have you an update for this?

[GitHub] [hadoop] jojochuang commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc.

2020-03-17 Thread GitBox
jojochuang commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-600198558 Thanks @vinayakumarb. I am looking

[GitHub] [hadoop] steveloughran commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable

2020-03-17 Thread GitBox
steveloughran commented on issue #1893: HADOOP-16920 ABFS: Make list page size configurable URL: https://github.com/apache/hadoop/pull/1893#issuecomment-600196338 LGTM. Final question before I merge: which Azur endpoint did you test this against? I don't need the results, just the name of

[GitHub] [hadoop] vinayakumarb commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move et

2020-03-17 Thread GitBox
vinayakumarb commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-600195268 After this change... Nam

[GitHub] [hadoop] bilaharith commented on a change in pull request #1893: HADOOP-16920 ABFS: Make list page size configurable

2020-03-17 Thread GitBox
bilaharith commented on a change in pull request #1893: HADOOP-16920 ABFS: Make list page size configurable URL: https://github.com/apache/hadoop/pull/1893#discussion_r393800551 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsClient.java

[GitHub] [hadoop] bilaharith commented on a change in pull request #1893: HADOOP-16920 ABFS: Make list page size configurable

2020-03-17 Thread GitBox
bilaharith commented on a change in pull request #1893: HADOOP-16920 ABFS: Make list page size configurable URL: https://github.com/apache/hadoop/pull/1893#discussion_r393800630 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsClient.java

[GitHub] [hadoop] goiri commented on a change in pull request #1898: Report read-ahead error back

2020-03-17 Thread GitBox
goiri commented on a change in pull request #1898: Report read-ahead error back URL: https://github.com/apache/hadoop/pull/1898#discussion_r393791625 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ReadBufferManager.java ## @@ -

[GitHub] [hadoop] goiri commented on a change in pull request #1898: Report read-ahead error back

2020-03-17 Thread GitBox
goiri commented on a change in pull request #1898: Report read-ahead error back URL: https://github.com/apache/hadoop/pull/1898#discussion_r393792745 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestAbfsInputStream.java ## @@

[GitHub] [hadoop] goiri commented on a change in pull request #1898: Report read-ahead error back

2020-03-17 Thread GitBox
goiri commented on a change in pull request #1898: Report read-ahead error back URL: https://github.com/apache/hadoop/pull/1898#discussion_r393793595 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ReadBufferManager.java ## @@ -

[GitHub] [hadoop] goiri commented on a change in pull request #1898: Report read-ahead error back

2020-03-17 Thread GitBox
goiri commented on a change in pull request #1898: Report read-ahead error back URL: https://github.com/apache/hadoop/pull/1898#discussion_r393791537 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ReadBufferManager.java ## @@ -

[GitHub] [hadoop] goiri commented on a change in pull request #1898: Report read-ahead error back

2020-03-17 Thread GitBox
goiri commented on a change in pull request #1898: Report read-ahead error back URL: https://github.com/apache/hadoop/pull/1898#discussion_r393790939 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -23

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-17 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060983#comment-17060983 ] Andrew Olson commented on HADOOP-16900: --- That plan sounds good from here [~ste...

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060966#comment-17060966 ] Steve Loughran commented on HADOOP-16900: - OK. simple is good. # fail rather t

[GitHub] [hadoop] steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again.

2020-03-17 Thread GitBox
steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again. URL: https://github.com/apache/hadoop/pull/1877#discussion_r393728897 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/o

[GitHub] [hadoop] steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again.

2020-03-17 Thread GitBox
steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again. URL: https://github.com/apache/hadoop/pull/1877#discussion_r393728393 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsHttpOperation.

[GitHub] [hadoop] steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again.

2020-03-17 Thread GitBox
steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again. URL: https://github.com/apache/hadoop/pull/1877#discussion_r393728614 ## File path: hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/TestSynthJobGeneration.java ###

[GitHub] [hadoop] steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again.

2020-03-17 Thread GitBox
steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again. URL: https://github.com/apache/hadoop/pull/1877#discussion_r393728056 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router

[GitHub] [hadoop] steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again.

2020-03-17 Thread GitBox
steveloughran commented on a change in pull request #1877: HADOOP-16908. Prune jackson 1 code again. URL: https://github.com/apache/hadoop/pull/1877#discussion_r393728174 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/im

[jira] [Updated] (HADOOP-16319) S3A Etag tests fail with default encryption enabled on bucket

2020-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16319: Priority: Minor (was: Major) > S3A Etag tests fail with default encryption enabled on bu

[jira] [Updated] (HADOOP-16319) S3A Etag tests fail with default encryption enabled on bucket

2020-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16319: Affects Version/s: 3.2.1 > S3A Etag tests fail with default encryption enabled on bucket

[jira] [Updated] (HADOOP-16319) S3A Etag tests fail with default encryption enabled on bucket

2020-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16319: Component/s: test > S3A Etag tests fail with default encryption enabled on bucket > -

[jira] [Resolved] (HADOOP-16319) S3A Etag tests fail with default encryption enabled on bucket

2020-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16319. - Fix Version/s: 3.3.1 Resolution: Fixed > S3A Etag tests fail with default encryp

[jira] [Assigned] (HADOOP-16319) S3A Etag tests fail with default encryption enabled on bucket

2020-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16319: --- Assignee: Ben Roling > S3A Etag tests fail with default encryption enabled on buck

[jira] [Commented] (HADOOP-16319) S3A Etag tests fail with default encryption enabled on bucket

2020-03-17 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060927#comment-17060927 ] Hudson commented on HADOOP-16319: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] steveloughran commented on issue #836: HADOOP-16319 skip invalid tests when default encryption enabled

2020-03-17 Thread GitBox
steveloughran commented on issue #836: HADOOP-16319 skip invalid tests when default encryption enabled URL: https://github.com/apache/hadoop/pull/836#issuecomment-600073176 merged to trunk. Thanks! This is an automated messag

[GitHub] [hadoop] steveloughran closed pull request #836: HADOOP-16319 skip invalid tests when default encryption enabled

2020-03-17 Thread GitBox
steveloughran closed pull request #836: HADOOP-16319 skip invalid tests when default encryption enabled URL: https://github.com/apache/hadoop/pull/836 This is an automated message from the Apache Git Service. To respond to t

[GitHub] [hadoop] steveloughran merged pull request #1897: HADOOP-16319 skip invalid tests when default encryption enabled

2020-03-17 Thread GitBox
steveloughran merged pull request #1897: HADOOP-16319 skip invalid tests when default encryption enabled URL: https://github.com/apache/hadoop/pull/1897 This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (HADOOP-16319) S3A Etag tests fail with default encryption enabled on bucket

2020-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16319: Summary: S3A Etag tests fail with default encryption enabled on bucket (was: ITestS3AMis

[GitHub] [hadoop] hadoop-yetus commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-03-17 Thread GitBox
hadoop-yetus commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#issuecomment-600068083 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:

[GitHub] [hadoop] mehakmeet commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-03-17 Thread GitBox
mehakmeet commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#issuecomment-600028014 Please suggest how to write tests for "timeSpendOnTaskWait" counter. Please suggest how to simulate bytes failed to upload for "b

[GitHub] [hadoop] mehakmeet edited a comment on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-03-17 Thread GitBox
mehakmeet edited a comment on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#issuecomment-600024548 test run : mvn -T 1C -Dparallel-tests=abfs clean verify Region : East US, West US Failed tests(Container configurati

[GitHub] [hadoop] mehakmeet commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-03-17 Thread GitBox
mehakmeet commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#issuecomment-600024548 test run : mvn -T 1C -Dparallel-tests=abfs clean verify Region : East US, West US ``` [ERROR] Failures: [ERROR] ITestGe

[GitHub] [hadoop] mehakmeet opened a new pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-03-17 Thread GitBox
mehakmeet opened a new pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899 Change-Id: Ie976f23c6c3e2f5cf9167794357cfc669a232c80 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and

[GitHub] [hadoop] bilaharith commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-17 Thread GitBox
bilaharith commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r393500489 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azureb

[GitHub] [hadoop] bilaharith commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-17 Thread GitBox
bilaharith commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r393499796 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azureb