[jira] [Updated] (HADOOP-16389) Bump Apache Avro to 1.9.0

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16389: Issue Type: Sub-task (was: Improvement) Parent: HADOOP-9991 > Bump Apache Avro t

[jira] [Resolved] (HADOOP-16389) Bump Apache Avro to 1.9.0

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16389. - Resolution: Duplicate Fix Version/s: HADOOP-13386 duplicate of HADOOP-13386; ple

[GitHub] [hadoop] steveloughran commented on issue #1007: HADOOP-16389: Bump Apache Avro to 1.9.0

2019-06-24 Thread GitBox
steveloughran commented on issue #1007: HADOOP-16389: Bump Apache Avro to 1.9.0 URL: https://github.com/apache/hadoop/pull/1007#issuecomment-504969984 this is potentially really traumatic, which is why we've put it off in the past (HADOOP-13386) until satisfied. -1 to branch-2 right

[jira] [Commented] (HADOOP-16377) Moving logging APIs over to slf4j

2019-06-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871086#comment-16871086 ] Prabhu Joseph commented on HADOOP-16377: [~ste...@apache.org] Can you review th

[GitHub] [hadoop] leosunli commented on a change in pull request #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE…

2019-06-24 Thread GitBox
leosunli commented on a change in pull request #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE… URL: https://github.com/apache/hadoop/pull/977#discussion_r296693866 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apach

[jira] [Assigned] (HADOOP-16197) S3AUtils.translateException to map CredentialInitializationException to AccessDeniedException

2019-06-24 Thread Kei Kori (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kei Kori reassigned HADOOP-16197: - Assignee: Steve Loughran (was: Kei Kori) > S3AUtils.translateException to map CredentialIniti

[jira] [Assigned] (HADOOP-16197) S3AUtils.translateException to map CredentialInitializationException to AccessDeniedException

2019-06-24 Thread Kei Kori (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kei Kori reassigned HADOOP-16197: - Assignee: Kei Kori (was: Steve Loughran) > S3AUtils.translateException to map CredentialIniti

[GitHub] [hadoop] hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE…

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE… URL: https://github.com/apache/hadoop/pull/977#issuecomment-505003877 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE…

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE… URL: https://github.com/apache/hadoop/pull/977#issuecomment-505007298 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16378) RawLocalFileStatus throws exception if a file is created and deleted quickly

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871248#comment-16871248 ] Steve Loughran commented on HADOOP-16378: - lets not worry about that. The main

[jira] [Reopened] (HADOOP-15410) hoop-auth org.apache.hadoop.security.authentication.util.TestZKSignerSecretProvider org.apache.log4j package compile error

2019-06-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HADOOP-15410: -- > hoop-auth > org.apache.hadoop.security.authentication.util.TestZKSignerSecretProvider

[GitHub] [hadoop] anuengineer commented on issue #1004: HDDS-1718 : Increase Ratis Leader election timeout default to 10 seconds

2019-06-24 Thread GitBox
anuengineer commented on issue #1004: HDDS-1718 : Increase Ratis Leader election timeout default to 10 seconds URL: https://github.com/apache/hadoop/pull/1004#issuecomment-505071254 +1, the change looks good to me. @avijayanhwx Can you please confirm that test failures are not related to

[GitHub] [hadoop] anuengineer merged pull request #1005: HDDS-1719 : Increase ratis log segment size to 1MB.

2019-06-24 Thread GitBox
anuengineer merged pull request #1005: HDDS-1719 : Increase ratis log segment size to 1MB. URL: https://github.com/apache/hadoop/pull/1005 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] anuengineer commented on issue #1005: HDDS-1719 : Increase ratis log segment size to 1MB.

2019-06-24 Thread GitBox
anuengineer commented on issue #1005: HDDS-1719 : Increase ratis log segment size to 1MB. URL: https://github.com/apache/hadoop/pull/1005#issuecomment-505072019 @avijayanhwx Thanks for the contribution. @jiwq Thanks for the review. I have committed this patch to the trunk. --

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505073415 checkstyle is confused. This is an enum. There are no values. If I added a default I'd jus

[GitHub] [hadoop] steveloughran commented on a change in pull request #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
steveloughran commented on a change in pull request #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#discussion_r296800183 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/h

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505076565 reviewing my own patch (and looking @ failure reports of unrelated runs), I plan to change

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505082750 + also got a failure in the first test case where the source dir still existed. Need to Ma

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505083230 ``` [ERROR] test_110_teragen(org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortMagi

[GitHub] [hadoop] bgaborg commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
bgaborg commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505090015 Thanks for working on this @steveloughran; this will stabilize the integration tests. When ru

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296819323 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296819323 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296821886 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296823594 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296823722 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[jira] [Commented] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-24 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871526#comment-16871526 ] Ajay Kumar commented on HADOOP-16350: - Had offline discussion with [~xyao], he is o

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296831446 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296831537 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296832270 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296832773 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296833023 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505117374 > AllocatedBlocks from non leader OM will not be used. Block numbers will be left unused. > Should we add

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296847976 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296848336 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296848429 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296848597 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296848995 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296848832 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505123702 Thank You @hanishakoneru for the review. I have addressed the review comments. --

[GitHub] [hadoop] hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#issuecomment-505127909 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:---

[GitHub] [hadoop] hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#issuecomment-505129964 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:---

[GitHub] [hadoop] anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296821090 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ##

[GitHub] [hadoop] anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296819487 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ##

[GitHub] [hadoop] anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296861868 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ##

[GitHub] [hadoop] anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296820349 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ##

[GitHub] [hadoop] anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
anuengineer commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296858071 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ##

[GitHub] [hadoop] anuengineer commented on issue #969: HDDS-1597. Remove hdds-server-scm dependency from ozone-common

2019-06-24 Thread GitBox
anuengineer commented on issue #969: HDDS-1597. Remove hdds-server-scm dependency from ozone-common URL: https://github.com/apache/hadoop/pull/969#issuecomment-505135914 +1, Thanks for the contribution and reviews. This is an

[GitHub] [hadoop] anuengineer merged pull request #969: HDDS-1597. Remove hdds-server-scm dependency from ozone-common

2019-06-24 Thread GitBox
anuengineer merged pull request #969: HDDS-1597. Remove hdds-server-scm dependency from ozone-common URL: https://github.com/apache/hadoop/pull/969 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] anuengineer commented on a change in pull request #945: HDDS-1646. Support real persistence in the k8s example files

2019-06-24 Thread GitBox
anuengineer commented on a change in pull request #945: HDDS-1646. Support real persistence in the k8s example files URL: https://github.com/apache/hadoop/pull/945#discussion_r296869755 ## File path: hadoop-ozone/dist/src/main/k8s/definitions/ozone/om-ss.yaml ## @@ -36,6

[jira] [Commented] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-24 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871695#comment-16871695 ] Ajay Kumar commented on HADOOP-16350: - [~gss2002] thanks for the initial patch and

[GitHub] [hadoop] anuengineer commented on issue #945: HDDS-1646. Support real persistence in the k8s example files

2019-06-24 Thread GitBox
anuengineer commented on issue #945: HDDS-1646. Support real persistence in the k8s example files URL: https://github.com/apache/hadoop/pull/945#issuecomment-505137979 +1, Thanks for the patch. I will commit this now. This i

[GitHub] [hadoop] anuengineer merged pull request #945: HDDS-1646. Support real persistence in the k8s example files

2019-06-24 Thread GitBox
anuengineer merged pull request #945: HDDS-1646. Support real persistence in the k8s example files URL: https://github.com/apache/hadoop/pull/945 This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [hadoop] bgaborg opened a new pull request #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in …

2019-06-24 Thread GitBox
bgaborg opened a new pull request #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in … URL: https://github.com/apache/hadoop/pull/1009 …MetadataStore interface This is an automated message from the Ap

[GitHub] [hadoop] bgaborg commented on issue #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in …

2019-06-24 Thread GitBox
bgaborg commented on issue #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in … URL: https://github.com/apache/hadoop/pull/1009#issuecomment-505140565 Tests run against ireland. Got a few errors in the sequential tests: ``` [ERROR] Failures: [ERROR] ITes

[GitHub] [hadoop] bgaborg commented on issue #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in …

2019-06-24 Thread GitBox
bgaborg commented on issue #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in … URL: https://github.com/apache/hadoop/pull/1009#issuecomment-505141723 Yes, org.apache.hadoop.fs.contract.s3a.ITestS3AContractRootDir is failing even without my patch on trunk! It would

[GitHub] [hadoop] anuengineer commented on issue #979: HDDS-1698. Switch to use apache/ozone-runner in the compose/Dockerfile

2019-06-24 Thread GitBox
anuengineer commented on issue #979: HDDS-1698. Switch to use apache/ozone-runner in the compose/Dockerfile URL: https://github.com/apache/hadoop/pull/979#issuecomment-505142876 @elek Could you please rebase this when you get a chance ? Thanks in advance.

[jira] [Commented] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871719#comment-16871719 ] Hudson commented on HADOOP-16350: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] goiri commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE…

2019-06-24 Thread GitBox
goiri commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE… URL: https://github.com/apache/hadoop/pull/977#issuecomment-505151718 LGTM This is an automated message from t

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505156417 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[jira] [Updated] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-24 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Attachment: HADOOP-16350-branch-2.8.patch > Ability to tell HDFS client not to request KMS Inform

[jira] [Comment Edited] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-24 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871695#comment-16871695 ] Ajay Kumar edited comment on HADOOP-16350 at 6/24/19 8:02 PM: ---

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296892339 ## File path: hadoop-ozone/common/src/main/proto/OzoneManagerProtocol.proto ##

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296893191 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505161191 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] hadoop-yetus commented on issue #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in …

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #1009: HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in … URL: https://github.com/apache/hadoop/pull/1009#issuecomment-505161880 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296898239 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296908937 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[jira] [Commented] (HADOOP-16378) RawLocalFileStatus throws exception if a file is created and deleted quickly

2019-06-24 Thread K S (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871768#comment-16871768 ] K S commented on HADOOP-16378: -- Eh, it'll be a little difficult to reproduce. We discovere

[GitHub] [hadoop] bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505175600 Thank You @hanishakoneru for the review. I have addressed the review comments. --

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#discussion_r296916408 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
bharatviswa504 commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505184184 /retest This is an automated message from t

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505186383 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296921839 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ###

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505188933 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296923309 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ###

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296923309 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ###

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296925887 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ###

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296926683 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ###

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505194091 @bgaborg yes, seeing that too. --

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505196036 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296931497 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ###

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#discussion_r296926683 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java ###

[GitHub] [hadoop] bharatviswa504 commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
bharatviswa504 commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#issuecomment-505196534 Thank You @anuengineer for the review. I have addressed the review comments.

[GitHub] [hadoop] anuengineer closed pull request #880: HDDS-1617. Restructure the code layout for Ozone Manager

2019-06-24 Thread GitBox
anuengineer closed pull request #880: HDDS-1617. Restructure the code layout for Ozone Manager URL: https://github.com/apache/hadoop/pull/880 This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-24 Thread GitBox
steveloughran commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505197183 Gabor, fixed that; also rebased to trunk. * I have not done a full itest on this yet

[jira] [Updated] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-24 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15729: --- Attachment: HADOOP-15729.001.patch > [s3a] stop treat fs.s3a.max.threads as the long-term m

[jira] [Commented] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-24 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871830#comment-16871830 ] Sean Mackrory commented on HADOOP-15729: Attach a patch with my proposed change

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505201888 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[jira] [Commented] (HADOOP-16377) Moving logging APIs over to slf4j

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871832#comment-16871832 ] Steve Loughran commented on HADOOP-16377: - Core patch LGTM; I see the jenkins r

[jira] [Commented] (HADOOP-15076) Enhance S3A troubleshooting documents and add a performance document

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871834#comment-16871834 ] Steve Loughran commented on HADOOP-15076: - no reason why it won't, just need to

[GitHub] [hadoop] anuengineer opened a new pull request #880: HDDS-1617. Restructure the code layout for Ozone Manager

2019-06-24 Thread GitBox
anuengineer opened a new pull request #880: HDDS-1617. Restructure the code layout for Ozone Manager URL: https://github.com/apache/hadoop/pull/880 * Move Volume Management to core.volume under Ozone Manager. * Move Bucket Management to core.bucket package under Ozone Manager.

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505203741 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] anuengineer commented on issue #880: HDDS-1617. Restructure the code layout for Ozone Manager

2019-06-24 Thread GitBox
anuengineer commented on issue #880: HDDS-1617. Restructure the code layout for Ozone Manager URL: https://github.com/apache/hadoop/pull/880#issuecomment-505204742 Rebased to the latest trunk This is an automated message from

[jira] [Resolved] (HADOOP-13454) S3Guard: Provide custom FileSystem Statistics.

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13454. - Resolution: Done we've effectively done this > S3Guard: Provide custom FileSystem Stat

[jira] [Resolved] (HADOOP-16363) S3Guard DDB store prune() doesn't translate AWS exceptions to IOEs

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16363. - Resolution: Fixed Fix Version/s: 3.3.0 Fixed in the HADOOP-15183 patch > S3Guar

[GitHub] [hadoop] hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #956: HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/956#issuecomment-505212524 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[jira] [Commented] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871865#comment-16871865 ] Hadoop QA commented on HADOOP-16350: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#issuecomment-505216398 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:---

[GitHub] [hadoop] hadoop-yetus commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers…

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers… URL: https://github.com/apache/hadoop/pull/987#issuecomment-505217793 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-24 Thread GitBox
hadoop-yetus commented on issue #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006#issuecomment-505219271 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:---

  1   2   >