[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1483: HDDS-4319. Compile error with Java 11

2020-10-07 Thread GitBox
adoroszlai commented on pull request #1483: URL: https://github.com/apache/hadoop-ozone/pull/1483#issuecomment-705355508 Thanks @avijayanhwx for reviewing and committing it. This is an automated message from the Apache Git Se

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501443397 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501436585 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@ +/*

[jira] [Updated] (HDDS-4325) Incompatible return codes from Ozone getconf -confKey

2020-10-07 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDDS-4325: -- Affects Version/s: 1.0.0 > Incompatible return codes from Ozone getconf -confKey > -

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501423744 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,275 @@ +/**

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501415031 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,275 @@ +/** +

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501415031 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,275 @@ +/** +

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501414878 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#issuecomment-705289602 @linyiqun I've resolved the comments which are fixed. Please feel free to re-open, if anything extra to be handled. -

[jira] [Created] (HDDS-4325) Incompatible return codes from Ozone getconf -confKey

2020-10-07 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDDS-4325: - Summary: Incompatible return codes from Ozone getconf -confKey Key: HDDS-4325 URL: https://issues.apache.org/jira/browse/HDDS-4325 Project: Hadoop Distribute

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1480: HDDS-4315. Use Epoch to generate unique ObjectIDs

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1480: URL: https://github.com/apache/hadoop-ozone/pull/1480#discussion_r501398524 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java ## @@ -523,6 +531,32 @@ public static OmKeyInfo prepareKeyForR

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1467: HDDS-4268. Prepare for Upgrade step should purge the log after waiting for the last txn to be applied.

2020-10-07 Thread GitBox
avijayanhwx commented on pull request #1467: URL: https://github.com/apache/hadoop-ozone/pull/1467#issuecomment-705227363 /pending Looking into an edge case where Ratis log index can go over applied index, thereby causing purge not to succeed. -

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1483: HDDS-4319. Compile error with Java 11

2020-10-07 Thread GitBox
avijayanhwx merged pull request #1483: URL: https://github.com/apache/hadoop-ozone/pull/1483 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-4209) S3A Filesystem does not work with Ozone S3 in file system compat mode

2020-10-07 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-4209: Summary: S3A Filesystem does not work with Ozone S3 in file system compat mode (was: S3A Filesystem

[jira] [Resolved] (HDDS-4124) Verify parent directories and file system semantics during initiate MPU

2020-10-07 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-4124. - Resolution: Won't Fix > Verify parent directories and file system semantics during initiate MPU >

[jira] [Resolved] (HDDS-4209) S3A Filesystem does not work with Ozone S3

2020-10-07 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-4209. - Resolution: Won't Fix S3A is not supported in file system compatibility mode. > S3A Filesystem do

[jira] [Updated] (HDDS-4322) Add integration tests for Decommission and resolve issues detected by the tests

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4322: - Labels: pull-request-available (was: ) > Add integration tests for Decommission and resolve issue

[GitHub] [hadoop-ozone] sodonnel opened a new pull request #1484: HDDS-4322. Add integration tests for Decommission and resolve issues detected by the tests.

2020-10-07 Thread GitBox
sodonnel opened a new pull request #1484: URL: https://github.com/apache/hadoop-ozone/pull/1484 ## What changes were proposed in this pull request? Add a series of integration tests to prove decommission works, and that decommission can survive a restart of SCM. As part of add

[jira] [Created] (HDDS-4324) DatanodeAdminMonitor no longers needs maintenance end time to be passed

2020-10-07 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-4324: --- Summary: DatanodeAdminMonitor no longers needs maintenance end time to be passed Key: HDDS-4324 URL: https://issues.apache.org/jira/browse/HDDS-4324 Project: Ha

[jira] [Created] (HDDS-4323) Add integration tests for putting nodes into maintenance and fix any issues uncovered in the tests

2020-10-07 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-4323: --- Summary: Add integration tests for putting nodes into maintenance and fix any issues uncovered in the tests Key: HDDS-4323 URL: https://issues.apache.org/jira/browse/HDDS-43

[jira] [Created] (HDDS-4322) Add integration tests for Decommission and resolve issues detected by the tests

2020-10-07 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-4322: --- Summary: Add integration tests for Decommission and resolve issues detected by the tests Key: HDDS-4322 URL: https://issues.apache.org/jira/browse/HDDS-4322 Pro

[jira] [Resolved] (HDDS-3345) Investigate failure of TestDecommissionAndMaintenance integration test

2020-10-07 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDDS-3345. - Resolution: Invalid The problem tests have been replaced with new ones, so this is no long

[jira] [Updated] (HDDS-4319) Compile error with Java 11

2020-10-07 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4319: Resolution: Fixed Status: Resolved (was: Patch Available) Merged Github PR. > Comp

[GitHub] [hadoop-ozone] amaliujia edited a comment on pull request #1476: HDDS-4312. findbugs check succeeds despite compile error

2020-10-07 Thread GitBox
amaliujia edited a comment on pull request #1476: URL: https://github.com/apache/hadoop-ozone/pull/1476#issuecomment-705114071 LGTM @adoroszlai so for creating a new module that generates proto, the changes in this PR seems required. Will apply such change in the future when I create

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1476: HDDS-4312. findbugs check succeeds despite compile error

2020-10-07 Thread GitBox
amaliujia commented on pull request #1476: URL: https://github.com/apache/hadoop-ozone/pull/1476#issuecomment-705114071 LGTM @adoroszlai so for creating a new module, the changes in this PR seems required. Will apply such change in the future when I create new modules. --

[jira] [Updated] (HDDS-4319) Compile error with Java 11

2020-10-07 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4319: --- Status: Patch Available (was: Open) > Compile error with Java 11 > --

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501215658 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@ +/*

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1476: HDDS-4312. findbugs check succeeds despite compile error

2020-10-07 Thread GitBox
adoroszlai commented on pull request #1476: URL: https://github.com/apache/hadoop-ozone/pull/1476#issuecomment-705108450 @amaliujia item 3 is related to HDDS-4242. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501207900 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@ +/*

[jira] [Updated] (HDDS-4321) Revisit quota implementation based on HDDS-4308 task

2020-10-07 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Radhakrishnan updated HDDS-4321: --- Parent: HDDS-2939 Issue Type: Sub-task (was: Task) > Revisit quota implementa

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1482: HDDS-4317. Copy UserVolumeInfo to PersistedUserVolumeInfo in interface-storage

2020-10-07 Thread GitBox
amaliujia commented on pull request #1482: URL: https://github.com/apache/hadoop-ozone/pull/1482#issuecomment-705101169 R: @elek Can you take a look please? BTW, the next PR should be the last PR because of the complicated dependency issue. For all left migration, I will have to fin

[jira] [Created] (HDDS-4321) Revisit quota implementation based on HDDS-4308 task

2020-10-07 Thread Rakesh Radhakrishnan (Jira)
Rakesh Radhakrishnan created HDDS-4321: -- Summary: Revisit quota implementation based on HDDS-4308 task Key: HDDS-4321 URL: https://issues.apache.org/jira/browse/HDDS-4321 Project: Hadoop Distribut

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501204848 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@ +/*

[jira] [Updated] (HDDS-4320) Let Ozone input streams implement CanUnbuffer

2020-10-07 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4320: --- Description: Implement Hadoop's {{CanUnbuffer}} interface in {{OzoneFSInputStream}} and the un

[jira] [Created] (HDDS-4320) Let Ozone input streams implement CanUnbuffer

2020-10-07 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4320: -- Summary: Let Ozone input streams implement CanUnbuffer Key: HDDS-4320 URL: https://issues.apache.org/jira/browse/HDDS-4320 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1483: HDDS-4319. Compile error with Java 11

2020-10-07 Thread GitBox
adoroszlai opened a new pull request #1483: URL: https://github.com/apache/hadoop-ozone/pull/1483 ## What changes were proposed in this pull request? AspectJ-Maven-Plugin is [not compatible with Java 9](https://github.com/mojohaus/aspectj-maven-plugin/issues/24) or later as of the c

[jira] [Updated] (HDDS-4319) Compile error with Java 11

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4319: - Labels: pull-request-available (was: ) > Compile error with Java 11 > --

[jira] [Updated] (HDDS-4309) Fix inconsistent Recon config keys that start with "recon.om."

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4309: - Labels: newbie pull-request-available (was: newbie) > Fix inconsistent Recon config keys that sta

[jira] [Resolved] (HDDS-4309) Fix inconsistent Recon config keys that start with "recon.om."

2020-10-07 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian resolved HDDS-4309. -- Fix Version/s: 1.1.0 Resolution: Fixed > Fix inconsistent Recon c

[GitHub] [hadoop-ozone] vivekratnavel commented on pull request #1478: HDDS-4309. Fix inconsistency recon config keys starting with recon and not ozone

2020-10-07 Thread GitBox
vivekratnavel commented on pull request #1478: URL: https://github.com/apache/hadoop-ozone/pull/1478#issuecomment-705037905 @adoroszlai Thanks for the review and @frischHWC thanks for the contribution. This is an automated

[GitHub] [hadoop-ozone] vivekratnavel merged pull request #1478: Fix inconsistency recon config keys starting with recon and not ozone

2020-10-07 Thread GitBox
vivekratnavel merged pull request #1478: URL: https://github.com/apache/hadoop-ozone/pull/1478 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Updated] (HDDS-4319) Compile error with Java 11

2020-10-07 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4319: --- Description: {code:title=https://github.com/apache/hadoop-ozone/runs/1217093596#step:6:5632} E

[jira] [Created] (HDDS-4319) Compile error with Java 11

2020-10-07 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4319: -- Summary: Compile error with Java 11 Key: HDDS-4319 URL: https://issues.apache.org/jira/browse/HDDS-4319 Project: Hadoop Distributed Data Store Issue Type

[jira] [Assigned] (HDDS-4318) Disable single node pipeline creation by default in Ozone

2020-10-07 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-4318: - Assignee: Aryan Gupta > Disable single node pipeline creation by default in Ozone

[GitHub] [hadoop-ozone] runzhiwang commented on pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-10-07 Thread GitBox
runzhiwang commented on pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#issuecomment-704986134 > > @bshashikant Thanks for suggestions. Actually, RandomLeaderChoosePolicy does not choose datanode, it return null in [chooseLeader](https://github.com/apache/hadoop-o

[GitHub] [hadoop-ozone] codecov-io commented on pull request #1478: Fix inconsistency recon config keys starting with recon and not ozone

2020-10-07 Thread GitBox
codecov-io commented on pull request #1478: URL: https://github.com/apache/hadoop-ozone/pull/1478#issuecomment-704962201 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1478?src=pr&el=h1) Report > Merging [#1478](https://codecov.io/gh/apache/hadoop-ozone/pull/1478?src=pr&el=

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501043202 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501041763 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501040679 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,260 @@

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501040679 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,260 @@

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r501022137 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequest.java ## @@ -253,4 +253,33 @@ publ

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500980993 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequest.java ## @@ -253,4 +253,33 @@ publi

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500976257 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,260 @@ +/** +

[jira] [Created] (HDDS-4318) Disable single node pipeline creation by default in Ozone

2020-10-07 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-4318: - Summary: Disable single node pipeline creation by default in Ozone Key: HDDS-4318 URL: https://issues.apache.org/jira/browse/HDDS-4318 Project: Hadoop Distri

[jira] [Assigned] (HDDS-3811) Add tests to verify all the disks of a datanode are utilized for write

2020-10-07 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-3811: - Assignee: (was: Shashikant Banerjee) > Add tests to verify all the disks of a

[jira] [Resolved] (HDDS-3811) Add tests to verify all the disks of a datanode are utilized for write

2020-10-07 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3811. --- Fix Version/s: 1.1.0 Resolution: Fixed > Add tests to verify all the disks of a

[jira] [Resolved] (HDDS-4072) Pipeline creation on a datanodes should account for raft log disks reported

2020-10-07 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-4072. --- Fix Version/s: 1.1.0 Resolution: Fixed > Pipeline creation on a datanodes shoul

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#issuecomment-704863482 Thanks a lot @bharatviswa504 and @linyiqun for the review efforts and useful comments. I've made another commit by addressing your comments.

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500920112 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java ## @@ -129,6 +132,10 @@ * |--

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500919915 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,260 @@ +/**

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500919741 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,260 @@ +/**

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500919600 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequestV1.java ## @@ -0,0 +1,260 @@ +/**

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500919334 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@ +/*

[jira] [Updated] (HDDS-4313) Create thread-local instance of FileSystem in HadoopFsGenerator

2020-10-07 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4313: --- Status: Patch Available (was: In Progress) > Create thread-local instance of FileSystem in Ha

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500914750 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java ## @@ -227,6 +247,9 @@ protected OmMe

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500914750 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java ## @@ -227,6 +247,9 @@ protected OmMe

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500913715 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@ +/*

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500911479 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,283 @@ +/*

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500911297 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmKeyInfo.java ## @@ -126,6 +144,23 @@ public void setDataSize(

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500910910 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file/TestOMFileCreateRequestV1.java ## @@ -0,0 +1,456 @@

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500909870 ## File path: hadoop-ozone/interface-storage/src/main/java/org/apache/hadoop/ozone/om/OMMetadataManager.java ## @@ -399,4 +399,15 @@ String getMul

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500910318 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/file/OMFileCreateResponseV1.java ## @@ -0,0 +1,81 @@ +/

[jira] [Commented] (HDDS-4243) Get API not working from S3A filesystem with Ozone S3

2020-10-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209452#comment-17209452 ] Steve Loughran commented on HDDS-4243: -- all we like is an etag which can be returned

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1478: Fix inconsistency recon config keys starting with recon and not ozone

2020-10-07 Thread GitBox
adoroszlai commented on pull request #1478: URL: https://github.com/apache/hadoop-ozone/pull/1478#issuecomment-704792520 Thanks @frischHWC for updating the patch. Sorry, I forgot `TestOzoneConfigurationFields`, a unit test that checks whether properties in `ozone-default.xml` and the `*Co

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1472: HDDS-4306. Ozone checkstyle rule can't be imported to IntelliJ.

2020-10-07 Thread GitBox
adoroszlai commented on pull request #1472: URL: https://github.com/apache/hadoop-ozone/pull/1472#issuecomment-704783593 > One thing I notice that you suggest use LineLengthCheck instead of LineLength module. I think it is typo Today I learned: both forms work fine. However, y

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500795676 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file/TestOMFileCreateRequest.java ## @@ -146,7 +141,7 @@

[jira] [Updated] (HDDS-4317) Copy UserVolumeInfo to PersistedUserVolumeInfo in interface-storage

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4317: - Labels: pull-request-available (was: ) > Copy UserVolumeInfo to PersistedUserVolumeInfo in interf

[GitHub] [hadoop-ozone] amaliujia opened a new pull request #1482: HDDS-4317. Copy UserVolumeInfo to PersistedUserVolumeInfo in interface-storage

2020-10-07 Thread GitBox
amaliujia opened a new pull request #1482: URL: https://github.com/apache/hadoop-ozone/pull/1482 ## What changes were proposed in this pull request? Copy UserVolumeInfo to PersistedUserVolumeInfo in interface-storage ## What is the link to the Apache JIRA https://issues.

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500805730 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmKeyInfo.java ## @@ -413,7 +461,8 @@ public KeyInfo getProtobuf

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-07 Thread GitBox
linyiqun commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r500782708 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java ## @@ -129,6 +132,10 @@ * |---