[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #624: HDDS-3110. Fix race condition in Recon's container and pipeline handling.

2020-03-02 Thread GitBox
adoroszlai commented on a change in pull request #624: HDDS-3110. Fix race condition in Recon's container and pipeline handling. URL: https://github.com/apache/hadoop-ozone/pull/624#discussion_r386834211 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/s

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #624: HDDS-3110. Fix race condition in Recon's container and pipeline handling.

2020-03-02 Thread GitBox
adoroszlai commented on a change in pull request #624: HDDS-3110. Fix race condition in Recon's container and pipeline handling. URL: https://github.com/apache/hadoop-ozone/pull/624#discussion_r386833383 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/s

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #627: HDDS-3118. Possible deadlock in LockManager.

2020-03-02 Thread GitBox
adoroszlai commented on a change in pull request #627: HDDS-3118. Possible deadlock in LockManager. URL: https://github.com/apache/hadoop-ozone/pull/627#discussion_r386830200 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/lock/LockManager.java ## @

[jira] [Commented] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049946#comment-17049946 ] Attila Doroszlai commented on HDDS-3104: bq. ExitUtil is called while stopping the

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager.

2020-03-02 Thread GitBox
bharatviswa504 commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager. URL: https://github.com/apache/hadoop-ozone/pull/609#issuecomment-593793574 This time `##[error]The operation was canceled.` Before run has all acceptance tests passed

[jira] [Commented] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-02 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049935#comment-17049935 ] Siddharth Wagle commented on HDDS-3104: --- But the ExitUtil is called while stopping t

[jira] [Updated] (HDDS-3118) Possible deadlock in LockManager

2020-03-02 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3118: - Status: Patch Available (was: Open) > Possible deadlock in LockManager >

[jira] [Updated] (HDDS-3118) Possible deadlock in LockManager

2020-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3118: - Labels: pull-request-available (was: ) > Possible deadlock in LockManager > -

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #627: HDDS-3118. Possible deadlock in LockManager.

2020-03-02 Thread GitBox
bharatviswa504 opened a new pull request #627: HDDS-3118. Possible deadlock in LockManager. URL: https://github.com/apache/hadoop-ozone/pull/627 ## What changes were proposed in this pull request? Possible deadlock in lock manager. This is because of lockPool.borrowObject waits in

[jira] [Assigned] (HDDS-3118) Possible deadlock in LockManager

2020-03-02 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-3118: Assignee: Bharat Viswanadham > Possible deadlock in LockManager > -

[jira] [Resolved] (HDDS-2947) create file : remove key table iterator

2020-03-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-2947. - Resolution: Duplicate > create file : remove key table iterator >

[jira] [Assigned] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-02 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3104: - Assignee: Siddharth Wagle > Integration test crashes due to critical error in datanode >

[jira] [Updated] (HDDS-3113) Add new Freon test for putBlock

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3113: --- Status: Patch Available (was: In Progress) > Add new Freon test for putBlock > --

[GitHub] [hadoop-ozone] adoroszlai commented on issue #592: HDDS-3013. Fix TestBlockOutputStreamWithFailures.java.

2020-03-02 Thread GitBox
adoroszlai commented on issue #592: HDDS-3013. Fix TestBlockOutputStreamWithFailures.java. URL: https://github.com/apache/hadoop-ozone/pull/592#issuecomment-59351 @bshashikant run with the latest update had 1 error: ``` [ERROR] Tests run: 8, Failures: 0, Errors: 1, Skipped: 0,

[jira] [Commented] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049922#comment-17049922 ] Attila Doroszlai commented on HDDS-3104: bq. could be surefire bug to forking? N

[jira] [Comment Edited] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-02 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049918#comment-17049918 ] Siddharth Wagle edited comment on HDDS-3104 at 3/3/20 5:32 AM: -

[jira] [Updated] (HDDS-3092) Duplicate large key test

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3092: --- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Availabl

[GitHub] [hadoop-ozone] adoroszlai merged pull request #614: HDDS-3092. Duplicate large key test

2020-03-02 Thread GitBox
adoroszlai merged pull request #614: HDDS-3092. Duplicate large key test URL: https://github.com/apache/hadoop-ozone/pull/614 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop-ozone] adoroszlai commented on issue #614: HDDS-3092. Duplicate large key test

2020-03-02 Thread GitBox
adoroszlai commented on issue #614: HDDS-3092. Duplicate large key test URL: https://github.com/apache/hadoop-ozone/pull/614#issuecomment-593774272 Thanks @bshashikant for the review. Finally got a clean CI run, merging it. T

[jira] [Commented] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-02 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049918#comment-17049918 ] Siddharth Wagle commented on HDDS-3104: --- [~adoroszlai] Can you explain the crash par

[jira] [Updated] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3104: --- Attachment: org.apache.hadoop.ozone.client.rpc.TestContainerStateMachineFailureOnRead-output.t

[GitHub] [hadoop-ozone] swagle commented on issue #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed.

2020-03-02 Thread GitBox
swagle commented on issue #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed. URL: https://github.com/apache/hadoop-ozone/pull/626#issuecomment-593770054 Thanks @bshashikant for quick turn around! This is an

[GitHub] [hadoop-ozone] bshashikant commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-03-02 Thread GitBox
bshashikant commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-593769045 > @mukul1987 @arp7 @bshashikant @lokeshj1703 > Let me know if you have any opinion or any suggestion for a test befo

[jira] [Resolved] (HDDS-3115) NPE seen in datanode log as ApplyTransaction failed

2020-03-02 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3115. --- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~swagle] for working on this. I

[GitHub] [hadoop-ozone] bshashikant merged pull request #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed.

2020-03-02 Thread GitBox
bshashikant merged pull request #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed. URL: https://github.com/apache/hadoop-ozone/pull/626 This is an automated message from the Apache Git Service. To respond

[jira] [Created] (HDDS-3122) Fail to destroy pipeline in k8s when redeploy DataNode

2020-03-02 Thread runzhiwang (Jira)
runzhiwang created HDDS-3122: Summary: Fail to destroy pipeline in k8s when redeploy DataNode Key: HDDS-3122 URL: https://issues.apache.org/jira/browse/HDDS-3122 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3122) Fail to destroy pipeline in k8s when redeploy DataNode

2020-03-02 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049841#comment-17049841 ] runzhiwang commented on HDDS-3122: -- I'm working on it. > Fail to destroy pipeline in k8s

[jira] [Created] (HDDS-3121) Fix TestSCMPipelineBytesWrittenMetrics

2020-03-02 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3121: Summary: Fix TestSCMPipelineBytesWrittenMetrics Key: HDDS-3121 URL: https://issues.apache.org/jira/browse/HDDS-3121 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

2020-03-02 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049773#comment-17049773 ] runzhiwang commented on HDDS-1933: -- I'm working on it > Datanode should use hostname in

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386723869 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java ## @@

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386723497 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java ## @@

[jira] [Created] (HDDS-3120) Freon work with OM HA

2020-03-02 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3120: Summary: Freon work with OM HA Key: HDDS-3120 URL: https://issues.apache.org/jira/browse/HDDS-3120 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-3120) Freon work with OM HA

2020-03-02 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3120: - Issue Type: New Feature (was: Bug) > Freon work with OM HA > - > >

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386723497 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java ## @@

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386722947 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneClientAdapter

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386723017 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java ## @@

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386722258 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneClientAdapter

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager.

2020-03-02 Thread GitBox
bharatviswa504 commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager. URL: https://github.com/apache/hadoop-ozone/pull/609#issuecomment-593681874 This time it failed in it-freon step with time out. ``` [ERROR] Failed to execute goal org.apache.m

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager.

2020-03-02 Thread GitBox
bharatviswa504 edited a comment on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager. URL: https://github.com/apache/hadoop-ozone/pull/609#issuecomment-593681874 This time it failed in it-freon step with time out. Not related to this PR. ``` [ERROR] Faile

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource

2020-03-02 Thread GitBox
bharatviswa504 edited a comment on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource URL: https://github.com/apache/hadoop-ozone/pull/611#issuecomment-593677500 We can update with SnapShot version, @mukul1987 / @lokeshj1703 can help in releasing ratis

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource

2020-03-02 Thread GitBox
bharatviswa504 commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource URL: https://github.com/apache/hadoop-ozone/pull/611#issuecomment-593677500 We can update with SnapShot version, @mukul1987 / @lokeshj1703 can help in releasing ratis snapsho

[GitHub] [hadoop-ozone] runzhiwang edited a comment on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource

2020-03-02 Thread GitBox
runzhiwang edited a comment on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource URL: https://github.com/apache/hadoop-ozone/pull/611#issuecomment-593676516 @bharatviswa504 RATIS-814 was merged yesterday, and has not release RATIS-0.6.0. Can I change th

[GitHub] [hadoop-ozone] runzhiwang edited a comment on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource

2020-03-02 Thread GitBox
runzhiwang edited a comment on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource URL: https://github.com/apache/hadoop-ozone/pull/611#issuecomment-593676516 @bharatviswa504 RATIS-814 was merged yesterday, and has not release RATIS-0.6.0. Can I update th

[GitHub] [hadoop-ozone] runzhiwang commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource

2020-03-02 Thread GitBox
runzhiwang commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource URL: https://github.com/apache/hadoop-ozone/pull/611#issuecomment-593676516 @bharatviswa504 RATIS-814 was merged yesterday, and has not release Ratis-0.6.0. Can I change the RATIS

[jira] [Updated] (HDDS-3119) When ratis is enabled in OM, double Buffer metrics not getting updated

2020-03-02 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3119: - Priority: Blocker (was: Major) > When ratis is enabled in OM, double Buffer metrics not g

[jira] [Created] (HDDS-3119) When ratis is enabled in OM, double Buffer metrics not getting updated

2020-03-02 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3119: Summary: When ratis is enabled in OM, double Buffer metrics not getting updated Key: HDDS-3119 URL: https://issues.apache.org/jira/browse/HDDS-3119 Project:

[jira] [Updated] (HDDS-3119) When ratis is enabled in OM, double Buffer metrics not getting updated

2020-03-02 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3119: - Component/s: Ozone Manager > When ratis is enabled in OM, double Buffer metrics not gettin

[GitHub] [hadoop-ozone] runzhiwang commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource

2020-03-02 Thread GitBox
runzhiwang commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource URL: https://github.com/apache/hadoop-ozone/pull/611#issuecomment-593671036 @xiaoyuyao Yes, you are right. There is a duplicated jira RATIS-814 with a same fix was merged at Mar 2

[jira] [Updated] (HDDS-3115) NPE seen in datanode log as ApplyTransaction failed

2020-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3115: - Labels: pull-request-available (was: ) > NPE seen in datanode log as ApplyTransaction failed > --

[GitHub] [hadoop-ozone] swagle commented on issue #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed.

2020-03-02 Thread GitBox
swagle commented on issue #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed. URL: https://github.com/apache/hadoop-ozone/pull/626#issuecomment-593669766 cc: @bshashikant for review, thanks. This is an autom

[GitHub] [hadoop-ozone] swagle opened a new pull request #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed.

2020-03-02 Thread GitBox
swagle opened a new pull request #626: HDDS-3115. NPE seen in datanode log as ApplyTransaction failed. URL: https://github.com/apache/hadoop-ozone/pull/626 ## What changes were proposed in this pull request? Clear code issue so fixed the NPE site and added a unit test for the code path.

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
smengcl commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386692432 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneClientAdapter

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource

2020-03-02 Thread GitBox
xiaoyuyao commented on issue #611: HDDS-3041. Fix the memory leak of s3g by releasing the connection resource URL: https://github.com/apache/hadoop-ozone/pull/611#issuecomment-593657846 @runzhiwang why the RATIS JIRA got closed? My understanding is that the fix proposed here has a dependen

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
xiaoyuyao commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386687730 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java ## @

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
xiaoyuyao commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386686189 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java ## @

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount

2020-03-02 Thread GitBox
xiaoyuyao commented on a change in pull request #610: HDDS-2929. Implement ofs://: temp directory mount URL: https://github.com/apache/hadoop-ozone/pull/610#discussion_r386685553 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneClientAdapt

[GitHub] [hadoop-ozone] adoroszlai commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
adoroszlai commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621#issuecomment-593650073 Thanks @bharatviswa504 for reviewing and merging it. --

[jira] [Updated] (HDDS-3118) Possible deadlock in LockManager

2020-03-02 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3118: - Priority: Blocker (was: Major) > Possible deadlock in LockManager > -

[jira] [Created] (HDDS-3118) Possible deadlock in LockManager

2020-03-02 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3118: -- Summary: Possible deadlock in LockManager Key: HDDS-3118 URL: https://issues.apache.org/jira/browse/HDDS-3118 Project: Hadoop Distributed Data Store Issu

[jira] [Updated] (HDDS-3118) Possible deadlock in LockManager

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3118: --- Attachment: repro.patch repro.log > Possible deadlock in LockManager > ---

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
bharatviswa504 merged pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621 This is an automated message from t

[jira] [Updated] (HDDS-3106) Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3106: - Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Avai

[jira] [Commented] (HDDS-3116) Datanode sometimes fails to start with NPE when starting Ratis xceiver server

2020-03-02 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049680#comment-17049680 ] Stephen O'Donnell commented on HDDS-3116: - I was able to reproduce this after re-r

[jira] [Updated] (HDDS-3067) Fix Bug in Scrub Pipeline causing destory pipelines after SCM restart

2020-03-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3067: Fix Version/s: (was: 0.6.0) > Fix Bug in Scrub Pipeline causing destory pipelines after SCM rest

[jira] [Created] (HDDS-3117) Recon throws InterruptedException while getting new snapshot from OM

2020-03-02 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3117: Summary: Recon throws InterruptedException while getting new snapshot from OM Key: HDDS-3117 URL: https://issues.apache.org/jira/browse/HDDS-3117

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager.

2020-03-02 Thread GitBox
hanishakoneru commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager. URL: https://github.com/apache/hadoop-ozone/pull/609#issuecomment-593613662 +1 pending CI. This is an automated messa

[jira] [Updated] (HDDS-3116) Datanode sometimes fails to start with NPE when starting Ratis xceiver server

2020-03-02 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDDS-3116: Attachment: full_logs.txt > Datanode sometimes fails to start with NPE when starting Ratis x

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager.

2020-03-02 Thread GitBox
bharatviswa504 commented on issue #609: HDDS-3069. UpdateID check should be skipped for non-HA OzoneManager. URL: https://github.com/apache/hadoop-ozone/pull/609#issuecomment-593562110 Test failures are related, this has caused due to force push, and one of the commits which is directly do

[jira] [Updated] (HDDS-3110) Fix race condition in Recon's container and pipeline handling.

2020-03-02 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-3110: -- Status: Patch Available (was: Open) > Fix race condition in Recon's container and pipeline handling. >

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
bharatviswa504 edited a comment on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621#issuecomment-593528228 > Increase max. concurrency to 2x the number of volumes to be created, b

[jira] [Updated] (HDDS-2980) Delete replayed entry from OpenKeyTable during commit

2020-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2980: - Labels: pull-request-available (was: ) > Delete replayed entry from OpenKeyTable during commit >

[GitHub] [hadoop-ozone] hanishakoneru opened a new pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-02 Thread GitBox
hanishakoneru opened a new pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625 ## What changes were proposed in this pull request? During KeyCreate (and S3InitiateMultipartUpload), we do not check th

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
bharatviswa504 edited a comment on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621#issuecomment-593528228 Increase max. concurrency to 2x the number of volumes to be created, beca

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
bharatviswa504 commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621#issuecomment-593528228 > Increase max. concurrency to 2x the number of volumes to be created, because

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
bharatviswa504 commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621#issuecomment-593525240 > @bharatviswa504 I think there may be a real possibility of deadlock here, thi

[GitHub] [hadoop-ozone] adoroszlai commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
adoroszlai commented on issue #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621#issuecomment-593524678 @bharatviswa504 I think there may be a real possibility of deadlock here, this patc

[GitHub] [hadoop-ozone] adoroszlai commented on issue #608: HDDS-3084 - Extended Network Topology Robot tests to attempted to read data when …

2020-03-02 Thread GitBox
adoroszlai commented on issue #608: HDDS-3084 - Extended Network Topology Robot tests to attempted to read data when … URL: https://github.com/apache/hadoop-ozone/pull/608#issuecomment-593524065 /pending "I still believe this test will fail intermittently due to HDDS-3116 and HDDS-3107. Th

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #624: Hdds 3110 master

2020-03-02 Thread GitBox
avijayanhwx opened a new pull request #624: Hdds 3110 master URL: https://github.com/apache/hadoop-ozone/pull/624 ## What changes were proposed in this pull request? - Both the Incremental container report handler and the regular container report handler add new containers from SCM w

[GitHub] [hadoop-ozone] sodonnel commented on issue #608: HDDS-3084 - Extended Network Topology Robot tests to attempted to read data when …

2020-03-02 Thread GitBox
sodonnel commented on issue #608: HDDS-3084 - Extended Network Topology Robot tests to attempted to read data when … URL: https://github.com/apache/hadoop-ozone/pull/608#issuecomment-593514638 All checks have passed on this PR, however I still believe this test will fail intermittently due

[jira] [Updated] (HDDS-3069) UpdateID check should be skipped for non-HA OzoneManager

2020-03-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3069: Summary: UpdateID check should be skipped for non-HA OzoneManager (was: Delete key is failing) > U

[jira] [Assigned] (HDDS-3116) Datanode sometimes fails to start with NPE when starting Ratis xceiver server

2020-03-02 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar reassigned HDDS-3116: - Assignee: Nanda kumar > Datanode sometimes fails to start with NPE when starting Ratis xceiver se

[jira] [Resolved] (HDDS-3066) SCM startup failed during loading containers from DB

2020-03-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-3066. - Fix Version/s: (was: 0.6.0) 0.5.0 Resolution: Fixed Cherry-picked to

[jira] [Updated] (HDDS-3106) Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3106: --- Attachment: thread_dump.txt > Intermittent timeout in > TestOzoneManagerDoubleBufferWithOMRes

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
adoroszlai opened a new pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621 ## What changes were proposed in this pull request? Generate volume name using `UUID.randomUU

[GitHub] [hadoop-ozone] supratimdeka opened a new pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path

2020-03-02 Thread GitBox
supratimdeka opened a new pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path URL: https://github.com/apache/hadoop-ozone/pull/623 ## What changes were proposed in this pull request? As part of handling a Create File Request,

[jira] [Updated] (HDDS-2941) file create : create key table entries for intermediate directories in the path

2020-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2941: - Labels: pull-request-available (was: ) > file create : create key table entries for intermediate

[jira] [Assigned] (HDDS-3115) NPE seen in datanode log as ApplyTransaction failed

2020-03-02 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3115: - Assignee: Siddharth Wagle > NPE seen in datanode log as ApplyTransaction failed > ---

[jira] [Created] (HDDS-3116) Datanode sometimes fails to start with NPE when starting Ratis xceiver server

2020-03-02 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-3116: --- Summary: Datanode sometimes fails to start with NPE when starting Ratis xceiver server Key: HDDS-3116 URL: https://issues.apache.org/jira/browse/HDDS-3116 Proje

[jira] [Created] (HDDS-3115) NPE seen in datanode log as ApplyTransaction failed

2020-03-02 Thread Nilotpal Nandi (Jira)
Nilotpal Nandi created HDDS-3115: Summary: NPE seen in datanode log as ApplyTransaction failed Key: HDDS-3115 URL: https://issues.apache.org/jira/browse/HDDS-3115 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] adoroszlai closed pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
adoroszlai closed pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621 This is an automated message from the A

[jira] [Updated] (HDDS-3113) Add new Freon test for putBlock

2020-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3113: - Labels: pull-request-available (was: ) > Add new Freon test for putBlock > --

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #622: HDDS-3113. Add new Freon test for putBlock

2020-03-02 Thread GitBox
adoroszlai opened a new pull request #622: HDDS-3113. Add new Freon test for putBlock URL: https://github.com/apache/hadoop-ozone/pull/622 ## What changes were proposed in this pull request? Introduce a new Freon test that issues putBlock commands. https://issues.apache.org/ji

[jira] [Updated] (HDDS-3106) Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3106: --- Status: Patch Available (was: In Progress) > Intermittent timeout in > TestOzoneManagerDoubl

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #551: HDDS-2717. Handle chunk increments in datanode

2020-03-02 Thread GitBox
adoroszlai commented on a change in pull request #551: HDDS-2717. Handle chunk increments in datanode URL: https://github.com/apache/hadoop-ozone/pull/551#discussion_r386388214 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java

[jira] [Created] (HDDS-3114) Implement background block-file closing thread

2020-03-02 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3114: -- Summary: Implement background block-file closing thread Key: HDDS-3114 URL: https://issues.apache.org/jira/browse/HDDS-3114 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] bshashikant commented on issue #551: HDDS-2717. Handle chunk increments in datanode

2020-03-02 Thread GitBox
bshashikant commented on issue #551: HDDS-2717. Handle chunk increments in datanode URL: https://github.com/apache/hadoop-ozone/pull/551#issuecomment-593388159 Thanks @adoroszlai . I am started going through the change in detail and not completed yet. Will continue looking at this. --

[GitHub] [hadoop-ozone] bshashikant commented on a change in pull request #551: HDDS-2717. Handle chunk increments in datanode

2020-03-02 Thread GitBox
bshashikant commented on a change in pull request #551: HDDS-2717. Handle chunk increments in datanode URL: https://github.com/apache/hadoop-ozone/pull/551#discussion_r386374474 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConfigKeys.java ##

[jira] [Updated] (HDDS-3106) Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3106: - Labels: pull-request-available (was: ) > Intermittent timeout in > TestOzoneManagerDoubleBufferW

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer

2020-03-02 Thread GitBox
adoroszlai opened a new pull request #621: HDDS-3106. Intermittent timeout in TestOzoneManagerDoubleBufferWithOMResponse#testDoubleBuffer URL: https://github.com/apache/hadoop-ozone/pull/621 ## What changes were proposed in this pull request? Generate volume name using `UUID.randomUU

[GitHub] [hadoop-ozone] bshashikant commented on a change in pull request #551: HDDS-2717. Handle chunk increments in datanode

2020-03-02 Thread GitBox
bshashikant commented on a change in pull request #551: HDDS-2717. Handle chunk increments in datanode URL: https://github.com/apache/hadoop-ozone/pull/551#discussion_r386370792 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java

  1   2   >