[jira] [Created] (HDFS-12290) Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0

2017-08-10 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12290: Summary: Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0 Key: HDFS-12290 URL: https://issues.apache.org/jira/browse/HDFS-12290

[jira] [Commented] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122930#comment-16122930 ] Hudson commented on HDFS-12287: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12287: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status: Resolved

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122912#comment-16122912 ] Hadoop QA commented on HDFS-12196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122908#comment-16122908 ] Hadoop QA commented on HDFS-12255: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: HDFS-12196-HDFS-7240.007.patch > Ozone: DeleteKey-2: Implement block deleting service to d

[jira] [Commented] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122900#comment-16122900 ] Yiqun Lin commented on HDFS-12287: -- +1, will commit this shortly. > Remove a no-longer a

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122895#comment-16122895 ] Hadoop QA commented on HDFS-12196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122889#comment-16122889 ] John Zhuge commented on HDFS-11738: --- [~zhangchen] is the original author. [~jojochuang]

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122878#comment-16122878 ] Vinayakumar B commented on HDFS-11738: -- I see that, Following changes in {{DFSInputS

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122848#comment-16122848 ] Wei-Chiu Chuang commented on HDFS-11738: Thanks [~vinayrpet] for the patch! I have

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Status: In Progress (was: Patch Available) Looking into TestPread and TestDFSStripedInputStreamWithRand

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122809#comment-16122809 ] Anu Engineer commented on HDFS-12196: - [~cheersyang] Thanks for updating the patch. +1

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Description: Implement a block deleting service running on datanode to delete stale blocks. The servi

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Summary: Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background (w

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: HDFS-12196-HDFS-7240.006.patch Revised the names, java docs etc in v6 patch according to [

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122803#comment-16122803 ] Mukul Kumar Singh commented on HDFS-12255: -- [~vagarychen] I have addressed the co

[jira] [Updated] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12255: - Attachment: HDFS-12255-HDFS-7240.003.patch > Block Storage: Cblock should generated unique

[jira] [Updated] (HDFS-12289) [READ] HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12289: -- Summary: [READ] HDFS-12091 breaks the tests for provided block reads (was: HDFS-12091 b

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122790#comment-16122790 ] Weiwei Yang commented on HDFS-12196: Hi [~anu] Thanks for your quick response. I will

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122786#comment-16122786 ] Anu Engineer commented on HDFS-12196: - [~cheersyang] +1 for v5 patch, pending Jenkins.

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122780#comment-16122780 ] Weiwei Yang commented on HDFS-12196: Thanks [~anu] for the comments. Per offline discu

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: HDFS-12196-HDFS-7240.005.patch > Ozone: DeleteKey-2: Implement container recycling service

[jira] [Commented] (HDFS-12289) HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122745#comment-16122745 ] Hadoop QA commented on HDFS-12289: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12285) Better handling of namenode ip address change

2017-08-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122746#comment-16122746 ] Ming Ma commented on HDFS-12285: Thanks [~shahrs87]. Yeah indeed related, although the exc

[jira] [Commented] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122714#comment-16122714 ] Hadoop QA commented on HDFS-12066: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122706#comment-16122706 ] Hadoop QA commented on HDFS-12054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122680#comment-16122680 ] Hadoop QA commented on HDFS-11882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122677#comment-16122677 ] Andrew Wang commented on HDFS-11082: Hi Sammi, thanks for working on this, sorry for t

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122647#comment-16122647 ] Hadoop QA commented on HDFS-12159: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122645#comment-16122645 ] Hadoop QA commented on HDFS-12159: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122631#comment-16122631 ] Anu Engineer commented on HDFS-12283: - +1, I am perfectly fine with doing this using R

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122629#comment-16122629 ] Hadoop QA commented on HDFS-11303: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-10 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122627#comment-16122627 ] Huafeng Wang commented on HDFS-1: - Hi [~drankye], you're right. I think it's a be

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122621#comment-16122621 ] Kai Zheng commented on HDFS-11882: -- Thanks [~ajisakaa] for the clarifying. I guessed the

[jira] [Updated] (HDFS-12289) HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12289: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-9806 > HDFS-12091 breaks the tests

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122607#comment-16122607 ] Kai Zheng commented on HDFS-1: -- I thought a little bit more about this, Huafeng. Coul

[jira] [Updated] (HDFS-12289) HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12289: -- Attachment: HDFS-12289-HDFS-9806.001.patch Posting a patch that introduces a configurati

[jira] [Updated] (HDFS-12289) HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12289: -- Status: Patch Available (was: Open) > HDFS-12091 breaks the tests for provided block re

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122593#comment-16122593 ] Hadoop QA commented on HDFS-11576: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122588#comment-16122588 ] lufei commented on HDFS-12054: -- [~jojochuang],thanks for your advice. According to your sugge

[jira] [Updated] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12066: - Attachment: HDFS-12066.003.patch > When Namenode is in safemode,may not allowed to remove an user's erasure > cod

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: HDFS-12054.003.patch > FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to >

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: (was: HDFS-12054.003.patch) > FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeM

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11738: -- Summary: Hedged pread takes more time when block moved from initial locations (was: hedged pread takes

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122564#comment-16122564 ] Hanisha Koneru commented on HDFS-12288: --- Nope. Deleting should also be fine. > Fix

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122562#comment-16122562 ] Lukas Majercak commented on HDFS-12288: --- Sure [~hanishakoneru], do you mind if I jus

[jira] [Created] (HDFS-12289) HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12289: - Summary: HDFS-12091 breaks the tests for provided block reads Key: HDFS-12289 URL: https://issues.apache.org/jira/browse/HDFS-12289 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Attachment: HDFS-11882.03.patch Here's a new patch. I added a little more testing, and a lot more comm

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122514#comment-16122514 ] Anu Engineer commented on HDFS-12159: - [~aw] Thanks for the tip, will do so in the fut

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122509#comment-16122509 ] Allen Wittenauer commented on HDFS-12159: - bq. Is there a way to upload PNGs witho

[jira] [Comment Edited] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122479#comment-16122479 ] Anu Engineer edited comment on HDFS-12159 at 8/10/17 11:09 PM: -

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122502#comment-16122502 ] Hanisha Koneru commented on HDFS-12288: --- Thanks for the fix, [~lukmajercak]. The pat

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122487#comment-16122487 ] Lukas Majercak commented on HDFS-12288: --- Findbugs/unit test failures are unrelated t

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122486#comment-16122486 ] Lei (Eddy) Xu commented on HDFS-12221: -- Hi, [~ajayydv] Thanks for working this. It

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122480#comment-16122480 ] Anu Engineer commented on HDFS-12159: - just submitted a new job https://builds.apach

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122479#comment-16122479 ] Anu Engineer commented on HDFS-12159: - the png that I attached was confusing the Jenki

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Attachment: (was: createFlow.png) > Ozone: SCM: Add create replication pipeline RPC > --

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122453#comment-16122453 ] Anu Engineer commented on HDFS-12159: - started a precommt job by hand. https://builds.

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122451#comment-16122451 ] Hadoop QA commented on HDFS-12288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122449#comment-16122449 ] Anu Engineer commented on HDFS-12196: - [~cheersyang] , Thanks for updating the patch.

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Attachment: HDFS-11303.004.patch Patch 004 * Fix checkstyle * Rename futureComplete back to future to av

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122418#comment-16122418 ] Hadoop QA commented on HDFS-12281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122411#comment-16122411 ] Hadoop QA commented on HDFS-11303: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122397#comment-16122397 ] Andrew Wang edited comment on HDFS-11882 at 8/10/17 9:48 PM: -

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122397#comment-16122397 ] Andrew Wang commented on HDFS-11882: I spent some time digging into this, and I think

[jira] [Commented] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122380#comment-16122380 ] Hadoop QA commented on HDFS-12287: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122364#comment-16122364 ] Anu Engineer commented on HDFS-12255: - [~msingh] +1, from me, I will commit after [~va

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122343#comment-16122343 ] Anu Engineer commented on HDFS-12238: - [~ajayydv] Thanks for the contribution, Some mi

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11576: -- Attachment: HDFS-11576.009.patch > Block recovery will fail indefinitely if recovery time > hear

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122306#comment-16122306 ] Lukas Majercak commented on HDFS-11576: --- Patch 008 was missing some changes, updatin

[jira] [Commented] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-10 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122298#comment-16122298 ] Wellington Chevreuil commented on HDFS-12117: - Thanks [~jojochuang]! It seems

[jira] [Comment Edited] (HDFS-7240) Object store in HDFS

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122281#comment-16122281 ] Anu Engineer edited comment on HDFS-7240 at 8/10/17 8:37 PM: - [

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122281#comment-16122281 ] Anu Engineer commented on HDFS-7240: [~johnament] Would please care to comment on the A

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12288: -- Status: Patch Available (was: In Progress) > Fix DataNode's xceiver count calculation > ---

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12288: -- Attachment: HDFS-12288.001.patch > Fix DataNode's xceiver count calculation > --

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122260#comment-16122260 ] Hadoop QA commented on HDFS-12255: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122254#comment-16122254 ] Hadoop QA commented on HDFS-11576: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122231#comment-16122231 ] Hadoop QA commented on HDFS-5040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-11900) Hedged reads thread pool creation not synchronized

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122217#comment-16122217 ] Hadoop QA commented on HDFS-11900: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work started] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12288 started by Lukas Majercak. - > Fix DataNode's xceiver count calculation > --

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12288: -- Summary: Fix DataNode's xceiver count calculation (was: Fix DN xceiver count calculation) > Fi

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122203#comment-16122203 ] Lukas Majercak commented on HDFS-12288: --- I'll send a patch soon. > Fix DataNode's x

[jira] [Updated] (HDFS-12288) Fix DN xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12288: -- Summary: Fix DN xceiver count calculation (was: Change DN xceiver count calculation) > Fix DN

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122198#comment-16122198 ] Hadoop QA commented on HDFS-12255: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12288) Change DN xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-12288: - Summary: Change DN xceiver count calculation Key: HDFS-12288 URL: https://issues.apache.org/jira/browse/HDFS-12288 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12287: -- Status: Patch Available (was: Open) > Remove a no-longer applicable TODO comment in DatanodeManager > -

[jira] [Updated] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12287: -- Attachment: HDFS-12287.001.patch > Remove a no-longer applicable TODO comment in DatanodeManager > -

[jira] [Comment Edited] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122176#comment-16122176 ] Chen Liang edited comment on HDFS-12255 at 8/10/17 7:35 PM: Th

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122176#comment-16122176 ] Chen Liang commented on HDFS-12255: --- Thanks [~msingh] for taking care of this! {{TestBuf

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122161#comment-16122161 ] Wei-Chiu Chuang commented on HDFS-11303: Hi Chen Zhang. Your 002 patch is mostly g

[jira] [Commented] (HDFS-11900) Hedged reads thread pool creation not synchronized

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122172#comment-16122172 ] Wei-Chiu Chuang commented on HDFS-11900: Thanks for the patch John, I kicked off a

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11303: --- Attachment: HDFS-11303.003.patch > Hedged read might hang infinitely if read data from all DN

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-10 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Description: # XML Property: ozone.handler.type Value -   local ## Config Name:  OZONE_HANDLER_TYPE_DEFA

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-10 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122149#comment-16122149 ] Ajay Yadav commented on HDFS-12281: --- Hi [~cheersyang], updated the patch with RocksDB as

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-10 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122146#comment-16122146 ] Íñigo Goiri commented on HDFS-12273: [~raviprak], we would appreciate feedback on the

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-10 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Attachment: HDFS-12281-HDFS-7240.02.patch > Ozone: Ozone-default.xml has 3 properties that do not match

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11576: -- Status: Patch Available (was: In Progress) > Block recovery will fail indefinitely if recovery

[jira] [Created] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12287: - Summary: Remove a no-longer applicable TODO comment in DatanodeManager Key: HDFS-12287 URL: https://issues.apache.org/jira/browse/HDFS-12287 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-11576: --- Status: In Progress (was: Patch Available) > Block recovery will fail indefinitely if recovery time >

  1   2   >