[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

2017-01-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Attachment: HDFS-11293-HDFS-10285-01.patch Thank you [~yuanbo] for reviewing the

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6874: -- Fix Version/s: 2.9.0 > Add GETFILEBLOCKLOCATIONS operation to HttpFS >

[jira] [Updated] (HDFS-11284) [SPS]: fix issue of moving blocks with satisfier while changing replication factor

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11284: -- Summary: [SPS]: fix issue of moving blocks with satisfier while changing replication factor (was:

[jira] [Updated] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11284: -- Description: When the real replication number of block doesn't match the replication factor. For

[jira] [Commented] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

2017-01-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810898#comment-15810898 ] Rakesh R commented on HDFS-11289: - Thanks [~umamaheswararao]. Can we add units into the configuration

[jira] [Commented] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-01-08 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810888#comment-15810888 ] Lantao Jin commented on HDFS-11285: --- Thanks [~andrew.wang], Sure, I will disable shutdown function in

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810816#comment-15810816 ] Hadoop QA commented on HDFS-11072: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v6.patch > Add ability to unset and change directory EC policy >

[jira] [Comment Edited] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810584#comment-15810584 ] Yuanbo Liu edited comment on HDFS-11293 at 1/9/17 3:51 AM: --- [~umamaheswararao]

[jira] [Comment Edited] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810584#comment-15810584 ] Yuanbo Liu edited comment on HDFS-11293 at 1/9/17 3:51 AM: --- [~umamaheswararao]

[jira] [Commented] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810584#comment-15810584 ] Yuanbo Liu commented on HDFS-11293: --- [~umamaheswararao] Thanks for your patch. Most part of your code

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810573#comment-15810573 ] SammiChen commented on HDFS-11072: -- Thanks [~andrew.wang] for the comments. I will upload a new patch to

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: (was: HDFS-11072-v6.patch) > Add ability to unset and change directory EC policy >

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v6.patch > Add ability to unset and change directory EC policy >

[jira] [Commented] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810562#comment-15810562 ] Hadoop QA commented on HDFS-11292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11293: -- Description: In {{FsDatasetImpl#createTemporary}}, we use {{volumeMap}} to get replica info by block

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810475#comment-15810475 ] Yuanbo Liu commented on HDFS-11150: --- [~umamaheswararao] Sure, I will remove my code change of

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

2017-01-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11293: -- Assignee: Uma Maheswara Rao G (was: Yuanbo Liu) > [SPS]: Local DN should be given prefernce as source

[jira] [Updated] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.003.patch > log lastWrittenTxId etc info in logSyncAll >

[jira] [Commented] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810369#comment-15810369 ] Yongjun Zhang commented on HDFS-11292: -- Thanks [~jojochuang], good comments! I just uploaded rev 3 to

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-01-08 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Attachment: HDFS-11303-001.patch > Hedged read might hang infinitely if read data from all DN failed >

[jira] [Created] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-01-08 Thread Chen Zhang (JIRA)
Chen Zhang created HDFS-11303: - Summary: Hedged read might hang infinitely if read data from all DN failed Key: HDFS-11303 URL: https://issues.apache.org/jira/browse/HDFS-11303 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11221) Have StorageDirectory return Optional instead of File/null

2017-01-08 Thread Jiajia Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809359#comment-15809359 ] Jiajia Li commented on HDFS-11221: -- [~ehiggs], could you take a look at it? > Have StorageDirectory

[jira] [Updated] (HDFS-11221) Have StorageDirectory return Optional instead of File/null

2017-01-08 Thread Jiajia Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiajia Li updated HDFS-11221: - Attachment: HDFS-11221-v1.patch 1. In StorageDirectory class, changed the return type of the

[jira] [Commented] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

2017-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809002#comment-15809002 ] Hadoop QA commented on HDFS-11293: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||