[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802380#comment-15802380 ] Sean Mackrory commented on HDFS-11096: -- In the SortedMapWritable case, the class is actually still

[jira] [Comment Edited] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799802#comment-15799802 ] Sean Mackrory edited comment on HDFS-11096 at 1/5/17 8:03 PM: -- I've been

[jira] [Updated] (HDFS-8519) Patch for PPC64

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8519: - Fix Version/s: (was: 2.7.1) > Patch for PPC64 > --- > > Key: HDFS-8519 >

[jira] [Updated] (HDFS-8518) Patch for PPC64

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8518: - Fix Version/s: (was: 2.7.1) > Patch for PPC64 > --- > > Key: HDFS-8518 >

[jira] [Updated] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9293: - Fix Version/s: (was: 2.7.1) > FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists

[jira] [Created] (HDFS-11295) Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete()

2017-01-05 Thread Xiao Liang (JIRA)
Xiao Liang created HDFS-11295: - Summary: Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete() Key: HDFS-11295 URL: https://issues.apache.org/jira/browse/HDFS-11295

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-05 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802316#comment-15802316 ] Manoj Govindassamy commented on HDFS-9391: -- Case 1: One replica is decommissioning and two

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-05 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802317#comment-15802317 ] Manoj Govindassamy commented on HDFS-9391: -- Code References:

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802216#comment-15802216 ] Hadoop QA commented on HDFS-11273: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802135#comment-15802135 ] Andrew Wang commented on HDFS-11072: Thanks Allen for the quick turnaround! I retriggered precommit

[jira] [Comment Edited] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802100#comment-15802100 ] Allen Wittenauer edited comment on HDFS-11072 at 1/5/17 6:28 PM: - Wrote a

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802106#comment-15802106 ] Hadoop QA commented on HDFS-7967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802100#comment-15802100 ] Allen Wittenauer commented on HDFS-11072: - Wrote a job that applied a "scorched earth" policy to

[jira] [Commented] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-01-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802046#comment-15802046 ] Andrew Wang commented on HDFS-11285: Ah. So the issue is that there is a DN that still has a few

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801999#comment-15801999 ] Andrew Wang commented on HDFS-11072: Looking at some other stalled precommits, it looks like the H9

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11193: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Created] (HDFS-11294) libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails

2017-01-05 Thread James Clampffer (JIRA)
James Clampffer created HDFS-11294: -- Summary: libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails Key: HDFS-11294 URL: https://issues.apache.org/jira/browse/HDFS-11294 Project:

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801883#comment-15801883 ] Hadoop QA commented on HDFS-11291: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801846#comment-15801846 ] Rakesh R commented on HDFS-11193: - It looks like test failures are unrelated to the patch, please ignore

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Status: Patch Available (was: Open) > Reduce the performance impact of the balancer >

[jira] [Updated] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11291: -- Attachment: HDFS-11291.002.patch Thanks [~linyiqun] for review.. Attached

[jira] [Commented] (HDFS-9283) DFS client retry trace should not be dispalyed in CLI

2017-01-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801570#comment-15801570 ] Daniel Templeton commented on HDFS-9283: Thanks for the patch. I don't think the

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2017-01-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801541#comment-15801541 ] Kihwal Lee commented on HDFS-11160: --- [~jojochuang], please make sure it is in 2.8. > VolumeScanner

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801481#comment-15801481 ] Hadoop QA commented on HDFS-11193: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9283) DFS client retry trace should not be dispalyed in CLI

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801362#comment-15801362 ] Hadoop QA commented on HDFS-9283: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801168#comment-15801168 ] Rakesh R commented on HDFS-11193: - Attached new patch addressing checkstyle warning. It looks like the

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11193: Attachment: HDFS-11193-HDFS-10285-04.patch > [SPS]: Erasure coded files should be considered for satisfying

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801125#comment-15801125 ] Kai Zheng commented on HDFS-11072: -- Hi [~andrew.wang], this hasn't built for some days due to some

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801083#comment-15801083 ] Hadoop QA commented on HDFS-10759: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

2017-01-05 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800939#comment-15800939 ] Yuanbo Liu commented on HDFS-11293: --- [~umamaheswararao] Thanks for your response. {code} the scheduling

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2017-01-05 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800934#comment-15800934 ] Ewan Higgs commented on HDFS-10759: --- The TestWebHDFS* test failues appear to have been impacted by

[jira] [Updated] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-01-05 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated HDFS-11285: -- Attachment: DecomStatus.png > Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and

[jira] [Updated] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2017-01-05 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-10759: -- Attachment: HDFS-10759.0003.patch Attached the correct patch. > Change fsimage bool isStriped from

[jira] [Updated] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2017-01-05 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-10759: -- Attachment: (was: HDFS-11026.003.patch) > Change fsimage bool isStriped from boolean to an enum >

[jira] [Updated] (HDFS-7343) HDFS smart storage management

2017-01-05 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-7343: --- Attachment: HDFS-Smart-Storage-Management-update.pdf Based on the discussion and feedbacks collected, we

[jira] [Commented] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

2017-01-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800742#comment-15800742 ] Uma Maheswara Rao G commented on HDFS-11293: [~yuanbo], I am wondering how 'A' chosen as

<    1   2   3