[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064380#comment-16064380 ] steven-wugang commented on HDFS-12045: -- [~anu] This genkins mistake has nothing to do

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-26 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064377#comment-16064377 ] lufei commented on HDFS-11870: -- Hi [~jojochuang] The hadoop-hdfs unit test errors above remai

[jira] [Created] (HDFS-12047) Ozone: Add REST API documentation

2017-06-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12047: -- Summary: Ozone: Add REST API documentation Key: HDFS-12047 URL: https://issues.apache.org/jira/browse/HDFS-12047 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-12037) Ozone: Improvement rest API output format for better looking

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12037: --- Attachment: HDFS-12037-HDFS-7240.001.patch > Ozone: Improvement rest API output format for better look

[jira] [Updated] (HDFS-12037) Ozone: Improvement rest API output format for better looking

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12037: --- Status: Patch Available (was: Open) > Ozone: Improvement rest API output format for better looking >

[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064354#comment-16064354 ] Hadoop QA commented on HDFS-12045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060539#comment-16060539 ] Weiwei Yang edited comment on HDFS-11679 at 6/27/17 6:18 AM: -

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: Patch Available (was: In Progress) > Reduce memory used by snapshot diff data structure

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Attachment: HDFS-12042.02.patch > Reduce memory used by snapshot diff data structures >

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: In Progress (was: Patch Available) > Reduce memory used by snapshot diff data structure

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12018: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target Versi

[jira] [Updated] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12045: Status: Patch Available (was: Open) > Add log when Diskbalancer volume is transient storage type >

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064263#comment-16064263 ] Weiwei Yang commented on HDFS-12018: I just committed v3 patch to the feature branch,

[jira] [Commented] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064259#comment-16064259 ] Hadoop QA commented on HDFS-12011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064256#comment-16064256 ] Weiwei Yang commented on HDFS-12018: The jenkins result seems good, +1 to the v3 patch

[jira] [Updated] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12028: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolv

[jira] [Comment Edited] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064250#comment-16064250 ] Anu Engineer edited comment on HDFS-12045 at 6/27/17 4:41 AM: --

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064251#comment-16064251 ] Weiwei Yang commented on HDFS-12028: Just committed to the feature branch, thanks for

[jira] [Updated] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12045: Component/s: diskbalancer > Add log when Diskbalancer volume is transient storage type > ---

[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064250#comment-16064250 ] Anu Engineer commented on HDFS-12045: - +1, pending jenkins. Thanks for take care of th

[jira] [Assigned] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-12045: --- Assignee: Anu Engineer > Add log when Diskbalancer volume is transient storage type > ---

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064246#comment-16064246 ] Anu Engineer commented on HDFS-12028: - +1 [~vagarychen] Thanks for taking care of this

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064245#comment-16064245 ] Weiwei Yang commented on HDFS-12028: Hi [~vagarychen] You are right. I just did a cle

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064238#comment-16064238 ] Hadoop QA commented on HDFS-11870: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064230#comment-16064230 ] Yiqun Lin commented on HDFS-12040: -- LGTM, +1. Thanks [~kihwal] for reminding me. > TestF

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064223#comment-16064223 ] Hadoop QA commented on HDFS-12025: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064215#comment-16064215 ] Hadoop QA commented on HDFS-12040: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12046) Hadoop CRC implementation using Intel ISAL library

2017-06-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12046: - Summary: Hadoop CRC implementation using Intel ISAL library (was: Hadoop CRC implementation using Intel I

[jira] [Created] (HDFS-12046) Hadoop CRC implementation using Intel ISAL-CRC library

2017-06-26 Thread luhuichun (JIRA)
luhuichun created HDFS-12046: Summary: Hadoop CRC implementation using Intel ISAL-CRC library Key: HDFS-12046 URL: https://issues.apache.org/jira/browse/HDFS-12046 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12011: --- Attachment: HADOOP-12011.002.patch > Add a new load balancing volume choosing policy > --

[jira] [Updated] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12045: - Attachment: HDFS-12045.patch > Add log when Diskbalancer volume is transient storage type > --

[jira] [Updated] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12011: --- Attachment: (was: HADOOP-12011.003.patch) > Add a new load balancing volume choosing policy > ---

[jira] [Updated] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12011: --- Attachment: (was: HADOOP-12011.002.path) > Add a new load balancing volume choosing policy >

[jira] [Created] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread steven-wugang (JIRA)
steven-wugang created HDFS-12045: Summary: Add log when Diskbalancer volume is transient storage type Key: HDFS-12045 URL: https://issues.apache.org/jira/browse/HDFS-12045 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-26 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064147#comment-16064147 ] lufei commented on HDFS-11870: -- Thank you very much for your careful check. I have Modified i

[jira] [Updated] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-26 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-11870: - Attachment: HDFS-11870.005.patch > Add CLI cmd to enable/disable an erasure code policy >

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Status: Patch Available (was: Open) > Modify help instructions of Plan command and Execute comman

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Attachment: (was: HDFS-12025.001.patch) > Modify help instructions of Plan command and Execute

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Attachment: HDFS-12025.002.patch > Modify help instructions of Plan command and Execute command ab

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Status: Open (was: Patch Available) > Modify help instructions of Plan command and Execute comman

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12040: --- Attachment: HDFS-12040.001.patch > TestFsDatasetImpl.testCleanShutdownOfVolume fails > ---

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12040: --- Affects Version/s: 3.0.0-alpha3 Status: Patch Available (was: Open) > TestFsDatasetImp

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12040: --- Attachment: HDFS-12040-branch-2.001.patch > TestFsDatasetImpl.testCleanShutdownOfVolume fails > --

[jira] [Assigned] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong reassigned HDFS-12040: -- Assignee: hu xiaodong > TestFsDatasetImpl.testCleanShutdownOfVolume fails > ---

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064056#comment-16064056 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-26 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12044: Summary: Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery. Key: HDFS-12044 URL: http

[jira] [Commented] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064036#comment-16064036 ] Hadoop QA commented on HDFS-12042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063946#comment-16063946 ] Hudson commented on HDFS-12033: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12033: - Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch Avail

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: Patch Available (was: Open) > Reduce memory used by snapshot diff data structures > ---

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Attachment: HDFS-12042.01.patch > Reduce memory used by snapshot diff data structures >

[jira] [Commented] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063900#comment-16063900 ] Andrew Wang commented on HDFS-12033: +1 LGTM, thanks Eddy! > DatanodeManager picking

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-06-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.014.patch Rebased patch > In Hadoop 3, make FileStatus serialize itself via pr

[jira] [Commented] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063812#comment-16063812 ] Hadoop QA commented on HDFS-12033: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12043) Add counters for block re-replication

2017-06-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12043: - Summary: Add counters for block re-replication Key: HDFS-12043 URL: https://issues.apache.org/jira/browse/HDFS-12043 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063761#comment-16063761 ] Hudson commented on HDFS-11993: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063755#comment-16063755 ] Andrew Wang commented on HDFS-11882: I added the nice-to-have label to it, thanks Zhe.

[jira] [Resolved] (HDFS-11787) After HDFS-11515, -du still throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11787. Resolution: Duplicate Fix Version/s: (was: 2.8.2) (was: 3.

[jira] [Reopened] (HDFS-11515) -du throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11515: I think we can simplify the JIRA history since this change never made it into a release, re-opening. >

[jira] [Reopened] (HDFS-11787) After HDFS-11515, -du still throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11787: > After HDFS-11515, -du still throws ConcurrentModificationException > -

[jira] [Updated] (HDFS-11515) -du throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11515: --- Fix Version/s: (was: 2.8.2) (was: 3.0.0-alpha4) (was:

[jira] [Reopened] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11419: My mistake, the commit message of a subtask included the JIRA # of this one. Reopening. > BlockPlaceme

[jira] [Updated] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11419: --- Fix Version/s: (was: 3.0.0-alpha4) > BlockPlacementPolicyDefault is choosing datanode in an ineffi

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Description: When snapshot diff operation is performed in a NameNode that manages several milli

[jira] [Resolved] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11419. Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Resolving as it looks like this was completed.

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11907: --- Fix Version/s: 3.0.0-alpha4 > Add metric for time taken by NameNode resource check > -

[jira] [Closed] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash closed HDFS-11993. --- > Add log info when connect to datanode socket address failed > --

[jira] [Updated] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-11993: Fix Version/s: 3.0.0-alpha4 2.9.0 > Add log info when connect to datanode socket

[jira] [Updated] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-11993: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and cherry-pic

[jira] [Commented] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063699#comment-16063699 ] Ravi Prakash commented on HDFS-11993: - Thanks Chen Liang for the review and suggestion

[jira] [Updated] (HDFS-11078) Fix NPE in LazyPersistFileScrubber

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11078: --- Summary: Fix NPE in LazyPersistFileScrubber (was: NPE in LazyPersistFileScrubber) > Fix NPE in LazyP

[jira] [Created] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
Misha Dmitriev created HDFS-12042: - Summary: Reduce memory used by snapshot diff data structures Key: HDFS-12042 URL: https://issues.apache.org/jira/browse/HDFS-12042 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063669#comment-16063669 ] Hadoop QA commented on HDFS-12018: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063658#comment-16063658 ] Kihwal Lee commented on HDFS-12008: --- Test failures are not caused by the patch. {{TestFs

[jira] [Updated] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12033: - Attachment: HDFS-12033.01.patch Thanks for the suggestions, [~andrew.wang] Added a new test in 01

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063639#comment-16063639 ] Xiaoyu Yao commented on HDFS-12018: --- Patch v3 looks good to me. +1 pending Jenkins. > O

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063608#comment-16063608 ] Hadoop QA commented on HDFS-9079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9079: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Erasure coding: preallocate multiple generation stamps and se

[jira] [Commented] (HDFS-11956) Do not require a storage ID or target storage IDs when writing a block

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063595#comment-16063595 ] Hudson commented on HDFS-11956: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-06-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063592#comment-16063592 ] Zhe Zhang commented on HDFS-11882: -- Sorry I missed this ping earlier. bq. Although it sa

[jira] [Updated] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11992: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolv

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.003.patch Post v003 patch to rebase. > Ozone: Misc: Add CBlocks defaul

[jira] [Updated] (HDFS-11956) Do not require a storage ID or target storage IDs when writing a block

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11956: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch Available

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063551#comment-16063551 ] Hadoop QA commented on HDFS-12018: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12032) Inaccurate comment on DatanodeDescriptor#getNumberOfBlocksToBeErasureCoded

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063550#comment-16063550 ] Hudson commented on HDFS-12032: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11956) Do not require a storage ID or target storage IDs when writing a block

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11956: --- Summary: Do not require a storage ID or target storage IDs when writing a block (was: Fix BlockToken

[jira] [Updated] (HDFS-11956) Fix BlockToken compatibility with Hadoop 2.x clients

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11956: --- Release Note: Hadoop 2.x clients do not pass the storage ID or target storage IDs when writing a block

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.002.patch Thanks [~xyao] for the comments! Post v002 patch. The last tw

[jira] [Commented] (HDFS-11956) Fix BlockToken compatibility with Hadoop 2.x clients

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063533#comment-16063533 ] Andrew Wang commented on HDFS-11956: +1 LGTM, I'll adjust the release notes as well.

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12040: -- Summary: TestFsDatasetImpl.testCleanShutdownOfVolume fails (was: TestFsDatasetImpl.testCleanShutdownOfV

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063528#comment-16063528 ] Kihwal Lee commented on HDFS-12040: --- I just ran it on trunk and it failed. {noformat} Ru

[jira] [Created] (HDFS-12041) Block Storage : make the server address config more concise

2017-06-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12041: - Summary: Block Storage : make the server address config more concise Key: HDFS-12041 URL: https://issues.apache.org/jira/browse/HDFS-12041 Project: Hadoop HDFS Is

[jira] [Updated] (HDFS-12032) Inaccurate comment on DatanodeDescriptor#getNumberOfBlocksToBeErasureCoded

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12032: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch Available

[jira] [Commented] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063503#comment-16063503 ] Xiaoyu Yao commented on HDFS-12030: --- Thanks [~linyiqun] for working on this. The patch l

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063487#comment-16063487 ] Akira Ajisaka commented on HDFS-11992: -- LGTM, +1. All the failed tests except TestFsD

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2

2017-06-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12040: - Description: Found when reviewing HDFS-11992 {noformat} Running org.apache.hadoop.hdfs.server.data

[jira] [Created] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2

2017-06-26 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-12040: Summary: TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2 Key: HDFS-12040 URL: https://issues.apache.org/jira/browse/HDFS-12040 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063457#comment-16063457 ] Chen Liang commented on HDFS-12028: --- Thanks [~xyao] for the comments. [~cheersyang] it s

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063447#comment-16063447 ] Xiaoyu Yao commented on HDFS-12018: --- Thanks [~vagarychen] for working on this. The patch

[jira] [Resolved] (HDFS-11589) Unable to remove dead node after datanode decommission

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-11589. --- Resolution: Duplicate > Unable to remove dead node after datanode decommission >

  1   2   >