[jira] [Commented] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181621#comment-15181621 ] Hadoop QA commented on HDFS-9702: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181564#comment-15181564 ] Hadoop QA commented on HDFS-8786: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181534#comment-15181534 ] Chris Nauroth commented on HDFS-9906: - I am also +1 for the patch to downtune this logging to debug

[jira] [Updated] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9702: --- Attachment: HDFS-9702-HDFS-1312.002.patch [~eddyxu] Thanks for your review. I have addressed your

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181522#comment-15181522 ] Hadoop QA commented on HDFS-9906: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9817: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for your reviews and

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181502#comment-15181502 ] Hadoop QA commented on HDFS-9817: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

2016-03-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181501#comment-15181501 ] Rakesh R commented on HDFS-8786: Thanks a lot [~jingzhao] for the detailed explanations and advice. Sorry

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181499#comment-15181499 ] Anu Engineer commented on HDFS-9817: bq. I see you changed log level at several places. Is this on

[jira] [Updated] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

2016-03-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8786: --- Attachment: HDFS-8786-004.patch > Erasure coding: DataNode should transfer striped blocks before being >

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181487#comment-15181487 ] Inigo Goiri commented on HDFS-9882: --- I created HDFS-9910 to make the disk operations in the heartbeat

[jira] [Commented] (HDFS-9910) Datanode heartbeats can get blocked by disk in FsDatasetImpl#checkBlock()

2016-03-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181486#comment-15181486 ] Inigo Goiri commented on HDFS-9910: --- To avoid the heartbeats getting stuck in disk operations, we

[jira] [Updated] (HDFS-9910) Datanode heartbeats can get blocked by disk in FsDatasetImpl#checkBlock()

2016-03-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9910: -- Summary: Datanode heartbeats can get blocked by disk in FsDatasetImpl#checkBlock() (was: Datanode

[jira] [Created] (HDFS-9910) Datanode heartbeats can get blocked by disk in {{FsDatasetImpl#checkBlock()}}

2016-03-04 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-9910: - Summary: Datanode heartbeats can get blocked by disk in {{FsDatasetImpl#checkBlock()}} Key: HDFS-9910 URL: https://issues.apache.org/jira/browse/HDFS-9910 Project: Hadoop

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181449#comment-15181449 ] Arpit Agarwal commented on HDFS-9906: - +1 pending Jenkins. Thanks for the quick patch [~brahmareddy].

[jira] [Updated] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9906: Assignee: Brahma Reddy Battula > Remove spammy log spew when a datanode is restarted >

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181445#comment-15181445 ] Mingliang Liu commented on HDFS-9817: - Hi [~anu], I see you changed log level at several places. Is

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181443#comment-15181443 ] Brahma Reddy Battula commented on HDFS-9906: Me too +1 on making it debug.. > Remove spammy

[jira] [Updated] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9906: --- Attachment: HDFS-9906.patch > Remove spammy log spew when a datanode is restarted >

[jira] [Updated] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9906: --- Status: Patch Available (was: Open) > Remove spammy log spew when a datanode is

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181388#comment-15181388 ] Hadoop QA commented on HDFS-9579: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181365#comment-15181365 ] Arpit Agarwal commented on HDFS-9817: - Thanks Anu. +1 pending Jenkins. > Use SLF4J in new classes >

[jira] [Updated] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9817: --- Attachment: HDFS-9817-HDFS-1312.002.patch [~arpitagarwal] Thanks for the comment. I have fixed in the

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181353#comment-15181353 ] Hudson commented on HDFS-9239: -- FAILURE: Integrated in Hadoop-trunk-Commit #9426 (See

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181341#comment-15181341 ] Hadoop QA commented on HDFS-9118: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180582#comment-15180582 ] Arpit Agarwal edited comment on HDFS-9817 at 3/5/16 12:09 AM: -- Thanks for

[jira] [Commented] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181316#comment-15181316 ] Lei (Eddy) Xu commented on HDFS-9702: - Hey, [~anu] The patch looks good in general. Will +1 once

[jira] [Updated] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9239: Release Note: This release adds a new feature called the DataNode Lifeline Protocol. If configured,

[jira] [Updated] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9239: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180733#comment-15180733 ] Arpit Agarwal commented on HDFS-9427: - The v002 patch lgtm. I'll postpone committing at least 3-4 days

[jira] [Commented] (HDFS-9891) Ozone: Add container transport client

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180707#comment-15180707 ] Chris Nauroth commented on HDFS-9891: - Hi [~anu]. This looks good overall. Here are a few comments.

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-04 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180692#comment-15180692 ] Ray Chiang commented on HDFS-8356: -- RE: Failing JDK8 unit test Unit test passes in my tree > Document

[jira] [Commented] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180677#comment-15180677 ] Arpit Agarwal commented on HDFS-1477: - Hi [~xiaobingo], the patch looks almost ready. A few stylistic

[jira] [Commented] (HDFS-9005) Provide support for upgrade domain script

2016-03-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180669#comment-15180669 ] Lei (Eddy) Xu commented on HDFS-9005: - Hey, [~mingma] sorry for the late reply and thanks for the

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.000.patch Initial patch: -extend logging to be able to filter by

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Status: Patch Available (was: Open) > Add logging system for libdhfs++ >

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180651#comment-15180651 ] Hadoop QA commented on HDFS-8356: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8789) Block Placement policy migrator

2016-03-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180649#comment-15180649 ] Ming Ma commented on HDFS-8789: --- Maybe we can use migrator as the first scenario for doing block movement

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180633#comment-15180633 ] Arpit Agarwal commented on HDFS-9906: - Rate limiting is overkill. +1 on just making it debug. > Remove

[jira] [Updated] (HDFS-9909) Can't read file after hdfs restart

2016-03-04 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated HDFS-9909: -- Description: If HDFS is restarted while a file is open for writing then new clients can't read

[jira] [Updated] (HDFS-9909) Can't read file after hdfs restart

2016-03-04 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated HDFS-9909: -- Description: If HDFS is restarted while a file is open for writing then new clients can't read

[jira] [Updated] (HDFS-9909) Can't read file after hdfs restart

2016-03-04 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated HDFS-9909: -- Attachment: Main.java > Can't read file after hdfs restart > --

[jira] [Created] (HDFS-9909) Can't read file after hdfs restart

2016-03-04 Thread Bogdan Raducanu (JIRA)
Bogdan Raducanu created HDFS-9909: - Summary: Can't read file after hdfs restart Key: HDFS-9909 URL: https://issues.apache.org/jira/browse/HDFS-9909 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180582#comment-15180582 ] Arpit Agarwal commented on HDFS-9817: - Thanks for addressing this [~anu]. One minor comment. When

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180572#comment-15180572 ] Haohui Mai commented on HDFS-9906: -- The information is useful for debugging but I agree that we don't need

[jira] [Commented] (HDFS-9889) Update balancer/mover document about HDFS-6133 feature

2016-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180571#comment-15180571 ] Hudson commented on HDFS-9889: -- FAILURE: Integrated in Hadoop-trunk-Commit #9425 (See

[jira] [Updated] (HDFS-9889) Update balancer/mover document about HDFS-6133 feature

2016-03-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9889: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Comment Edited] (HDFS-9889) Update balancer/mover document about HDFS-6133 feature

2016-03-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180569#comment-15180569 ] Yongjun Zhang edited comment on HDFS-9889 at 3/4/16 9:33 PM: - Committed to

[jira] [Updated] (HDFS-9908) Datanode should tolerate disk scan failure during NN handshake

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9908: -- Summary: Datanode should tolerate disk scan failure during NN handshake (was: Datanode should

[jira] [Updated] (HDFS-9908) Datanode should tolerate disk scan failure during NN handshake

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9908: -- Description: DN may treat a disk scan failure exception as an NN handshake exception, and this

[jira] [Commented] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180542#comment-15180542 ] Arpit Agarwal commented on HDFS-9478: - bq. guess we better refactor

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2016-03-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180541#comment-15180541 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~dwatzke], this question sounds like it should

[jira] [Commented] (HDFS-9908) Datanode should tolerate disk failure during NN handshake

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180534#comment-15180534 ] Wei-Chiu Chuang commented on HDFS-9908: --- For completeness, here's the related logs in DN: *DN

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180528#comment-15180528 ] Tsz Wo Nicholas Sze commented on HDFS-9239: --- +1 the new patch looks good. Thanks for the update.

[jira] [Updated] (HDFS-9908) Datanode should tolerate disk failure during NN handshake

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9908: -- Priority: Major (was: Critical) > Datanode should tolerate disk failure during NN handshake >

[jira] [Updated] (HDFS-9908) Datanode should tolerate disk failure during NN handshake

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9908: -- Description: DN may treat a disk failure exception as NN handshake exception, and this can

[jira] [Created] (HDFS-9908) Datanode should tolerate disk failure during NN handshake

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9908: - Summary: Datanode should tolerate disk failure during NN handshake Key: HDFS-9908 URL: https://issues.apache.org/jira/browse/HDFS-9908 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180446#comment-15180446 ] Chris Nauroth commented on HDFS-9907: - [~anu], thank you for committing! > Exclude Ozone

[jira] [Updated] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9907: --- Resolution: Fixed Status: Resolved (was: Patch Available) I have committed this patch. Thanks

[jira] [Commented] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180433#comment-15180433 ] Hadoop QA commented on HDFS-9907: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9873) Ozone: Add container transport server

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180429#comment-15180429 ] Chris Nauroth commented on HDFS-9873: - Hi [~anu]. Nice work! Do you think {{XceiverServer#start}} can

[jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

2016-03-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180415#comment-15180415 ] Jing Zhao commented on HDFS-8786: - I think we can use this jira to fix ErasureCodingWork first. The sorting

[jira] [Updated] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9907: --- Issue Type: Sub-task (was: Improvement) Parent: HDFS-7240 > Exclude Ozone protobuf-generated

[jira] [Commented] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180408#comment-15180408 ] Anu Engineer commented on HDFS-9907: [~cnauroth] Thanks for the patch. +1, pending jenkins. > Exclude

[jira] [Updated] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9907: Component/s: build > Exclude Ozone protobuf-generated classes from Findbugs analysis. >

[jira] [Updated] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9907: Status: Patch Available (was: Open) > Exclude Ozone protobuf-generated classes from Findbugs

[jira] [Updated] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9907: Attachment: HDFS-9907-HDFS-7240.001.patch Attaching patch v001. I expect we'll see a drop in

[jira] [Created] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9907: --- Summary: Exclude Ozone protobuf-generated classes from Findbugs analysis. Key: HDFS-9907 URL: https://issues.apache.org/jira/browse/HDFS-9907 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-04 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180403#comment-15180403 ] Ray Chiang commented on HDFS-8356: -- Thanks for all the feedback so far [~ajisakaa]. I've caught up on all

[jira] [Updated] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-04 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8356: - Attachment: HDFS-8356.006.patch - Implement all of [~ajisakaa]'s feedback - Add

[jira] [Updated] (HDFS-9891) Ozone: Add container transport client

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9891: Status: Open (was: Patch Available) > Ozone: Add container transport client >

[jira] [Updated] (HDFS-9891) Ozone: Add container transport client

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9891: Status: Patch Available (was: Open) > Ozone: Add container transport client >

[jira] [Commented] (HDFS-9126) namenode crash in fsimage download/transfer

2016-03-04 Thread Brian P Spallholtz (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180393#comment-15180393 ] Brian P Spallholtz commented on HDFS-9126: -- Any resolution to this? > namenode crash in fsimage

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180384#comment-15180384 ] Arpit Agarwal commented on HDFS-9882: - Disk operations can be slow on any platform if the disk is

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180373#comment-15180373 ] Zhe Zhang commented on HDFS-7866: - bq. We're using 11 bits to store the policy ID, which means it could

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180374#comment-15180374 ] Chris Nauroth commented on HDFS-9239: - The test failures are unrelated. The remaining style warnings

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2016-03-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7285: -- Release Note: HDFS now provides native support for erasure coding (EC) to store data more efficiently.

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180364#comment-15180364 ] Inigo Goiri commented on HDFS-9882: --- Just for the record, this happened in Windows where the Hadoop code

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180348#comment-15180348 ] Arpit Agarwal commented on HDFS-9882: - Thanks that makes sense. This is a good find. Do you think it's

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2016-03-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7285: Release Note: HDFS now provides native support for erasure coding (EC) to store data more efficiently.

[jira] [Commented] (HDFS-9888) Allow reseting KerberosName in unit tests

2016-03-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180302#comment-15180302 ] Xiao Chen commented on HDFS-9888: - FYI, I just noticed that the commit to trunk has a bunch of whitespace

[jira] [Commented] (HDFS-9888) Allow reseting KerberosName in unit tests

2016-03-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180281#comment-15180281 ] Xiao Chen commented on HDFS-9888: - Thanks very much [~zhz]! > Allow reseting KerberosName in unit tests >

[jira] [Created] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-04 Thread Elliott Clark (JIRA)
Elliott Clark created HDFS-9906: --- Summary: Remove spammy log spew when a datanode is restarted Key: HDFS-9906 URL: https://issues.apache.org/jira/browse/HDFS-9906 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9888) Allow reseting KerberosName in unit tests

2016-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180255#comment-15180255 ] Hudson commented on HDFS-9888: -- FAILURE: Integrated in Hadoop-trunk-Commit #9424 (See

[jira] [Updated] (HDFS-9888) Allow reseting KerberosName in unit tests

2016-03-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9888: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Target Version/s:

[jira] [Updated] (HDFS-9888) Allow reseting KerberosName in unit tests

2016-03-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9888: Summary: Allow reseting KerberosName in unit tests (was: TestBalancer#testBalancerWithKeytabs should reset

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180227#comment-15180227 ] Kihwal Lee commented on HDFS-9239: -- Filed HDFS-9905 for TestWebHdfsTimeouts. > DataNode Lifeline

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-03-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180225#comment-15180225 ] Kihwal Lee commented on HDFS-9905: -- This is from a precommit for HDFS-9239. {noformat} Running

[jira] [Updated] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-03-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9905: - Component/s: (was: t) > TestWebHdfsTimeouts fails occasionally >

[jira] [Commented] (HDFS-9888) TestBalancer#testBalancerWithKeytabs should reset KerberosName in test case setup

2016-03-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180223#comment-15180223 ] Xiao Chen commented on HDFS-9888: - Yes Zhe, HDFS-3016 is not in branch-2. Additionally, since

[jira] [Created] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-03-04 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9905: Summary: TestWebHdfsTimeouts fails occasionally Key: HDFS-9905 URL: https://issues.apache.org/jira/browse/HDFS-9905 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180154#comment-15180154 ] Kihwal Lee commented on HDFS-9904: -- The stack trace from the test failure. {noformat}

[jira] [Created] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-04 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9904: Summary: testCheckpointCancellationDuringUpload occasionally fails Key: HDFS-9904 URL: https://issues.apache.org/jira/browse/HDFS-9904 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-03-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-9902: -- Assignee: Brahma Reddy Battula > dfs.datanode.du.reserved should be difference

[jira] [Commented] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180103#comment-15180103 ] Hadoop QA commented on HDFS-7166: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-7166: -- Status: Patch Available (was: Open) > SbNN Web UI shows #Under replicated blocks and #pending

[jira] [Updated] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2016-03-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-7166: -- Attachment: HDFS-7166.001.patch Rev01: SbNN will not show corrupted blocks, under-replicated

[jira] [Commented] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180060#comment-15180060 ] Rushabh S Shah commented on HDFS-9871: -- ltgm. +1 (non-binding) > "Bytes Being Moved" -ve(-1 B) when

[jira] [Commented] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179991#comment-15179991 ] Hadoop QA commented on HDFS-9868: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-04 Thread NING DING (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179954#comment-15179954 ] NING DING commented on HDFS-9868: - Hi, [~jojochuang] I added a test case about switching active namenode in

  1   2   >