[jira] [Commented] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-02-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306789#comment-14306789 ] Jing Zhao commented on HDFS-7716: - Thanks for the comments, Zhe! I'm currently still workin

[jira] [Commented] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-02-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306764#comment-14306764 ] Zhe Zhang commented on HDFS-7716: - Thanks Jing! The high-level plan looks good. Below are s

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306717#comment-14306717 ] Hadoop QA commented on HDFS-7738: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306690#comment-14306690 ] Hadoop QA commented on HDFS-6054: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306573#comment-14306573 ] Yi Liu commented on HDFS-7738: -- {quote} I rather keep this patch simple. Sounds good? {quote}

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306563#comment-14306563 ] Tsz Wo Nicholas Sze commented on HDFS-7738: --- Thanks for the quick review. Since

[jira] [Comment Edited] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306558#comment-14306558 ] Yi Liu edited comment on HDFS-7738 at 2/5/15 3:12 AM: -- I notice the pa

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306558#comment-14306558 ] Yi Liu commented on HDFS-7738: -- I notice the patch distinguishes recover lease exception strin

[jira] [Updated] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7738: -- Status: Patch Available (was: Open) > Add more negative tests for truncate > ---

[jira] [Updated] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7738: -- Attachment: h7738_20150204.patch h7738_20150204.patch: adds the new tests and revises the

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

2015-02-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306543#comment-14306543 ] Junping Du commented on HDFS-6261: -- Sounds like a reasonable plan, [~decster]! I may need

[jira] [Commented] (HDFS-7349) Support DFS command for the EC encoding

2015-02-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306525#comment-14306525 ] Kai Zheng commented on HDFS-7349: - OK no problem. I'm working on the way from low level cod

[jira] [Created] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7738: - Summary: Add more negative tests for truncate Key: HDFS-7738 URL: https://issues.apache.org/jira/browse/HDFS-7738 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7371) Loading predefined EC schemas from configuration

2015-02-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306507#comment-14306507 ] Kai Zheng commented on HDFS-7371: - Thanks Zhe. Will look at the design and think about it.

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

2015-02-04 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306506#comment-14306506 ] Binglin Chang commented on HDFS-6261: - bq. I'd prefer to see this get merged into the R

[jira] [Commented] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-02-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306491#comment-14306491 ] Yongjun Zhang commented on HDFS-6054: - Hi [~kihwal], I just uploaded rev 002 to make t

[jira] [Commented] (HDFS-7349) Support DFS command for the EC encoding

2015-02-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306489#comment-14306489 ] Zhe Zhang commented on HDFS-7349: - I agree with selecting from predefined schemas. How abou

[jira] [Updated] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-02-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6054: Attachment: HDFS-6054.002.patch > MiniQJMHACluster should not use static port to avoid binding failur

[jira] [Updated] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6832: --- Status: Open (was: Patch Available) Cancelling patch since it no longer applies. > Fix the us

[jira] [Commented] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306439#comment-14306439 ] Hadoop QA commented on HDFS-6832: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-402) Display the server version in dfsadmin -report

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-402: -- Status: Open (was: Patch Available) Cancelling the patch as it no longer applies. > Display the

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-316: -- Status: Open (was: Patch Available) Cancelling since patch no longer applies. > Balancer should

[jira] [Updated] (HDFS-1918) DataXceiver double logs every IOE out of readBlock

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1918: --- Resolution: Unresolved Status: Resolved (was: Patch Available) Closing as Unresolved.

[jira] [Updated] (HDFS-2304) log libhdfs messages to syslog

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2304: --- Status: Open (was: Patch Available) old, outdated patch. cancelling. > log libhdfs messages t

[jira] [Updated] (HDFS-3728) Update Httpfs documentation

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3728: --- Status: Open (was: Patch Available) Cancelling patch since it no longer applies. > Update Htt

[jira] [Commented] (HDFS-7371) Loading predefined EC schemas from configuration

2015-02-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306421#comment-14306421 ] Zhe Zhang commented on HDFS-7371: - Thanks Kai. It's an interesting and non-trivial questio

[jira] [Updated] (HDFS-4922) Improve the short-circuit document

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4922: --- Target Version/s: 2.1.0-beta, 3.0.0 (was: 3.0.0, 2.1.0-beta) Status: Open (was:

[jira] [Updated] (HDFS-4919) Improve documentation of dfs.permissions.enabled flag.

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4919: --- Target Version/s: 2.1.0-beta, 3.0.0 (was: 3.0.0, 2.1.0-beta) Status: Open (was:

[jira] [Updated] (HDFS-6261) Add document for enabling node group layer in HDFS

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6261: --- Status: Open (was: Patch Available) Cancelling the current patch due to non-applicability and

[jira] [Updated] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6832: --- Status: Patch Available (was: Open) > Fix the usage of 'hdfs namenode' command > -

[jira] [Commented] (HDFS-7546) Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306414#comment-14306414 ] Allen Wittenauer commented on HDFS-7546: +1 lgtm > Document, and set an accepting

[jira] [Updated] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6832: --- Status: Open (was: Patch Available) > Fix the usage of 'hdfs namenode' command > -

[jira] [Commented] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-02-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306407#comment-14306407 ] Jing Zhao commented on HDFS-7716: - Here is the plan: # the class BlockInfo holds the common

[jira] [Commented] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306390#comment-14306390 ] Hadoop QA commented on HDFS-7270: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7733) NFS: readdir/readdirplus return null directory attribute on failure

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306320#comment-14306320 ] Hudson commented on HDFS-7733: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7010 (See [https:

[jira] [Updated] (HDFS-7733) NFS: readdir/readdirplus return null directory attribute on failure

2015-02-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7733: Resolution: Fixed Fix Version/s: 2.6.1 Target Version/s: (was: 2.7.0) Hadoo

[jira] [Commented] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306302#comment-14306302 ] Yi Liu commented on HDFS-7655: -- Thanks [~shv] for review too. Will update the patch to address

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306296#comment-14306296 ] Tsz Wo Nicholas Sze commented on HDFS-3107: --- [~shv], how is the remaining work?

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306295#comment-14306295 ] Yi Liu commented on HDFS-7734: -- Thanks for Andrew, Kihwal and Arpit 's reviews and comments.

[jira] [Resolved] (HDFS-4014) Fix warnings found by findbugs2

2015-02-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved HDFS-4014. - Resolution: Fixed Fix Version/s: 2.0.3-alpha Closing this issue since all of the sub-tasks w

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306261#comment-14306261 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- I do not intention to block the deco

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-02-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306216#comment-14306216 ] Zhe Zhang commented on HDFS-7702: - Thanks [~raviprak] for clarifying. It does sound like a

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-02-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306193#comment-14306193 ] Andrew Wang commented on HDFS-7411: --- I would definitely welcome some other opinions on th

[jira] [Updated] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

2015-02-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7270: - Attachment: HDFS-7270.004.patch > Add congestion signaling capability to DataNode write protocol >

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-02-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306187#comment-14306187 ] Ravi Prakash commented on HDFS-7702: HDFS Federation was static partitioning from what

[jira] [Commented] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-02-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306182#comment-14306182 ] Yongjun Zhang commented on HDFS-6054: - Hi [~kihwal], Thanks a lot for looking into! I

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306167#comment-14306167 ] Kihwal Lee commented on HDFS-7411: -- HDFS-7735 is also being worked on. If we can convince

[jira] [Commented] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306152#comment-14306152 ] Kihwal Lee commented on HDFS-6054: -- Before looking at the patch too hard, I tried running

[jira] [Commented] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306141#comment-14306141 ] Hadoop QA commented on HDFS-7270: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-02-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306131#comment-14306131 ] Zhe Zhang commented on HDFS-7702: - How is this related to HDFS federation (HDFS-1052)? > M

[jira] [Commented] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306034#comment-14306034 ] Hadoop QA commented on HDFS-7692: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
new design doc file is [HDFSErasureCodingDesign-20150204.pdf|https://issues.apache.org/jira/secure/attachment/12696562/HDFSErasureCodingDesign-20150204.pdf]. > Erasure Coding Support inside HDFS > -- > > Key: HDFS-7285 >

[jira] [Updated] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6054: - Component/s: test Target Version/s: 2.7.0 > MiniQJMHACluster should not use static port to avoid b

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305997#comment-14305997 ] Kihwal Lee commented on HDFS-7704: -- {{processQueueMessages()}} is called outside of the tr

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7285: -- Attachment: HDFSErasureCodingDesign-20150204.pdf Revised the design doc as follows

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-02-04 Thread Ray (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray updated HDFS-7702: -- Issue Type: Sub-task (was: New Feature) Parent: HDFS-7737 > Move metadata across namenode - Effort to a real dis

[jira] [Created] (HDFS-7737) Implement distributed namenode

2015-02-04 Thread Ray (JIRA)
Ray created HDFS-7737: - Summary: Implement distributed namenode Key: HDFS-7737 URL: https://issues.apache.org/jira/browse/HDFS-7737 Project: Hadoop HDFS Issue Type: New Feature Reporter: Ray

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-02-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305930#comment-14305930 ] Lei (Eddy) Xu commented on HDFS-7722: - [~usrikanth] Would you mind to let me take on th

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305920#comment-14305920 ] Lei (Eddy) Xu commented on HDFS-7719: - Thank you so much for reviewing and committing t

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7719: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-316) Balancer should run for a configurable # of iterations

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305912#comment-14305912 ] Hadoop QA commented on HDFS-316: {color:red}-1 overall{color}. Here are the results of test

[jira] [Resolved] (HDFS-7018) Implement hdfs.h interface in libhdfs3

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7018. Resolution: Fixed Fix Version/s: HDFS-6994 Target Version/s: HDFS-699

[jira] [Updated] (HDFS-7018) Implement hdfs.h interface in libhdfs3

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7018: --- Summary: Implement hdfs.h interface in libhdfs3 (was: Implement C interface for libhdf

[jira] [Commented] (HDFS-7018) Implement C interface for libhdfs3

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305907#comment-14305907 ] Colin Patrick McCabe commented on HDFS-7018: +1. Thanks, Zhanwei. > Implement

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-316: -- Status: Patch Available (was: Open) > Balancer should run for a configurable # of iterations > --

[jira] [Commented] (HDFS-316) Balancer should run for a configurable # of iterations

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305900#comment-14305900 ] Allen Wittenauer commented on HDFS-316: --- Re-fire the jenkins test > Balancer should r

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

2015-02-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-316: -- Status: Open (was: Patch Available) > Balancer should run for a configurable # of iterations > --

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305889#comment-14305889 ] Hudson commented on HDFS-7719: -- FAILURE: Integrated in Hadoop-trunk-Commit #7005 (See [https:

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305883#comment-14305883 ] Arpit Agarwal commented on HDFS-7734: - Thank you for picking this up [~hitliuyi] and th

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305880#comment-14305880 ] Colin Patrick McCabe commented on HDFS-6994: Hi Haohui, That is interesting.

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305860#comment-14305860 ] Colin Patrick McCabe commented on HDFS-7719: I ran TestDFSMkdirs locally and ca

[jira] [Comment Edited] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305849#comment-14305849 ] Colin Patrick McCabe edited comment on HDFS-7719 at 2/4/15 8:01 PM: -

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305849#comment-14305849 ] Colin Patrick McCabe commented on HDFS-7719: +1. Thanks, Eddy {code} java.lan

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7719: --- Summary: BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state assoc

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305824#comment-14305824 ] Hudson commented on HDFS-7734: -- FAILURE: Integrated in Hadoop-trunk-Commit #7004 (See [https:

[jira] [Updated] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7734: -- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305790#comment-14305790 ] Kihwal Lee commented on HDFS-7734: -- bq. Yi's patch looks good to me, should we just commit

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305771#comment-14305771 ] Andrew Wang commented on HDFS-7734: --- Yi's patch looks good to me, should we just commit t

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-04 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305742#comment-14305742 ] Charles Lamb commented on HDFS-7704: Oh, sorry, one more comment. In the test, to be co

[jira] [Updated] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-02-04 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leitao Guo updated HDFS-7692: - Release Note: Please help review the patch. Thanks! Status: Patch Available (was: Open) > DataSt

[jira] [Updated] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-02-04 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leitao Guo updated HDFS-7692: - Attachment: HDFS-7692.01.patch > DataStorage#addStorageLocations(...) should support MultiThread to speedup

[jira] [Commented] (HDFS-7733) NFS: readdir/readdirplus return null directory attribute on failure

2015-02-04 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305682#comment-14305682 ] Brandon Li commented on HDFS-7733: -- +1. The patch looks good to me. Thank you, Arpit, for

[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

2015-02-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305670#comment-14305670 ] Zhe Zhang commented on HDFS-7652: - This JIRA can only be tested with client striped writing

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305478#comment-14305478 ] Hadoop QA commented on HDFS-7734: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-04 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305452#comment-14305452 ] Charles Lamb commented on HDFS-7704: Hi [~shahrs87], I only have a few nits on the lat

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305262#comment-14305262 ] Hudson commented on HDFS-7712: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2045 (See [htt

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305261#comment-14305261 ] Hudson commented on HDFS-7707: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2045 (See [htt

[jira] [Commented] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305267#comment-14305267 ] Hudson commented on HDFS-7721: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2045 (See [htt

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305208#comment-14305208 ] Hudson commented on HDFS-7707: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #95 (See

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305209#comment-14305209 ] Hudson commented on HDFS-7712: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #95 (See

[jira] [Commented] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305214#comment-14305214 ] Hudson commented on HDFS-7721: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #95 (See

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305190#comment-14305190 ] Kihwal Lee commented on HDFS-7734: -- Since {{MiniDFSCluster}} directly calls {{createNameno

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305184#comment-14305184 ] Hadoop QA commented on HDFS-7734: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Comment Edited] (HDFS-7712) Switch blockStateChangeLog to use slf4j

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305147#comment-14305147 ] Kihwal Lee edited comment on HDFS-7712 at 2/4/15 2:27 PM: -- OMG, I

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305147#comment-14305147 ] Kihwal Lee commented on HDFS-7712: -- OMG, I missed that. Precommit test runs will look dece

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305126#comment-14305126 ] Hudson commented on HDFS-7707: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #91 (See [http

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305127#comment-14305127 ] Hudson commented on HDFS-7712: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #91 (See [http

[jira] [Commented] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305132#comment-14305132 ] Hudson commented on HDFS-7721: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #91 (See [http

[jira] [Commented] (HDFS-7735) Optimize decommission Datanodes to reduce the impact on NameNode's performance

2015-02-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305122#comment-14305122 ] Kihwal Lee commented on HDFS-7735: -- HDFS-7411 is related. Please have a look. > Optimize

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305100#comment-14305100 ] Hudson commented on HDFS-7712: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2026 (See [https://

  1   2   >