[jira] [Created] (HDFS-7792) Add links to FaultInjectFramework and SLGUserGuide to site index

2015-02-12 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-7792: -- Summary: Add links to FaultInjectFramework and SLGUserGuide to site index Key: HDFS-7792 URL: https://issues.apache.org/jira/browse/HDFS-7792 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-12 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319477#comment-14319477 ] zhaoyunjiong commented on HDFS-6133: {quote} Is there use scenario that one want to spe

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319479#comment-14319479 ] Hadoop QA commented on HDFS-7713: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319487#comment-14319487 ] Hudson commented on HDFS-7668: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7100 (See [https:

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319503#comment-14319503 ] Yongjun Zhang commented on HDFS-6133: - Another factor is how many blocks a file have, s

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

2015-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319516#comment-14319516 ] Arpit Agarwal commented on HDFS-7009: - Hi [~mingma], thanks for reporting this issue an

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319517#comment-14319517 ] Uma Maheswara Rao G commented on HDFS-7729: --- Great thoughts! I think here my sugg

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319523#comment-14319523 ] Kai Zheng commented on HDFS-7729: - Hi [~umamaheswararao], Good idea. Let me proceed to fil

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319522#comment-14319522 ] Hadoop QA commented on HDFS-7009: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7793) Refactor DFSOutputStream seperating DataStreamer out

2015-02-12 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7793: --- Summary: Refactor DFSOutputStream seperating DataStreamer out Key: HDFS-7793 URL: https://issues.apache.org/jira/browse/HDFS-7793 Project: Hadoop HDFS Issue Type: Impr

[jira] [Updated] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7793: Summary: Refactor DFSOutputStream separating DataStreamer out (was: Refactor DFSOutputStream seperating Data

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319530#comment-14319530 ] Kai Zheng commented on HDFS-7729: - I opened HDFS-7793 for the refactoring. Thanks all ! >

[jira] [Updated] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7793: Description: As proposed by [~jingzhao], [~szetszwo] and discussed with [~zhz] in HDFS-7729, it would be grea

[jira] [Updated] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7648: --- Attachment: HDFS-7648-3.patch > Verify the datanode directory layout > > >

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319537#comment-14319537 ] Li Bo commented on HDFS-7729: - At first my idea is using a block writer to receive bytes and wr

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319541#comment-14319541 ] Rakesh R commented on HDFS-7648: bq. If there are a bunch of files in the wrong location, w

[jira] [Updated] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7648: --- Status: Patch Available (was: Open) > Verify the datanode directory layout > -

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319546#comment-14319546 ] Li Bo commented on HDFS-7729: - Thanks [~zhz] , [~drankye], [~jingzhao], [~umamaheswararao] ,[~s

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

2015-02-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319549#comment-14319549 ] Ming Ma commented on HDFS-7009: --- Thanks, [~arpitagarwal]. The patch seems to be useful even a

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319589#comment-14319589 ] Hadoop QA commented on HDFS-7668: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7759) Provide existence-of-a-second-file implementation for pinning blocks on Datanode

2015-02-12 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7759: --- Attachment: HDFS-7759.patch I'll add more unit test and check the logic for upgrade and finalizeUpgrade

[jira] [Commented] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319621#comment-14319621 ] Vinayakumar B commented on HDFS-7703: - Merged to branch-2 as well. > Support favouredN

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Fix Version/s: (was: 3.0.0) 2.7.0 > Support favouredNodes for the append for n

[jira] [Commented] (HDFS-3689) Add support for variable length block

2015-02-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319623#comment-14319623 ] Vinayakumar B commented on HDFS-3689: - Thanks [~jingzhao]. > Add support for variable

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319622#comment-14319622 ] Hadoop QA commented on HDFS-7686: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Attachment: HDFS-7703-003.patch Attaching the committed patch with trailing spaces removed and format

[jira] [Updated] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7793: Attachment: HDFS-7793.000.patch Thanks for working on this, Bo! I also spent some time on this and got a ve

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319634#comment-14319634 ] Li Bo commented on HDFS-7793: - Great! Thanks for helping me and I will go on working on your pa

[jira] [Updated] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

2015-02-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7410: Attachment: HDFS-7410-003.patch Updated the patch after HDFS-3689 is in. In the latest patch, FileSys

[jira] [Updated] (HDFS-7784) load fsimage in parallel

2015-02-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7784: Target Version/s: 3.0.0 Status: Patch Available (was: Open) > load fsimage in parallel > -

[jira] [Updated] (HDFS-7784) load fsimage in parallel

2015-02-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7784: Attachment: HDFS-7784.001.patch compatible with the old fsimage file. > load fsimage in parallel > -

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319684#comment-14319684 ] Walter Su commented on HDFS-7784: - I'll upload performance test results in 4 hours. > load

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319692#comment-14319692 ] Zhe Zhang commented on HDFS-7729: - [~libo-intel] Thank you for taking on the refactor task!

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319696#comment-14319696 ] Zhe Zhang commented on HDFS-7793: - [~jingzhao] That was fast :) Just to clarify, is the fin

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319704#comment-14319704 ] Jing Zhao commented on HDFS-7793: - bq. is the final plan still to move DataStreamer out as

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319716#comment-14319716 ] Hadoop QA commented on HDFS-7648: - {color:red}-1 overall{color}. Here are the results of t

<    1   2   3