[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356413#comment-14356413 ] Rakesh R commented on HDFS-5356: Thanks [~cmccabe] for the explanation and helps to underst

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5356: --- Attachment: HDFS-5356-4.patch > MiniDFSCluster shoud close all open FileSystems when shutdown() > -

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: HDFS-7915.001.patch > The DataNode can sometimes allocate a ShortCircuitShm

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Status: Patch Available (was: Open) > The DataNode can sometimes allocate a ShortCircu

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: (was: HDFS-7915.001.patch) > The DataNode can sometimes allocate a Shor

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356374#comment-14356374 ] Arun Suresh commented on HDFS-5796: --- Also, please consider using HADOOP-11702, which modi

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-03-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356375#comment-14356375 ] Ming Ma commented on HDFS-7877: --- Thanks Eddy for the review and suggestions. Please find my r

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356370#comment-14356370 ] Arun Suresh commented on HDFS-5796: --- bq. I'm actually inclined to say no, since the othe

[jira] [Commented] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356369#comment-14356369 ] Hadoop QA commented on HDFS-7864: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-10 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7864: -- Status: Patch Available (was: Open) > Erasure Coding: Update safemode calculation for striped blocks > -

[jira] [Updated] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-10 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7864: -- Attachment: HDFS-7864.2.patch safemode calculation has been modified for stripedBlock by checking wether the sto

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356340#comment-14356340 ] Brahma Reddy Battula commented on HDFS-7884: Thanks for update!! Even I ran loc

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356253#comment-14356253 ] Hadoop QA commented on HDFS-5796: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356252#comment-14356252 ] Walter Su commented on HDFS-7285: - I have a problem how to make EC files use specially desi

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356233#comment-14356233 ] Walter Su commented on HDFS-7068: - *Goal* NameNode can use different block placement polici

[jira] [Commented] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-03-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356183#comment-14356183 ] Kai Zheng commented on HDFS-7369: - Thanks [~zhz] for working on this part. I will try to ha

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356162#comment-14356162 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7914) TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356160#comment-14356160 ] Hadoop QA commented on HDFS-7914: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-10 Thread Thanh Do (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356161#comment-14356161 ] Thanh Do commented on HDFS-7360: +1. > Test libhdfs3 against MiniDFSCluster >

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356156#comment-14356156 ] Colin Patrick McCabe commented on HDFS-7915: I think putting the "unregister sl

[jira] [Created] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-10 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7915: -- Summary: The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error Key: HDFS-7915 URL: https://issu

[jira] [Commented] (HDFS-7737) Implement distributed namenode

2015-03-10 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356147#comment-14356147 ] Ray Zhang commented on HDFS-7737: - Have finished prototype without replication feature, wil

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356134#comment-14356134 ] Hudson commented on HDFS-7830: -- FAILURE: Integrated in Hadoop-trunk-Commit #7302 (See [https:

[jira] [Updated] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7830: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-10 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356111#comment-14356111 ] Takanobu Asanuma commented on HDFS-7829: Thank you for the helpful advice! I agree

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356110#comment-14356110 ] Brahma Reddy Battula commented on HDFS-7894: Test case failures are un-related

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-10 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356104#comment-14356104 ] jack liuquan commented on HDFS-7715: OK, I see. Thanks for your responses. > Implement

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-10 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356105#comment-14356105 ] jack liuquan commented on HDFS-7715: OK, I see. Thanks for your responses. > Implement

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356100#comment-14356100 ] Hadoop QA commented on HDFS-7894: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356097#comment-14356097 ] Jing Zhao commented on HDFS-7854: - I think we can also declare {{DFSOutputStream.src}} as f

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356094#comment-14356094 ] Jing Zhao commented on HDFS-7854: - Some comments so far: # Can we keep {{currentSeqno}}, {{

[jira] [Commented] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356092#comment-14356092 ] Hadoop QA commented on HDFS-2605: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356068#comment-14356068 ] Colin Patrick McCabe commented on HDFS-7830: +1. Thanks, [~eddyxu]. > DataNod

[jira] [Commented] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-10 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356059#comment-14356059 ] Zhanwei Wang commented on HDFS-7360: Hi [~thanhdo] I do not know if Hadoop supports co

[jira] [Commented] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-10 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356052#comment-14356052 ] Zhanwei Wang commented on HDFS-7360: Any comments on the new patch? > Test libhdfs3 ag

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356048#comment-14356048 ] Allen Wittenauer commented on HDFS-5796: bq. I don't quite follow – I wonder, why s

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356032#comment-14356032 ] Konstantin Shvachko commented on HDFS-7886: --- Thanks for clarifying Yi, I see it n

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356007#comment-14356007 ] Hadoop QA commented on HDFS-7830: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356001#comment-14356001 ] Zhe Zhang commented on HDFS-7912: - I've just posted a patch for HDFS-7369. Looking forward

[jira] [Updated] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Attachment: HDFS-7369-001.patch The main change in this patch is to extend existing {{ReplicationWork}} class

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355997#comment-14355997 ] Hadoop QA commented on HDFS-7830: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355992#comment-14355992 ] Haohui Mai commented on HDFS-5796: -- I don't quite follow -- I wonder, why setting the secr

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355981#comment-14355981 ] Kai Zheng commented on HDFS-7285: - As discussed previously, I updated the document for the

[jira] [Updated] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-03-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7337: Attachment: PluggableErasureCodec-v2.pdf Updated the document according to the major discussions online or of

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355960#comment-14355960 ] Lei (Eddy) Xu commented on HDFS-7884: - I ran {{mvn test -Dtest=TestDatanodeManager}} on

[jira] [Comment Edited] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355950#comment-14355950 ] Allen Wittenauer edited comment on HDFS-5796 at 3/10/15 11:39 PM: ---

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355950#comment-14355950 ] Allen Wittenauer commented on HDFS-5796: I'm (obviously) +1. This fixes the issues

[jira] [Updated] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6658: -- Attachment: HDFS-6658.patch There's likely to be some todo debris, maybe snippets of other work, and some

[jira] [Comment Edited] (HDFS-7007) Interfaces to plugin ConsensusNode.

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354427#comment-14354427 ] Konstantin Shvachko edited comment on HDFS-7007 at 3/10/15 11:37 PM:

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355932#comment-14355932 ] Daryn Sharp commented on HDFS-6658: --- Sorry, didn't see your reply, but great minds think

[jira] [Updated] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Sasson updated HDFS-5796: -- Assignee: Ryan Sasson (was: Arun Suresh) Status: Patch Available (was: Open) This patch allows We

[jira] [Updated] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Sasson updated HDFS-5796: -- Status: Open (was: Patch Available) > The file system browser in the namenode UI requires SPNEGO. >

[jira] [Updated] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Sasson updated HDFS-5796: -- Attachment: HDFS-5796.4.patch > The file system browser in the namenode UI requires SPNEGO. > ---

[jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355908#comment-14355908 ] Jing Zhao commented on HDFS-7826: - 6. Maybe we can temporarily define this chunksize in Hdf

[jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355905#comment-14355905 ] Jing Zhao commented on HDFS-7826: - Thanks for updating the patch, Kai. The latest patch loo

[jira] [Updated] (HDFS-7914) TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS.

2015-03-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7914: - Status: Patch Available (was: Open) > TestJournalNode#testFailToStartWithBadConfig failed consistently whe

[jira] [Updated] (HDFS-7914) TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS.

2015-03-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7914: - Attachment: HDFS-7914.00.patch Post v0 patch that changes the failed test to use free port for journal node

[jira] [Created] (HDFS-7914) TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS.

2015-03-10 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7914: Summary: TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS. Key: HDFS-7914 URL: https://issues.apac

[jira] [Assigned] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-7913: -- Assignee: Brahma Reddy Battula > HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in d

[jira] [Commented] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355854#comment-14355854 ] Jing Zhao commented on HDFS-7864: - Hi Rui, I think you're on the correct the track. Some co

[jira] [Created] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-10 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7913: -- Summary: HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations Key: HDFS-7913 URL: https://issues.apache.org/jira/browse/HDFS-7913 Project: Hadoop HDFS

[jira] [Commented] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355830#comment-14355830 ] Konstantin Shvachko commented on HDFS-2605: --- +1 Thanks. > CHANGES.txt has two "R

[jira] [Updated] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7864: Status: Open (was: Patch Available) > Erasure Coding: Update safemode calculation for striped blocks > -

[jira] [Updated] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

2015-03-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2605: --- Attachment: HDFS-2605-01.patch Oh I get it now. New patch, just removes the first 0.21.1. > C

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355787#comment-14355787 ] Jing Zhao commented on HDFS-7829: - Thanks for updating the patch, Takanobu. So my main con

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355752#comment-14355752 ] Jing Zhao commented on HDFS-7827: - Hi Hui, the current patch looks good to me. One comment

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355701#comment-14355701 ] Colin Patrick McCabe commented on HDFS-7846: bq. Yi asked: For original BlockIn

[jira] [Updated] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7830: Attachment: HDFS-7830.004.patch Sorry. I did not rebase to trunk last time. I created a new patch aft

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355641#comment-14355641 ] Konstantin Shvachko commented on HDFS-7903: --- The fix looks good. # One nit to rep

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-03-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355589#comment-14355589 ] Lei (Eddy) Xu commented on HDFS-7877: - Hi, [~mingma]. This work looks great and more co

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-10 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355489#comment-14355489 ] Ray Zhang commented on HDFS-7702: - Have finished a prototype of metadata moving tools. Will

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355445#comment-14355445 ] Zhe Zhang commented on HDFS-7912: - bq. In general I think to track the whole BlockInfoStrip

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355438#comment-14355438 ] Hadoop QA commented on HDFS-7903: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-7903: --- Attachment: HDFS-7903.1.patch Regenerated patch. > Cannot recover block after truncate and del

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355423#comment-14355423 ] Jing Zhao commented on HDFS-7912: - Thanks for the comments, Zhe! Yeah, the main motivation

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355401#comment-14355401 ] Hadoop QA commented on HDFS-7722: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Release Note: This change introduces a new configuration key used to throttle decommissioning work, "dfs

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355391#comment-14355391 ] Hadoop QA commented on HDFS-7830: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355379#comment-14355379 ] Plamen Jeliazkov commented on HDFS-7903: The block will be scheduled for deletion w

[jira] [Updated] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Attachment: HDFS-7369-000-part1.patch > Erasure coding: distribute block recovery work to DataNode >

[jira] [Commented] (HDFS-2115) Transparent compression in HDFS

2015-03-10 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355349#comment-14355349 ] Hari Sekhon commented on HDFS-2115: --- MapR-FS provides transparent compression at the file

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355330#comment-14355330 ] Hadoop QA commented on HDFS-7830: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355294#comment-14355294 ] Zhe Zhang commented on HDFS-7912: - Thanks for the work Jing! I'm working on HDFS-7369 which

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355284#comment-14355284 ] Jing Zhao commented on HDFS-7827: - Yes, you're right. > Erasure Coding: support striped bl

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355281#comment-14355281 ] Jing Zhao commented on HDFS-7898: - committed into 2.7 > Change TestAppendSnapshotTruncate

[jira] [Updated] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7898: Fix Version/s: (was: 2.8.0) 2.7.0 > Change TestAppendSnapshotTruncate to fail-fast > -

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355278#comment-14355278 ] Jing Zhao commented on HDFS-7898: - Thanks for the correction, [~ajisakaa]! Actually this fi

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355103#comment-14355103 ] Arun Suresh commented on HDFS-6826: --- Will be fixing the test cases.. But I was wondering

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355069#comment-14355069 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2078 (See [htt

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355070#comment-14355070 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2078 (See [htt

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355044#comment-14355044 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #128 (See

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355043#comment-14355043 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #128 (See

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355019#comment-14355019 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #119 (See [htt

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355028#comment-14355028 ] Yi Liu commented on HDFS-7886: -- Thanks Konst and Plamen for the comments. Following is reply t

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355020#comment-14355020 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #119 (See [htt

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354984#comment-14354984 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2060 (See [https://

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354980#comment-14354980 ] Yi Liu commented on HDFS-7846: -- Another comment is about block replicas: the replication numbe

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354983#comment-14354983 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2060 (See [https://

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354970#comment-14354970 ] Brahma Reddy Battula commented on HDFS-7894: Thanks!!! > Rolling upgrade readi

[jira] [Comment Edited] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353850#comment-14353850 ] Yi Liu edited comment on HDFS-7847 at 3/10/15 2:25 PM: --- Thanks [~arpi

  1   2   >