[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296627#comment-14296627 ] Hadoop QA commented on HDFS-7584: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-01-29 Thread ray zhang (JIRA)
ray zhang created HDFS-7702: --- Summary: Move metadata across namenode - Effort to a real distributed namenode Key: HDFS-7702 URL: https://issues.apache.org/jira/browse/HDFS-7702 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296718#comment-14296718 ] Hudson commented on HDFS-6673: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #88 (See [http

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296723#comment-14296723 ] Hudson commented on HDFS-7423: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #88 (See [http

[jira] [Commented] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296719#comment-14296719 ] Hudson commented on HDFS-7681: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #88 (See [http

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296722#comment-14296722 ] Hudson commented on HDFS-7611: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #88 (See [http

[jira] [Commented] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296730#comment-14296730 ] Hudson commented on HDFS-7681: -- FAILURE: Integrated in Hadoop-Yarn-trunk #822 (See [https://b

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296734#comment-14296734 ] Hudson commented on HDFS-7423: -- FAILURE: Integrated in Hadoop-Yarn-trunk #822 (See [https://b

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296733#comment-14296733 ] Hudson commented on HDFS-7611: -- FAILURE: Integrated in Hadoop-Yarn-trunk #822 (See [https://b

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296729#comment-14296729 ] Hudson commented on HDFS-6673: -- FAILURE: Integrated in Hadoop-Yarn-trunk #822 (See [https://b

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-01-29 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Affects Version/s: 2.6.0 > Support favouredNodes for the append for new blocks >

[jira] [Created] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-01-29 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-7703: --- Summary: Support favouredNodes for the append for new blocks Key: HDFS-7703 URL: https://issues.apache.org/jira/browse/HDFS-7703 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296801#comment-14296801 ] Charles Lamb commented on HDFS-7423: bq. Is it correct? Yes, it's ok because statistic

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296804#comment-14296804 ] Hudson commented on HDFS-6673: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #89 (See

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296807#comment-14296807 ] Hudson commented on HDFS-7611: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #89 (See

[jira] [Commented] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296805#comment-14296805 ] Hudson commented on HDFS-7681: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #89 (See

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296808#comment-14296808 ] Hudson commented on HDFS-7423: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #89 (See

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296899#comment-14296899 ] Hudson commented on HDFS-7423: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #85 (See [http

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296894#comment-14296894 ] Hudson commented on HDFS-6673: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #85 (See [http

[jira] [Commented] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296895#comment-14296895 ] Hudson commented on HDFS-7681: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #85 (See [http

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296898#comment-14296898 ] Hudson commented on HDFS-7611: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #85 (See [http

[jira] [Assigned] (HDFS-7648) Verify the datanode directory layout

2015-01-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-7648: -- Assignee: Rakesh R > Verify the datanode directory layout > > >

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296932#comment-14296932 ] Hudson commented on HDFS-7611: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2020 (See [https://

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296925#comment-14296925 ] Rakesh R commented on HDFS-7648: Thanks [~cmccabe] for comments. bq.Probably what we want t

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296928#comment-14296928 ] Hudson commented on HDFS-6673: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2020 (See [https://

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296933#comment-14296933 ] Hudson commented on HDFS-7423: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2020 (See [https://

[jira] [Commented] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296929#comment-14296929 ] Hudson commented on HDFS-7681: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2020 (See [https://

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297005#comment-14297005 ] Hudson commented on HDFS-7423: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2039 (See [htt

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297001#comment-14297001 ] Hudson commented on HDFS-6673: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2039 (See [htt

[jira] [Commented] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297002#comment-14297002 ] Hudson commented on HDFS-7681: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2039 (See [htt

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297004#comment-14297004 ] Hudson commented on HDFS-7611: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2039 (See [htt

[jira] [Created] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-7704: Summary: DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out. Key: HDFS-7704 URL: https://issues.apache.org/jira/browse/HDFS-770

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Attachment: HDFS-7704.patch > DN heartbeat to Active NN may be blocked and expire if connection to

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Status: Patch Available (was: Open) To fix the issue, I created a queue for each actor thread whic

[jira] [Updated] (HDFS-6884) Include the hostname in HTTPFS log filenames

2015-01-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6884: --- Status: Open (was: Patch Available) > Include the hostname in HTTPFS log filenames > -

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297130#comment-14297130 ] Xiaoyu Yao commented on HDFS-7584: -- org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOf

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2015-01-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297133#comment-14297133 ] Ming Ma commented on HDFS-7314: --- Thanks, [~jira.shegalov]. That is interesting. That might wo

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: editsStored > Enable Quota Support for Storage Types > -- >

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.9.1.patch > Enable Quota Support for Storage Types >

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297157#comment-14297157 ] Hadoop QA commented on HDFS-7584: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.9a.patch Reorder the patch name for Jenkins to pick up the latest. > Enable Quota Su

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2015-01-29 Thread Subbu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297190#comment-14297190 ] Subbu commented on HDFS-7175: - The problem that we face is that if we turn on showprogress, the

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2015-01-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297199#comment-14297199 ] Allen Wittenauer commented on HDFS-7175: I'm talking specifically about the null no

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2015-01-29 Thread Subbu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297207#comment-14297207 ] Subbu commented on HDFS-7175: - I tried on jdk7. Note that the timeout happens only on large cl

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2015-01-29 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297266#comment-14297266 ] Gera Shegalov commented on HDFS-7314: - Actually I need to take #1 back, I misspoke DFS#

[jira] [Updated] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-01-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4265: --- Attachment: 0005-HDFS-4265.patch > BKJM doesn't take advantage of speculative reads > -

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-01-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297298#comment-14297298 ] Rakesh R commented on HDFS-4265: I've rebased the fix on trunk and attached new patch. Ther

[jira] [Commented] (HDFS-7603) The background replication queue initialization may not let others run

2015-01-29 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297302#comment-14297302 ] Daryn Sharp commented on HDFS-7603: --- +1 Looks good, understood too hard to write a test t

[jira] [Updated] (HDFS-7603) The background replication queue initialization may not let others run

2015-01-29 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7603: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7603) The background replication queue initialization may not let others run

2015-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297315#comment-14297315 ] Hudson commented on HDFS-7603: -- FAILURE: Integrated in Hadoop-trunk-Commit #6962 (See [https:

[jira] [Commented] (HDFS-7577) Add additional headers that includes need by Windows

2015-01-29 Thread Thanh Do (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297336#comment-14297336 ] Thanh Do commented on HDFS-7577: Thanks Colin. I'll work on the next patch soon. Best! > A

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297368#comment-14297368 ] Hadoop QA commented on HDFS-4265: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297385#comment-14297385 ] Hadoop QA commented on HDFS-7704: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7696) FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors

2015-01-29 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297416#comment-14297416 ] Joe Pallas commented on HDFS-7696: -- That looks right; I'm embarrassed I didn't do it mysel

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

2015-01-29 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Status: In Progress (was: Patch Available) > DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but

[jira] [Commented] (HDFS-7693) libhdfs: add hdfsFile cache

2015-01-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297456#comment-14297456 ] Chris Nauroth commented on HDFS-7693: - Hi Colin. I've only taken a quick scan of the p

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-01-29 Thread Ray (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297455#comment-14297455 ] Ray commented on HDFS-7702: --- Wrote a draft proposal. https://cwiki.apache.org/confluence/display/

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297476#comment-14297476 ] Rushabh S Shah commented on HDFS-7704: -- This test pass on my local setup. > DN heartb

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297658#comment-14297658 ] Hadoop QA commented on HDFS-7584: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-01-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297657#comment-14297657 ] Charles Lamb commented on HDFS-7702: Hi [~xiyunyue], I read over your proposal and hav

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-01-29 Thread Ray (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297712#comment-14297712 ] Ray commented on HDFS-7702: --- Hi [~clamb], Good questions. For the failure scenarios, I will docum

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-01-29 Thread Ray (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297745#comment-14297745 ] Ray commented on HDFS-7702: --- Is the transfer granularity blockpool only? This is the last step(C

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-01-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297759#comment-14297759 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- Thanks for posting the meeting note.

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.9b.patch Fix the findbugs issue. > Enable Quota Support for Storage Types >

[jira] [Created] (HDFS-7705) {{FileSystem}} should expose some performance characteristics for caller (e.g., FsShell) to choose right algorithm.

2015-01-29 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7705: --- Summary: {{FileSystem}} should expose some performance characteristics for caller (e.g., FsShell) to choose right algorithm. Key: HDFS-7705 URL: https://issues.apache.org/jira/brows

[jira] [Updated] (HDFS-7705) FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

2015-01-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7705: Summary: FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choo

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297816#comment-14297816 ] Kihwal Lee commented on HDFS-7704: -- The high-level approach seems fine, but use of {{Datan

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297887#comment-14297887 ] Charles Lamb commented on HDFS-7704: Hi [~shahrs87], A couple of quick comments: {cod

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297894#comment-14297894 ] Colin Patrick McCabe commented on HDFS-7648: bq. Do you meant, DirectoryScanner

[jira] [Created] (HDFS-7706) Switch BlockManager logging to use slf4j

2015-01-29 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-7706: - Summary: Switch BlockManager logging to use slf4j Key: HDFS-7706 URL: https://issues.apache.org/jira/browse/HDFS-7706 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7706) Switch BlockManager logging to use slf4j

2015-01-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7706: -- Attachment: hdfs-7706.001.patch Patch attached. Also refactored a common logging idiom I saw in tests int

[jira] [Updated] (HDFS-7706) Switch BlockManager logging to use slf4j

2015-01-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7706: -- Status: Patch Available (was: Open) > Switch BlockManager logging to use slf4j > ---

[jira] [Commented] (HDFS-7706) Switch BlockManager logging to use slf4j

2015-01-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297950#comment-14297950 ] Yi Liu commented on HDFS-7706: -- Thanks Andrew, +1 pending Jenkins > Switch BlockManager loggi

[jira] [Updated] (HDFS-7339) Allocating and persisting block groups in NameNode

2015-01-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7339: Attachment: HDFS-7339-007.patch Updated patch based on latest [discussion | https://issues.apache.org/jira/b

[jira] [Created] (HDFS-7707) Edit log corruption due to delayed block removal again

2015-01-29 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-7707: --- Summary: Edit log corruption due to delayed block removal again Key: HDFS-7707 URL: https://issues.apache.org/jira/browse/HDFS-7707 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

2015-01-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298003#comment-14298003 ] Yongjun Zhang commented on HDFS-7707: - One possible solution I thought about is, whenev

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298016#comment-14298016 ] Hadoop QA commented on HDFS-7339: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298027#comment-14298027 ] Hadoop QA commented on HDFS-7584: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2015-01-29 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-7708: --- Summary: Balancer should delete its pid file when it completes rebalance Key: HDFS-7708 URL: https://issues.apache.org/jira/browse/HDFS-7708 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2015-01-29 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7708: Description: When balancer completes rebalance and exits, it does not delete its pid file. Starting

[jira] [Commented] (HDFS-7706) Switch BlockManager logging to use slf4j

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298164#comment-14298164 ] Hadoop QA commented on HDFS-7706: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.9c.patch refactor addDirectoryWithQuotaFeature > Enable Quota Support for Storage Ty

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: (was: editsStored) > Enable Quota Support for Storage Types > -

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: (was: HDFS-7584.9.1.patch) > Enable Quota Support for Storage Types > -

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-01-29 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Status: Patch Available (was: Open) > Support favouredNodes for the append for new blocks >

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-01-29 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Attachment: HDFS-7703-001.patch Attaching the patch. Please review. > Support favouredNodes for the

[jira] [Commented] (HDFS-7706) Switch BlockManager logging to use slf4j

2015-01-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298216#comment-14298216 ] Xiaoyu Yao commented on HDFS-7706: -- The patch looks good to me. One question: why import

[jira] [Commented] (HDFS-7501) TransactionsSinceLastCheckpoint can be negative on SBNs

2015-01-29 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298235#comment-14298235 ] Harsh J commented on HDFS-7501: --- [~daryn] - The metric goes negative at the standby after the

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-01-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298294#comment-14298294 ] Hadoop QA commented on HDFS-7584: - {color:red}-1 overall{color}. Here are the results of t