[jira] [Commented] (HDFS-5362) Add SnapshotException to terse exception group

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798853#comment-13798853 ] Hadoop QA commented on HDFS-5362: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798901#comment-13798901 ] Hadoop QA commented on HDFS-5167: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

2013-10-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-4754: - Fix Version/s: (was: 2.2.0) 2.2.1 Add an API in the namenode to mark a

[jira] [Updated] (HDFS-5244) TestNNStorageRetentionManager#testPurgeMultipleDirs fails because incorrectly expects Hashmap values to have order.

2013-10-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-5244: - Fix Version/s: (was: 2.2.0) 2.2.1

[jira] [Updated] (HDFS-5098) Enhance FileSystem.Statistics to have locality information

2013-10-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-5098: - Fix Version/s: (was: 2.2.0) 2.2.1 Enhance FileSystem.Statistics to have

[jira] [Updated] (HDFS-5160) MiniDFSCluster webui does not work

2013-10-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-5160: - Fix Version/s: (was: 2.2.0) 2.2.1 MiniDFSCluster webui does not work

[jira] [Updated] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated HDFS-5167: - Attachment: HDFS-5167.6.patch TestMetricsSystemImpl's test failure looks unrelated to me. Test

[jira] [Updated] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated HDFS-5167: - Attachment: HDFS-5167.7.patch I attached wrong patches for last 2 times. I apologize for this.

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798933#comment-13798933 ] Tsuyoshi OZAWA commented on HDFS-5167: -- HDFS-5167.7.patch is correct one. Add

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798935#comment-13798935 ] Radim Kolar commented on HDFS-5365: --- can be this merged to branch-2.1-beta ? Fix

[jira] [Commented] (HDFS-5341) DirectoryScanner hold the object lock dataset too long in scan,it make the datanode turn into deadnode and block all reciving thread

2013-10-18 Thread qus-jiawei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799001#comment-13799001 ] qus-jiawei commented on HDFS-5341: -- Hi Prakash :Thanks for help. In out Hadoop cluster,

[jira] [Commented] (HDFS-4511) Cover package org.apache.hadoop.hdfs.tools with unit test

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799006#comment-13799006 ] Hudson commented on HDFS-4511: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799009#comment-13799009 ] Hudson commented on HDFS-5365: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See

[jira] [Commented] (HDFS-5379) Update links to datanode information in dfshealth.html

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799005#comment-13799005 ] Hudson commented on HDFS-5379: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See

[jira] [Commented] (HDFS-5336) DataNode should not output 'StartupProgress' metrics

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799007#comment-13799007 ] Hudson commented on HDFS-5336: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See

[jira] [Commented] (HDFS-5374) Remove deadcode in DFSOutputStream

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799004#comment-13799004 ] Hudson commented on HDFS-5374: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See

[jira] [Commented] (HDFS-5375) hdfs.cmd does not expose several snapshot commands.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799003#comment-13799003 ] Hudson commented on HDFS-5375: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See

[jira] [Commented] (HDFS-5239) Allow FSNamesystem lock fairness to be configurable

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799029#comment-13799029 ] Hudson commented on HDFS-5239: -- FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #764 (See

[jira] [Commented] (HDFS-4511) Cover package org.apache.hadoop.hdfs.tools with unit test

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799033#comment-13799033 ] Hudson commented on HDFS-4511: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See

[jira] [Commented] (HDFS-5379) Update links to datanode information in dfshealth.html

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799032#comment-13799032 ] Hudson commented on HDFS-5379: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See

[jira] [Commented] (HDFS-5374) Remove deadcode in DFSOutputStream

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799031#comment-13799031 ] Hudson commented on HDFS-5374: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799036#comment-13799036 ] Hudson commented on HDFS-5365: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See

[jira] [Commented] (HDFS-5375) hdfs.cmd does not expose several snapshot commands.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799030#comment-13799030 ] Hudson commented on HDFS-5375: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See

[jira] [Commented] (HDFS-5336) DataNode should not output 'StartupProgress' metrics

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799034#comment-13799034 ] Hudson commented on HDFS-5336: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799038#comment-13799038 ] Hadoop QA commented on HDFS-5167: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4311) repair test org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos

2013-10-18 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated HDFS-4311: - Attachment: HDFS-4311--N1.patch Test rewritten to use MiniKdc. repair test

[jira] [Commented] (HDFS-4311) repair test org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799083#comment-13799083 ] Hadoop QA commented on HDFS-4311: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799095#comment-13799095 ] Hudson commented on HDFS-5365: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See

[jira] [Commented] (HDFS-5375) hdfs.cmd does not expose several snapshot commands.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799089#comment-13799089 ] Hudson commented on HDFS-5375: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See

[jira] [Commented] (HDFS-5379) Update links to datanode information in dfshealth.html

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799091#comment-13799091 ] Hudson commented on HDFS-5379: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See

[jira] [Commented] (HDFS-5374) Remove deadcode in DFSOutputStream

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799090#comment-13799090 ] Hudson commented on HDFS-5374: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See

[jira] [Commented] (HDFS-4511) Cover package org.apache.hadoop.hdfs.tools with unit test

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799092#comment-13799092 ] Hudson commented on HDFS-4511: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See

[jira] [Commented] (HDFS-5336) DataNode should not output 'StartupProgress' metrics

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799093#comment-13799093 ] Hudson commented on HDFS-5336: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See

[jira] [Created] (HDFS-5386) Add feature documentation for datanode caching.

2013-10-18 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5386: --- Summary: Add feature documentation for datanode caching. Key: HDFS-5386 URL: https://issues.apache.org/jira/browse/HDFS-5386 Project: Hadoop HDFS Issue Type:

[jira] [Reopened] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-5365: - bq. can be this merged to branch-2.1-beta ? branch-2.1-beta is closed. Now that release 2.2.0 is

[jira] [Updated] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5365: Target Version/s: 3.0.0, 2.2.1 (was: 3.0.0, 2.3.0) Fix libhdfs compile error on FreeBSD9

[jira] [Updated] (HDFS-4511) Cover package org.apache.hadoop.hdfs.tools with unit test

2013-10-18 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-4511: -- Resolution: Fixed Fix Version/s: 2.3.0 3.0.0 Status:

[jira] [Created] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
Leif Wickland created HDFS-5387: --- Summary: Documentation on FileSystem.createNewFile() is misleading Key: HDFS-5387 URL: https://issues.apache.org/jira/browse/HDFS-5387 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leif Wickland updated HDFS-5387: Attachment: FileSystem.java.patch Here's my suggested change to the document's wording.

[jira] [Updated] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leif Wickland updated HDFS-5387: Description: The documentation for FileSystem.createNewFile() indicates that it will return false

[jira] [Updated] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leif Wickland updated HDFS-5387: Description: The documentation for FileSystem.createNewFile() indicates that it will return false

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799324#comment-13799324 ] Luke Lu commented on HDFS-4885: --- Nicholas suggested offline that we simply pass in the

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799334#comment-13799334 ] Tsz Wo (Nicholas), SZE commented on HDFS-4885: -- Nicholas suggested offline

[jira] [Assigned] (HDFS-5386) Add feature documentation for datanode caching.

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-5386: - Assignee: Andrew Wang Add feature documentation for datanode caching.

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799358#comment-13799358 ] Junping Du commented on HDFS-4885: -- Thanks Luke and Nicholas for comments! bq. More

[jira] [Resolved] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5365. - Resolution: Fixed Fix Version/s: (was: 2.3.0) 2.2.1 I've merged

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799377#comment-13799377 ] Hudson commented on HDFS-5365: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4629 (See

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799381#comment-13799381 ] Junping Du commented on HDFS-4885: -- Sorry. the return value should be changed to

[jira] [Created] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5388: --- Summary: Loading fsimage fails to find cache pools during namenode startup. Key: HDFS-5388 URL: https://issues.apache.org/jira/browse/HDFS-5388 Project: Hadoop HDFS

[jira] [Work started] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5388 started by Chris Nauroth. Loading fsimage fails to find cache pools during namenode startup.

[jira] [Updated] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5388: Attachment: HDFS-5388.1.patch I just noticed the problem this morning after my namenode did a

[jira] [Commented] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799402#comment-13799402 ] Junping Du commented on HDFS-4376: -- Hi [~sureshms], In our offline meet yesterday, you

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v4.patch Address above review comments in v4 patch. Update verifyBlockPlacement()

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5203: Attachment: HDFS-5203.1.patch I'm attaching a preliminary patch. I've tested this manually. This

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799422#comment-13799422 ] Colin Patrick McCabe commented on HDFS-5203: Thanks for tackling this, Chris.

[jira] [Commented] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799473#comment-13799473 ] Colin Patrick McCabe commented on HDFS-5388: +1. thanks, Chris Loading

[jira] [Resolved] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5388. Resolution: Fixed Fix Version/s: HDFS-4949 Loading fsimage fails to find

[jira] [Updated] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5388: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-4949 Loading fsimage fails to

[jira] [Commented] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799480#comment-13799480 ] Chris Nauroth commented on HDFS-5388: - Thanks for committing, Colin. Loading fsimage

[jira] [Commented] (HDFS-2261) AOP unit tests are not getting compiled or run

2013-10-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799481#comment-13799481 ] Karthik Kambatla commented on HDFS-2261: Just checking again if we have a decision

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5203: Attachment: HDFS-5203.2.patch bq. We got rid of the batch operations because they were a big

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799486#comment-13799486 ] Chris Nauroth commented on HDFS-5203: - I also meant to mention that I discovered a bug

[jira] [Commented] (HDFS-5382) Implement the UI of browsing filesystems in HTML 5 page

2013-10-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799496#comment-13799496 ] Jing Zhao commented on HDFS-5382: - bq. Safari, however, still blocks this request, breaking

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799497#comment-13799497 ] Colin Patrick McCabe commented on HDFS-5203: It looks good. The only thing

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5203: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-4949 Concurrent clients that

[jira] [Commented] (HDFS-5347) add HDFS NFS user guide

2013-10-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799509#comment-13799509 ] Jing Zhao commented on HDFS-5347: - The document looks great. Some minors and nits: # uses

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799521#comment-13799521 ] Hadoop QA commented on HDFS-4885: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-5389) Remove INode limitations in Namenode

2013-10-18 Thread Lin Xiao (JIRA)
Lin Xiao created HDFS-5389: -- Summary: Remove INode limitations in Namenode Key: HDFS-5389 URL: https://issues.apache.org/jira/browse/HDFS-5389 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-5389) Remove INode limitations in Namenode

2013-10-18 Thread Lin Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799525#comment-13799525 ] Lin Xiao commented on HDFS-5389: One design to remove the space limits while maintain

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799536#comment-13799536 ] Akira AJISAKA commented on HDFS-5167: - Thanks for taking this issue, [~ozawa]. I built

[jira] [Updated] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5167: Attachment: HDFS-5167.8.patch Attaching the revised patch. Add metrics about the NameNode retry

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5203: Attachment: HDFS-5203.3.patch Here is patch version 3, which adds tests. There is no difference in

[jira] [Commented] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799565#comment-13799565 ] Andrew Wang commented on HDFS-5378: --- Hey Colin, could you rebase this one? Doesn't apply

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799572#comment-13799572 ] Tsz Wo (Nicholas), SZE commented on HDFS-4885: -- - In

[jira] [Resolved] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5203. Resolution: Fixed Fix Version/s: HDFS-4949 Concurrent clients that add a

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799584#comment-13799584 ] Colin Patrick McCabe commented on HDFS-5203: +1, thanks Chris Concurrent

[jira] [Updated] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5378: --- Attachment: HDFS-5378-caching.003.patch rebased In CacheReport, don't send genstamp

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799595#comment-13799595 ] Chris Nauroth commented on HDFS-5203: - Thanks for the code review, Colin. Concurrent

[jira] [Commented] (HDFS-5326) add modifyDirective to cacheAdmin

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799606#comment-13799606 ] Colin Patrick McCabe commented on HDFS-5326: I took a whack at this this

[jira] [Assigned] (HDFS-5180) Add time taken to process the command to audit log

2013-10-18 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita reassigned HDFS-5180: Assignee: Shinichi Yamashita Add time taken to process the command to audit log

[jira] [Updated] (HDFS-5320) Add datanode caching metrics

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5320: -- Attachment: hdfs-5320-2.patch Here's a new rebased patch, minus the cache report rename since I think

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799625#comment-13799625 ] Colin Patrick McCabe commented on HDFS-5276: I ran mvn eclipse:eclipse locally

[jira] [Updated] (HDFS-4995) Make getContentSummary() less expensive

2013-10-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4995: - Attachment: HDFS-4995.trunk.patch The new patch moves the lock yield code to the context object. This is

[jira] [Commented] (HDFS-4995) Make getContentSummary() less expensive

2013-10-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799628#comment-13799628 ] Kihwal Lee commented on HDFS-4995: -- I've tested this with 100 threads creating, renaming

[jira] [Updated] (HDFS-2832) Heartbeats from Datandode should include one storage report per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Summary: Heartbeats from Datandode should include one storage report per storage (was: Enable

[jira] [Updated] (HDFS-5390) Incremental block reports should be sent per storage directory

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5390: Summary: Incremental block reports should be sent per storage directory (was: Incremental block

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Summary: Enable support for heterogeneous storages in HDFS (was: Heartbeats from Datandode should

[jira] [Updated] (HDFS-5377) Heartbeats from Datandode should include one storage report per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5377: Summary: Heartbeats from Datandode should include one storage report per storage (was: Storage

[jira] [Updated] (HDFS-5377) Heartbeats from Datandode should include one storage report per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5377: Description: Heartbeats must include one storage report per storage directory, so that usage

[jira] [Updated] (HDFS-5377) Heartbeats from Datandode should include one storage report per storage directory

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5377: Summary: Heartbeats from Datandode should include one storage report per storage directory (was:

[jira] [Commented] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799640#comment-13799640 ] Andrew Wang commented on HDFS-5378: --- Looks mostly good, just a few things: * Need to

[jira] [Updated] (HDFS-5347) add HDFS NFS user guide

2013-10-18 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5347: - Attachment: HDFS-5347.003.patch Thank you, Jing. I've uploaded a new patch to address the comments. add

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799651#comment-13799651 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for carefully review. All comments

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v5.patch Update verifyBlockPlacement() API in BlockPlacementPolicy

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799676#comment-13799676 ] Hadoop QA commented on HDFS-5167: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5276: --- Resolution: Fixed Fix Version/s: 2.3.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799689#comment-13799689 ] Hudson commented on HDFS-5276: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4632 (See

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799692#comment-13799692 ] Tsuyoshi OZAWA commented on HDFS-5167: -- Thanks for catching up, Akira. [~jingzhao],

[jira] [Updated] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5378: --- Attachment: HDFS-5378-caching.004.patch thanks for the review. I renamed the

[jira] [Commented] (HDFS-4995) Make getContentSummary() less expensive

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799719#comment-13799719 ] Hadoop QA commented on HDFS-4995: - {color:green}+1 overall{color}. Here are the results of

  1   2   >