[jira] [Commented] (HDFS-5346) Replication queues should not be initialized in the middle of IBR processing.

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794933#comment-13794933 ] Hadoop QA commented on HDFS-5346: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794918#comment-13794918 ] Suresh Srinivas commented on HDFS-5361: --- Given this is incompatible, the target versi

[jira] [Commented] (HDFS-5330) fix readdir and readdirplus for large directories

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794917#comment-13794917 ] Hadoop QA commented on HDFS-5330: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-5364) Add OpenFileCtx cache

2013-10-14 Thread Brandon Li (JIRA)
Brandon Li created HDFS-5364: Summary: Add OpenFileCtx cache Key: HDFS-5364 URL: https://issues.apache.org/jira/browse/HDFS-5364 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Br

[jira] [Commented] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794907#comment-13794907 ] Hadoop QA commented on HDFS-5361: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5343) When cat command is issued on snapshot files getting unexpected result

2013-10-14 Thread sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sathish updated HDFS-5343: -- Attachment: HDFS-5343-001.patch > When cat command is issued on snapshot files getting unexpected result > -

[jira] [Commented] (HDFS-5343) When cat command is issued on snapshot files getting unexpected result

2013-10-14 Thread sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794881#comment-13794881 ] sathish commented on HDFS-5343: --- // update current position if (updatePosition) {

[jira] [Commented] (HDFS-5343) When cat command is issued on snapshot files getting unexpected result

2013-10-14 Thread sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794883#comment-13794883 ] sathish commented on HDFS-5343: --- for this i am attching a fix and testcase in this pacth,plea

[jira] [Updated] (HDFS-5331) make SnapshotDiff.java to a o.a.h.util.Tool interface implementation

2013-10-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5331: Status: Patch Available (was: Open) > make SnapshotDiff.java to a o.a.h.util.Tool interface implementation > --

[jira] [Commented] (HDFS-5331) make SnapshotDiff.java to a o.a.h.util.Tool interface implementation

2013-10-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794877#comment-13794877 ] Vinay commented on HDFS-5331: - Thanks Uma for taking a look at Jira. Since comments are alread

[jira] [Updated] (HDFS-5283) NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold

2013-10-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5283: Attachment: (was: HDFS-5283.patch) > NN not coming out of startup safemode due to under construction blocks only

[jira] [Updated] (HDFS-5283) NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold

2013-10-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5283: Attachment: HDFS-5283.patch > NN not coming out of startup safemode due to under construction blocks only > inside

[jira] [Updated] (HDFS-5283) NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold

2013-10-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5283: Attachment: HDFS-5283.patch Thanks Nicholas for taking a look at patch. Attaching the patch updated with as per com

[jira] [Commented] (HDFS-5363) Create SPENGO-authenticated connection in URLConnectionFactory instead WebHdfsFileSystem

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794872#comment-13794872 ] Hadoop QA commented on HDFS-5363: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5361: Attachment: HDFS-5361.2.patch Modified the patch to fix unit tests. > Change the unit of StartupPro

[jira] [Updated] (HDFS-5330) fix readdir and readdirplus for large directories

2013-10-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5330: - Status: Patch Available (was: Open) > fix readdir and readdirplus for large directories > ---

[jira] [Updated] (HDFS-5330) fix readdir and readdirplus for large directories

2013-10-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5330: - Attachment: HDFS-5330.001.patch > fix readdir and readdirplus for large directories >

[jira] [Updated] (HDFS-5346) Replication queues should not be initialized in the middle of IBR processing.

2013-10-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-5346: --- Attachment: HDFS-5346.patch Patch for trunk > Replication queues should not be initialized in the mid

[jira] [Updated] (HDFS-5346) Replication queues should not be initialized in the middle of IBR processing.

2013-10-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-5346: --- Status: Patch Available (was: Open) > Replication queues should not be initialized in the middle of I

[jira] [Commented] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794801#comment-13794801 ] Hadoop QA commented on HDFS-5361: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794772#comment-13794772 ] Hadoop QA commented on HDFS-5276: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5096: --- Attachment: HDFS-5096-caching.009.patch here's an updated patch which is rebased on th

[jira] [Commented] (HDFS-5352) Server#initLog() doesn't close InputStream in httpfs

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794756#comment-13794756 ] Hudson commented on HDFS-5352: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4605 (See [https:

[jira] [Updated] (HDFS-5363) Create SPENGO-authenticated connection in URLConnectionFactory instead WebHdfsFileSystem

2013-10-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5363: - Status: Patch Available (was: Open) > Create SPENGO-authenticated connection in URLConnectionFactory inst

[jira] [Created] (HDFS-5363) Create SPENGO-authenticated connection in URLConnectionFactory instead WebHdfsFileSystem

2013-10-14 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5363: Summary: Create SPENGO-authenticated connection in URLConnectionFactory instead WebHdfsFileSystem Key: HDFS-5363 URL: https://issues.apache.org/jira/browse/HDFS-5363 Project:

[jira] [Updated] (HDFS-5363) Create SPENGO-authenticated connection in URLConnectionFactory instead WebHdfsFileSystem

2013-10-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5363: - Attachment: HDFS-5363.000.patch > Create SPENGO-authenticated connection in URLConnectionFactory instead

[jira] [Assigned] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-5040: - Assignee: Shinichi Yamashita > Audit log for admin commands/ logging output of all DFS admin comma

[jira] [Updated] (HDFS-5352) Server#initLog() doesn't close InputStream in httpfs

2013-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5352: Resolution: Fixed Fix Version/s: 2.3.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-5352) Server#initLog() doesn't close InputStream in httpfs

2013-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5352: Summary: Server#initLog() doesn't close InputStream in httpfs (was: Server#initLog() doesn't close InputStr

[jira] [Commented] (HDFS-5196) Provide more snapshot information in WebUI

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794747#comment-13794747 ] Hadoop QA commented on HDFS-5196: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794744#comment-13794744 ] Andrew Wang commented on HDFS-5276: --- Cool, that all works for me. +1 on the new patch; ma

[jira] [Updated] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5276: --- Attachment: HDFS-5276.003.patch > FileSystem.Statistics got performance issue on multi

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794740#comment-13794740 ] Colin Patrick McCabe commented on HDFS-5276: thanks for the review, Andrew. bq

[jira] [Created] (HDFS-5362) Add SnapshotException to terse exception group

2013-10-14 Thread Shinichi Yamashita (JIRA)
Shinichi Yamashita created HDFS-5362: Summary: Add SnapshotException to terse exception group Key: HDFS-5362 URL: https://issues.apache.org/jira/browse/HDFS-5362 Project: Hadoop HDFS Issu

[jira] [Resolved] (HDFS-5359) Allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-5359. --- Resolution: Fixed Fix Version/s: HDFS-4949 Committed to branch, thanks Colin. > Allow LightWei

[jira] [Updated] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5361: Release Note: Change the unit of 'PercentComplete' metric from rate to percentage. Hadoop Flags:

[jira] [Updated] (HDFS-5359) Allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5359: -- Summary: Allow LightWeightGSet#Iterator to remove elements (was: allow LightWeightGSet#Iterator to remo

[jira] [Commented] (HDFS-5359) allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794687#comment-13794687 ] Andrew Wang commented on HDFS-5359: --- Actually, I can't find the submit patch button (mayb

[jira] [Updated] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5361: Attachment: HDFS-5361.patch Attaching a patch. > Change the unit of StartupProgress 'PercentComplet

[jira] [Assigned] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned HDFS-5361: --- Assignee: Akira AJISAKA > Change the unit of StartupProgress 'PercentComplete' to percentage >

[jira] [Commented] (HDFS-5359) allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794680#comment-13794680 ] Andrew Wang commented on HDFS-5359: --- Cool patch; I had to do some background reading on

[jira] [Updated] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5361: Labels: metrics newbie (was: metrics) > Change the unit of StartupProgress 'PercentComplete' to per

[jira] [Commented] (HDFS-5334) Implement dfshealth.jsp in HTML pages

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794649#comment-13794649 ] Hadoop QA commented on HDFS-5334: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2013-10-14 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-5361: --- Summary: Change the unit of StartupProgress 'PercentComplete' to percentage Key: HDFS-5361 URL: https://issues.apache.org/jira/browse/HDFS-5361 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5278) Reduce memory consumptions of TestDFSClientRetries

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794638#comment-13794638 ] Hadoop QA commented on HDFS-5278: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-5360) Improvement of usage message of renameSnapshot and deleteSnapshot

2013-10-14 Thread Shinichi Yamashita (JIRA)
Shinichi Yamashita created HDFS-5360: Summary: Improvement of usage message of renameSnapshot and deleteSnapshot Key: HDFS-5360 URL: https://issues.apache.org/jira/browse/HDFS-5360 Project: Hadoop

[jira] [Updated] (HDFS-5359) allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5359: --- Attachment: HDFS-5359-caching.001.patch > allow LightWeightGSet#Iterator to remove ele

[jira] [Work started] (HDFS-5359) allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5359 started by Colin Patrick McCabe. > allow LightWeightGSet#Iterator to remove elements > - > >

[jira] [Updated] (HDFS-5359) allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5359: --- Summary: allow LightWeightGSet#Iterator to remove elements (was: allow GSet#Iterator

[jira] [Commented] (HDFS-5359) allow LightWeightGSet#Iterator to remove elements

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794622#comment-13794622 ] Colin Patrick McCabe commented on HDFS-5359: Note that this doesn't mean suppor

[jira] [Created] (HDFS-5359) allow GSet#Iterator to remove elements

2013-10-14 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5359: -- Summary: allow GSet#Iterator to remove elements Key: HDFS-5359 URL: https://issues.apache.org/jira/browse/HDFS-5359 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794601#comment-13794601 ] Chris Nauroth commented on HDFS-5096: - bq. Let me know if you think the comments in the

[jira] [Resolved] (HDFS-5358) Add replication field to PathBasedCacheDirective

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-5358. --- Resolution: Fixed Fix Version/s: HDFS-4949 Hadoop Flags: Reviewed Committed to branch, tha

[jira] [Updated] (HDFS-5358) Add replication field to PathBasedCacheDirective

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5358: -- Summary: Add replication field to PathBasedCacheDirective (was: add 'replication' field to PathBasedCac

[jira] [Commented] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794597#comment-13794597 ] Andrew Wang commented on HDFS-5358: --- +1, thanks Colin. Will commit shortly. > add 'repli

[jira] [Updated] (HDFS-5196) Provide more snapshot information in WebUI

2013-10-14 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-5196: - Target Version/s: 3.0.0 Affects Version/s: 3.0.0 Status: Patch Availabl

[jira] [Updated] (HDFS-5196) Provide more snapshot information in WebUI

2013-10-14 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-5196: - Attachment: HDFS-5196.patch I attach a patch file about two images of the former comment.

[jira] [Updated] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5358: --- Attachment: HDFS-5358-caching.002.patch > add 'replication' field to PathBasedCacheDir

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794590#comment-13794590 ] Colin Patrick McCabe commented on HDFS-5096: and yeah, taking the FSN lock whil

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794588#comment-13794588 ] Colin Patrick McCabe commented on HDFS-5096: bq. Shall we remove INodeFile#cach

[jira] [Commented] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2013-10-14 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794584#comment-13794584 ] Milind Bhandarkar commented on HDFS-5324: - Colin, Yes, I agree that the big lock c

[jira] [Commented] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794567#comment-13794567 ] Colin Patrick McCabe commented on HDFS-5358: bq. Can we use uint32 for replicat

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794555#comment-13794555 ] Chris Nauroth commented on HDFS-5096: - Thanks, Colin and Andrew. I agree that the logi

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794556#comment-13794556 ] Chris Nauroth commented on HDFS-5096: - Also, can we please document {{dfs.namenode.pat

[jira] [Commented] (HDFS-5349) DNA_CACHE and DNA_UNCACHE should be by blockId only

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794547#comment-13794547 ] Colin Patrick McCabe commented on HDFS-5349: bq. I think this is getting cleane

[jira] [Resolved] (HDFS-5349) DNA_CACHE and DNA_UNCACHE should be by blockId only

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5349. Resolution: Fixed Fix Version/s: HDFS-4949 > DNA_CACHE and DNA_UNCACHE should

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794540#comment-13794540 ] Andrew Wang commented on HDFS-5096: --- Hey Chris, I can field a few of these for Colin: bq

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794539#comment-13794539 ] Colin Patrick McCabe commented on HDFS-5096: bq. Looks like the TODO: support l

[jira] [Commented] (HDFS-5357) TestFileSystemAccessService failures in JDK7

2013-10-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794519#comment-13794519 ] Jonathan Eagles commented on HDFS-5357: --- +1. Thanks, Rob. This patch is only for bran

[jira] [Commented] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794517#comment-13794517 ] Colin Patrick McCabe commented on HDFS-5324: As you know, we currently have a r

[jira] [Updated] (HDFS-5278) Reduce memory consumptions of TestDFSClientRetries

2013-10-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5278: - Attachment: HDFS-5278.001.patch > Reduce memory consumptions of TestDFSClientRetries > ---

[jira] [Updated] (HDFS-5334) Implement dfshealth.jsp in HTML pages

2013-10-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5334: - Attachment: HDFS-5334.003.patch Based on HDFS-5342. > Implement dfshealth.jsp in HTML pages > ---

[jira] [Commented] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794503#comment-13794503 ] Andrew Wang commented on HDFS-5358: --- Thanks for splitting this out from HDFS-5096, nice t

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794501#comment-13794501 ] Chris Nauroth commented on HDFS-5096: - A couple of quick comments looking at version 6

[jira] [Commented] (HDFS-5342) Provide more information in the FSNamesystem JMX interfaces

2013-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794485#comment-13794485 ] Hudson commented on HDFS-5342: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4601 (See [https:

[jira] [Commented] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794484#comment-13794484 ] Chris Nauroth commented on HDFS-5358: - Can we use uint32 for replication in the protoco

[jira] [Updated] (HDFS-5342) Provide more information in the FSNamesystem JMX interfaces

2013-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5342: Resolution: Fixed Fix Version/s: 2.3.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-5342) Provide more information in the FSNamesystem JMX interfaces

2013-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5342: Summary: Provide more information in the FSNamesystem JMX interfaces (was: Provide more information in the

[jira] [Commented] (HDFS-5342) Provide more information in the JMX interfaces

2013-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794463#comment-13794463 ] Jing Zhao commented on HDFS-5342: - Thanks for the update Haohui! The patch looks good to me

[jira] [Commented] (HDFS-5349) DNA_CACHE and DNA_UNCACHE should be by blockId only

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794457#comment-13794457 ] Andrew Wang commented on HDFS-5349: --- Great, looks good. +1, up to you on the following:

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794443#comment-13794443 ] Hadoop QA commented on HDFS-5356: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5096) Automatically cache new data added to a cached path

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794408#comment-13794408 ] Colin Patrick McCabe commented on HDFS-5096: I split off the change adding repl

[jira] [Updated] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5358: --- Attachment: HDFS-5358-caching.001.patch > add 'replication' field to PathBasedCacheDir

[jira] [Work started] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5358 started by Colin Patrick McCabe. > add 'replication' field to PathBasedCacheDirective > -- > >

[jira] [Assigned] (HDFS-5346) Replication queues should not be initialized in the middle of IBR processing.

2013-10-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reassigned HDFS-5346: -- Assignee: Ravi Prakash > Replication queues should not be initialized in the middle of IBR proce

[jira] [Commented] (HDFS-5357) TestFileSystemAccessService failures in JDK7

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794406#comment-13794406 ] Hadoop QA commented on HDFS-5357: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5357) TestFileSystemAccessService failures in JDK7

2013-10-14 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated HDFS-5357: Status: Patch Available (was: Open) > TestFileSystemAccessService failures in JDK7 > --

[jira] [Updated] (HDFS-5357) TestFileSystemAccessService failures in JDK7

2013-10-14 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated HDFS-5357: Attachment: HDFS-5357v1.patch > TestFileSystemAccessService failures in JDK7 > -

[jira] [Assigned] (HDFS-5357) TestFileSystemAccessService failures in JDK7

2013-10-14 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker reassigned HDFS-5357: --- Assignee: Robert Parker > TestFileSystemAccessService failures in JDK7 > -

[jira] [Created] (HDFS-5357) TestFileSystemAccessService failures in JDK7

2013-10-14 Thread Robert Parker (JIRA)
Robert Parker created HDFS-5357: --- Summary: TestFileSystemAccessService failures in JDK7 Key: HDFS-5357 URL: https://issues.apache.org/jira/browse/HDFS-5357 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

2013-10-14 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5358: -- Summary: add 'replication' field to PathBasedCacheDirective Key: HDFS-5358 URL: https://issues.apache.org/jira/browse/HDFS-5358 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2013-10-14 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794398#comment-13794398 ] Milind Bhandarkar commented on HDFS-5324: - Colin, As I have replied to Sanjay, I a

[jira] [Commented] (HDFS-5342) Provide more information in the JMX interfaces

2013-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794389#comment-13794389 ] Hadoop QA commented on HDFS-5342: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794380#comment-13794380 ] Andrew Wang commented on HDFS-5276: --- I really like how this has shaped up. The microbench

[jira] [Updated] (HDFS-5349) DNA_CACHE and DNA_UNCACHE should be by blockId only

2013-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5349: --- Attachment: HDFS-5349-caching.002.patch Here is an updated patch that removes genstamp

[jira] [Commented] (HDFS-5130) Add test for snapshot related FsShell and DFSAdmin commands

2013-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794344#comment-13794344 ] Jing Zhao commented on HDFS-5130: - The patch looks good to me. Some minors: # Please add s

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2013-10-14 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent updated HDFS-5356: --- Status: Patch Available (was: Open) > MiniDFSCluster shoud close all open FileSystems when shutdown() > -

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2013-10-14 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent updated HDFS-5356: --- Description: After add some metrics functions to DFSClient, I found that some unit tests relates to metrics ar

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2013-10-14 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent updated HDFS-5356: --- Attachment: HDFS-5356.patch > MiniDFSCluster shoud close all open FileSystems when shutdown() > --

[jira] [Created] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2013-10-14 Thread haosdent (JIRA)
haosdent created HDFS-5356: -- Summary: MiniDFSCluster shoud close all open FileSystems when shutdown() Key: HDFS-5356 URL: https://issues.apache.org/jira/browse/HDFS-5356 Project: Hadoop HDFS Issue

  1   2   >