[jira] [Updated] (HDFS-3084) FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3084: -- Attachment: hdfs-3084.txt This patch, in conjunction with HADOOP-8007, provides the necessary facilities

[jira] [Updated] (HDFS-3183) Add JournalManager implementation to JournalDaemons for storing edits

2012-04-03 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3183: -- Description: The JournalManager is used in HA configuration and uses the following journal daem

[jira] [Created] (HDFS-3193) HDFS journal logging improvement

2012-04-03 Thread Suresh Srinivas (Created) (JIRA)
HDFS journal logging improvement Key: HDFS-3193 URL: https://issues.apache.org/jira/browse/HDFS-3193 Project: Hadoop HDFS Issue Type: Improvement Components: name-node Reporter: Suresh S

[jira] [Commented] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-03 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246059#comment-13246059 ] Suresh Srinivas commented on HDFS-3192: --- Hari, agree with Aaron that this should not

[jira] [Commented] (HDFS-3178) Add states for journal synchronization in journal daemon

2012-04-03 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246058#comment-13246058 ] Suresh Srinivas commented on HDFS-3178: --- Nicholas, if you are going to check for all

[jira] [Commented] (HDFS-3000) Add a public API for setting quotas

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246051#comment-13246051 ] Hudson commented on HDFS-3000: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2000 (See [https

[jira] [Commented] (HDFS-3000) Add a public API for setting quotas

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246049#comment-13246049 ] Hadoop QA commented on HDFS-3000: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3000) Add a public API for setting quotas

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246048#comment-13246048 ] Hudson commented on HDFS-3000: -- Integrated in Hadoop-Common-trunk-Commit #1987 (See [https://

[jira] [Commented] (HDFS-3000) Add a public API for setting quotas

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246047#comment-13246047 ] Hudson commented on HDFS-3000: -- Integrated in Hadoop-Hdfs-trunk-Commit #2062 (See [https://bu

[jira] [Commented] (HDFS-2185) HA: HDFS portion of ZK-based FailoverController

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246045#comment-13246045 ] Todd Lipcon commented on HDFS-2185: --- bq. I think you are missing the failure arc when tra

[jira] [Updated] (HDFS-2185) HA: HDFS portion of ZK-based FailoverController

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2185: -- Attachment: zkfc-design.pdf > HA: HDFS portion of ZK-based FailoverController >

[jira] [Commented] (HDFS-3179) Improve the error message: DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246014#comment-13246014 ] Hadoop QA commented on HDFS-3179: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246012#comment-13246012 ] Hadoop QA commented on HDFS-3110: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245996#comment-13245996 ] Aaron T. Myers commented on HDFS-3168: -- Looks like this patch may have broken compilat

[jira] [Commented] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245995#comment-13245995 ] Hudson commented on HDFS-3168: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1999 (See [https

[jira] [Commented] (HDFS-3102) Add CLI tool to initialize the shared-edits dir

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245992#comment-13245992 ] Hadoop QA commented on HDFS-3102: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245990#comment-13245990 ] Hudson commented on HDFS-3168: -- Integrated in Hadoop-Common-trunk-Commit #1986 (See [https://

[jira] [Commented] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245989#comment-13245989 ] Hudson commented on HDFS-3168: -- Integrated in Hadoop-Hdfs-trunk-Commit #2061 (See [https://bu

[jira] [Updated] (HDFS-3000) Add a public API for setting quotas

2012-04-03 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3000: - Issue Type: New Feature (was: Improvement) > Add a public API for setting quotas > --

[jira] [Updated] (HDFS-3000) Add a public API for setting quotas

2012-04-03 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3000: - Attachment: HDFS-3000.patch Thanks a lot for the reviews, Daryn and Nicholas. Here's an updated pa

[jira] [Updated] (HDFS-3179) Improve the error message: DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3179: - Component/s: (was: data-node) hdfs client Priority: Maj

[jira] [Updated] (HDFS-3179) failed to append data, DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3179: - Assignee: Tsz Wo (Nicholas), SZE Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-3179) failed to append data, DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3179: - Attachment: h3179_20120403.patch h3179_20120403.patch: - updates the error message

[jira] [Updated] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3168: - Resolution: Fixed Fix Version/s: 0.23.3 0.24.0 Hadoo

[jira] [Commented] (HDFS-3102) Add CLI tool to initialize the shared-edits dir

2012-04-03 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245981#comment-13245981 ] Aaron T. Myers commented on HDFS-3102: -- I should also mention that I tested this manua

[jira] [Updated] (HDFS-3178) Add states for journal synchronization in journal daemon

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3178: - Attachment: (was: h3178_20120403_svn_mv.patch) > Add states for journal sy

[jira] [Updated] (HDFS-3178) Add states for journal synchronization in journal daemon

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3178: - Attachment: h3178_20120403_svn_mv.patch svn_mv.sh Let's also move

[jira] [Updated] (HDFS-3178) Add states for journal synchronization in journal daemon

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3178: - Attachment: h3178_20120403_svn_mv.patch > Add states for journal synchronizati

[jira] [Updated] (HDFS-3102) Add CLI tool to initialize the shared-edits dir

2012-04-03 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3102: - Target Version/s: 0.24.0, 2.0.0 (was: 0.23.4, 0.24.0) Affects Version/s: (was: 0.23.3)

[jira] [Updated] (HDFS-3102) Add CLI tool to initialize the shared-edits dir

2012-04-03 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3102: - Target Version/s: 0.24.0, 2.0.0 (was: 2.0.0, 0.24.0) Status: Patch Available (was:

[jira] [Updated] (HDFS-3102) Add CLI tool to initialize the shared-edits dir

2012-04-03 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3102: - Attachment: HDFS-3102.patch Here's a patch for trunk which addresses the issue. >

[jira] [Commented] (HDFS-3050) rework OEV to share more code with the NameNode

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245967#comment-13245967 ] Hadoop QA commented on HDFS-3050: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.4.patch Patch addresses Todd's latest comments. > libhdfs i

[jira] [Commented] (HDFS-3148) The client should be able to use multiple local interfaces for data transfer

2012-04-03 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245954#comment-13245954 ] Suresh Srinivas commented on HDFS-3148: --- Eli, given it might be a few jiras, I agree

[jira] [Commented] (HDFS-1378) Edit log replay should track and report file offsets in case of errors

2012-04-03 Thread Colin Patrick McCabe (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245945#comment-13245945 ] Colin Patrick McCabe commented on HDFS-1378: ran TestCheckpoint, TestEditLog, T

[jira] [Commented] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245942#comment-13245942 ] Hadoop QA commented on HDFS-3168: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3050) rework OEV to share more code with the NameNode

2012-04-03 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3050: --- Attachment: HDFS-3050.018.patch * rebase on latest trunk > rework OEV

[jira] [Commented] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245924#comment-13245924 ] Hadoop QA commented on HDFS-3110: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3179) failed to append data, DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245920#comment-13245920 ] Tsz Wo (Nicholas), SZE commented on HDFS-3179: -- > ..., the appended data after

[jira] [Updated] (HDFS-1378) Edit log replay should track and report file offsets in case of errors

2012-04-03 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-1378: --- Attachment: HDFS-1378-b1.004.patch * add unit test > Edit log replay

[jira] [Updated] (HDFS-3100) failed to append data

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3100: - Summary: failed to append data (was: failed to append data using webhdfs) Revised

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245910#comment-13245910 ] Suresh Srinivas commented on HDFS-3077: --- For section 2.5.x, the document posted needs

[jira] [Updated] (HDFS-3092) Enable journal protocol based editlog streaming for standby namenode

2012-04-03 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3092: -- Attachment: MultipleSharedJournals.pdf Updated design with additional use cases.

[jira] [Commented] (HDFS-1378) Edit log replay should track and report file offsets in case of errors

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245897#comment-13245897 ] Todd Lipcon commented on HDFS-1378: --- Looks like your uploaded patch is still missing the

[jira] [Commented] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-03 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245896#comment-13245896 ] Aaron T. Myers commented on HDFS-3192: -- Also, why is this a sub-task of HDFS-3092? See

[jira] [Commented] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245895#comment-13245895 ] Todd Lipcon commented on HDFS-3192: --- Why? I think it's an _advantage_ that the FC may di

[jira] [Commented] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-03 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245889#comment-13245889 ] Hari Mankude commented on HDFS-3192: FC via healthmonitor will periodically poll the st

[jira] [Updated] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3168: - Attachment: h3168_20120403.patch > Clean up FSNamesystem and BlockManager > --

[jira] [Created] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-03 Thread Hari Mankude (Created) (JIRA)
Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs -- Key: HDFS-3192 URL: https://issues.apache.org/jira/browse/HDFS-31

[jira] [Assigned] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-03 Thread Hari Mankude (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude reassigned HDFS-3192: -- Assignee: Hari Mankude > Active NN should exit when it has not received a getServiceStatus()

[jira] [Updated] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3168: - Attachment: (was: h3168_20120403.patch) > Clean up FSNamesystem and BlockM

[jira] [Updated] (HDFS-1378) Edit log replay should track and report file offsets in case of errors

2012-04-03 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-1378: --- Attachment: HDFS-1378-b1.003.patch * include bug fix from revised patch * backport un

[jira] [Updated] (HDFS-3168) Clean up FSNamesystem and BlockManager

2012-04-03 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3168: - Attachment: h3168_20120403.patch Brandon, thanks for the review. h3168_20120403.p

[jira] [Commented] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245878#comment-13245878 ] Todd Lipcon commented on HDFS-3110: --- Sorry, a few things I missed when I looked at the ea

[jira] [Assigned] (HDFS-3186) Sync lagging journal service from the active journal service

2012-04-03 Thread Hari Mankude (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude reassigned HDFS-3186: -- Assignee: Brandon Li (was: Hari Mankude) > Sync lagging journal service from the active jou

[jira] [Commented] (HDFS-3191) Active NN should exit when it cannot write to quorum number of Journal Daemons

2012-04-03 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245875#comment-13245875 ] Hari Mankude commented on HDFS-3191: Currently active NN updates its in-memory state an

[jira] [Created] (HDFS-3191) Active NN should exit when it cannot write to quorum number of Journal Daemons

2012-04-03 Thread Hari Mankude (Created) (JIRA)
Active NN should exit when it cannot write to quorum number of Journal Daemons -- Key: HDFS-3191 URL: https://issues.apache.org/jira/browse/HDFS-3191 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-3191) Active NN should exit when it cannot write to quorum number of Journal Daemons

2012-04-03 Thread Hari Mankude (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude reassigned HDFS-3191: -- Assignee: Hari Mankude > Active NN should exit when it cannot write to quorum number of Jour

[jira] [Commented] (HDFS-3186) Sync lagging journal service from the active journal service

2012-04-03 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245874#comment-13245874 ] Hari Mankude commented on HDFS-3186: We need to have a mechanism for the newly added jo

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245871#comment-13245871 ] Hadoop QA commented on HDFS-3190: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245867#comment-13245867 ] Hudson commented on HDFS-3187: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1998 (See [https

[jira] [Updated] (HDFS-1378) Edit log replay should track and report file offsets in case of errors

2012-04-03 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-1378: --- Attachment: HDFS-1378-b1.002.patch * port to branch-1 > Edit log repl

[jira] [Reopened] (HDFS-1378) Edit log replay should track and report file offsets in case of errors

2012-04-03 Thread Colin Patrick McCabe (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-1378: Assignee: Colin Patrick McCabe (was: Aaron T. Myers) I'd like to port this to bra

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Henry Robinson (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated HDFS-3110: - Attachment: HDFS-3110.3.patch New patch that's actually a diff vs trunk this time :/ I incorporat

[jira] [Commented] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245857#comment-13245857 ] Hudson commented on HDFS-3187: -- Integrated in Hadoop-Common-trunk-Commit #1985 (See [https://

[jira] [Commented] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245854#comment-13245854 ] Hudson commented on HDFS-3187: -- Integrated in Hadoop-Hdfs-trunk-Commit #2060 (See [https://bu

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245850#comment-13245850 ] Suresh Srinivas commented on HDFS-3077: --- bq. so all nodes are now taking part in the

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245847#comment-13245847 ] Suresh Srinivas commented on HDFS-3077: --- bq. How can step 3 in section 2.4 be complet

[jira] [Updated] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3187: -- Resolution: Fixed Fix Version/s: 2.0.0 Hadoop Flags: Reviewed Status: Resolved (w

[jira] [Commented] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245827#comment-13245827 ] Todd Lipcon commented on HDFS-3187: --- Thanks Eli. I double checked that all the MR, HDFS,

[jira] [Commented] (HDFS-3188) Add infrastructure for waiting for a quorum of ListenableFutures to respond

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245818#comment-13245818 ] Hadoop QA commented on HDFS-3188: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245817#comment-13245817 ] Eli Collins commented on HDFS-3187: --- +1 looks good > Upgrade guava to 11

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245806#comment-13245806 ] Todd Lipcon commented on HDFS-3077: --- Hi Bikas. Thanks for bringing up this scenario. I do

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245785#comment-13245785 ] Bikas Saha commented on HDFS-3077: -- I have a question around syncing journal nodes and quo

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245778#comment-13245778 ] Todd Lipcon commented on HDFS-3190: --- thanks Bikas. Quick question for reviewers: when I m

[jira] [Commented] (HDFS-3092) Enable journal protocol based editlog streaming for standby namenode

2012-04-03 Thread Sanjay Radia (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245776#comment-13245776 ] Sanjay Radia commented on HDFS-3092: Is there a way to turn off the striping even if Qu

[jira] [Commented] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245773#comment-13245773 ] Todd Lipcon commented on HDFS-3110: --- uld be declared {{static}} - I think your new patch

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245771#comment-13245771 ] Suresh Srinivas commented on HDFS-3077: --- bq. Suresh seemed to think doing it on a bra

[jira] [Commented] (HDFS-3110) libhdfs implementation of direct read API

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245774#comment-13245774 ] Todd Lipcon commented on HDFS-3110: --- my top comment got chopped somehow above: - I like

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-04-03 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245765#comment-13245765 ] Bikas Saha commented on HDFS-3190: -- +1 lgtm. > Simple refactors in exist

[jira] [Commented] (HDFS-3179) failed to append data, DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster

2012-04-03 Thread Zhanwei.Wang (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245755#comment-13245755 ] Zhanwei.Wang commented on HDFS-3179: I totally agree with you about "the problem one da

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245752#comment-13245752 ] Bikas Saha commented on HDFS-3077: -- bq. Nope, the thinking is that all of the new code wil

[jira] [Updated] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3190: -- Assignee: Todd Lipcon Status: Patch Available (was: Open) > Simple refactors in existing NN c

[jira] [Commented] (HDFS-2185) HA: HDFS portion of ZK-based FailoverController

2012-04-03 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245739#comment-13245739 ] Bikas Saha commented on HDFS-2185: -- I think you are missing the failure arc when transitio

[jira] [Updated] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3190: -- Attachment: hdfs-3190.txt Simple patch implements the above. Does not add unit tests since it's a strai

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245736#comment-13245736 ] Todd Lipcon commented on HDFS-3077: --- bq. I think it will help clarify the doc, if you add

[jira] [Created] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-04-03 Thread Todd Lipcon (Created) (JIRA)
Simple refactors in existing NN code to assist QuorumJournalManager extension - Key: HDFS-3190 URL: https://issues.apache.org/jira/browse/HDFS-3190 Project: Hadoop HDFS

[jira] [Updated] (HDFS-3189) Add preliminary QJournalProtocol interface, translators

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3189: -- Attachment: hdfs-3189-prelim.txt Preliminary patch, there are still a couple TODOs/cleanup to do before

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-04-03 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245729#comment-13245729 ] Bikas Saha commented on HDFS-3077: -- Nice doc! Greatly sped up understanding the design ins

[jira] [Updated] (HDFS-3188) Add infrastructure for waiting for a quorum of ListenableFutures to respond

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3188: -- Status: Patch Available (was: Open) > Add infrastructure for waiting for a quorum of ListenableFutu

[jira] [Created] (HDFS-3189) Add preliminary QJournalProtocol interface, translators

2012-04-03 Thread Todd Lipcon (Created) (JIRA)
Add preliminary QJournalProtocol interface, translators --- Key: HDFS-3189 URL: https://issues.apache.org/jira/browse/HDFS-3189 Project: Hadoop HDFS Issue Type: Sub-task Component

[jira] [Updated] (HDFS-3188) Add infrastructure for waiting for a quorum of ListenableFutures to respond

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3188: -- Attachment: hdfs-3188.txt Attached patch implements QuorumCall as described, and includes a unit test.

[jira] [Commented] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245721#comment-13245721 ] Hadoop QA commented on HDFS-3187: - -1 overall. Here are the results of testing the latest

[jira] [Created] (HDFS-3188) Add infrastructure for waiting for a quorum of ListenableFutures to respond

2012-04-03 Thread Todd Lipcon (Created) (JIRA)
Add infrastructure for waiting for a quorum of ListenableFutures to respond --- Key: HDFS-3188 URL: https://issues.apache.org/jira/browse/HDFS-3188 Project: Hadoop HDFS

[jira] [Updated] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3187: -- Status: Patch Available (was: Open) > Upgrade guava to 11.0.2 > --- > >

[jira] [Created] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Todd Lipcon (Created) (JIRA)
Upgrade guava to 11.0.2 --- Key: HDFS-3187 URL: https://issues.apache.org/jira/browse/HDFS-3187 Project: Hadoop HDFS Issue Type: Sub-task Components: build Affects Versions: 2.0.0 Reporter: Todd

[jira] [Assigned] (HDFS-3186) Sync lagging journal service from the active journal service

2012-04-03 Thread Hari Mankude (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude reassigned HDFS-3186: -- Assignee: Hari Mankude > Sync lagging journal service from the active journal service >

[jira] [Updated] (HDFS-3187) Upgrade guava to 11.0.2

2012-04-03 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3187: -- Attachment: hdfs-3187.txt Attached patch upgrades guava in the pom, and also fixes two calls to methods

[jira] [Created] (HDFS-3186) Sync lagging journal service from the active journal service

2012-04-03 Thread Hari Mankude (Created) (JIRA)
Sync lagging journal service from the active journal service Key: HDFS-3186 URL: https://issues.apache.org/jira/browse/HDFS-3186 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-3185) Setup configuration for Journal Manager and Journal Services

2012-04-03 Thread Hari Mankude (Created) (JIRA)
Setup configuration for Journal Manager and Journal Services Key: HDFS-3185 URL: https://issues.apache.org/jira/browse/HDFS-3185 Project: Hadoop HDFS Issue Type: Sub-task

  1   2   >