[jira] [Commented] (HDFS-3229) add JournalProtocol RPCs to list finalized edit segments, and read edit segment file from JournalNode.

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249183#comment-13249183 ] Todd Lipcon commented on HDFS-3229: --- I'd recommend reusing the code/protobufs for the exi

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249182#comment-13249182 ] Todd Lipcon commented on HDFS-2983: --- bq. The proposal seems to suggest that the NN does n

[jira] [Commented] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249181#comment-13249181 ] Todd Lipcon commented on HDFS-3192: --- The state diagram is included in the design doc atta

[jira] [Commented] (HDFS-3201) Implement Journal reader for reading transactions from local edits log or remote Journal node

2012-04-06 Thread Brandon Li (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249165#comment-13249165 ] Brandon Li commented on HDFS-3201: -- After a new(or a rejoining) JournalNode joins the clus

[jira] [Created] (HDFS-3229) add JournalProtocol RPCs to list finalized edit segments, and read edit segment file from JournalNode.

2012-04-06 Thread Brandon Li (Created) (JIRA)
add JournalProtocol RPCs to list finalized edit segments, and read edit segment file from JournalNode. --- Key: HDFS-3229 URL: https://issues.apache.org/jira/brow

[jira] [Commented] (HDFS-2815) Namenode is not coming out of safemode when we perform ( NN crash + restart ) . Also FSCK report shows blocks missed.

2012-04-06 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249145#comment-13249145 ] Uma Maheswara Rao G commented on HDFS-2815: --- Suresh, could you please take a loo

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249143#comment-13249143 ] Colin Patrick McCabe commented on HDFS-3004: > Then would it show an error mess

[jira] [Commented] (HDFS-3092) Enable journal protocol based editlog streaming for standby namenode

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249134#comment-13249134 ] Tsz Wo (Nicholas), SZE commented on HDFS-3092: -- Hi Kihwal, If the NN already

[jira] [Commented] (HDFS-3222) DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block.

2012-04-06 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249132#comment-13249132 ] Uma Maheswara Rao G commented on HDFS-3222: --- Yes, I think that should solve the p

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249131#comment-13249131 ] Hadoop QA commented on HDFS-3004: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

2012-04-06 Thread Sanjay Radia (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249130#comment-13249130 ] Sanjay Radia commented on HDFS-2983: The proposal seems to suggest that the NN does not

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

2012-04-06 Thread Sanjay Radia (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249127#comment-13249127 ] Sanjay Radia commented on HDFS-2983: Most operations will not know when to take the sna

[jira] [Resolved] (HDFS-3080) Move FSDataset interfaces and implementation to separated packages

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-3080. -- Resolution: Fixed All the sub-tasks are done. Resolving. > Mov

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249123#comment-13249123 ] Tsz Wo (Nicholas), SZE commented on HDFS-3004: -- Please feel free to commit the

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249122#comment-13249122 ] Tsz Wo (Nicholas), SZE commented on HDFS-3004: -- - Please do not call toString(

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249118#comment-13249118 ] Tsz Wo (Nicholas), SZE commented on HDFS-3004: -- {quote} - Please remove create

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249115#comment-13249115 ] Hadoop QA commented on HDFS-3004: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-119) logSync() may block NameNode forever.

2012-04-06 Thread Konstantin Shvachko (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-119: - Attachment: HDFS-119-branch-1.0.patch Here is the patch for branch-1.0 > l

[jira] [Commented] (HDFS-3211) JournalProtocol changes required for introducing epoch and fencing

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249112#comment-13249112 ] Hudson commented on HDFS-3211: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2037 (See [https

[jira] [Commented] (HDFS-3211) JournalProtocol changes required for introducing epoch and fencing

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249111#comment-13249111 ] Hudson commented on HDFS-3211: -- Integrated in Hadoop-Common-trunk-Commit #2026 (See [https://

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249109#comment-13249109 ] Colin Patrick McCabe commented on HDFS-3004: Hi Allen, Recovery uses the norma

[jira] [Commented] (HDFS-3211) JournalProtocol changes required for introducing epoch and fencing

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249106#comment-13249106 ] Hudson commented on HDFS-3211: -- Integrated in Hadoop-Hdfs-trunk-Commit #2101 (See [https://bu

[jira] [Commented] (HDFS-119) logSync() may block NameNode forever.

2012-04-06 Thread Konstantin Shvachko (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249107#comment-13249107 ] Konstantin Shvachko commented on HDFS-119: -- This has never been ported to 0.20. And

[jira] [Updated] (HDFS-3211) JournalProtocol changes required for introducing epoch and fencing

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3211: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Pa

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.042.patch * reposting so jenkins will test > Im

[jira] [Commented] (HDFS-3192) Active NN should exit when it has not received a getServiceStatus() rpc from ZKFC for timeout secs

2012-04-06 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249099#comment-13249099 ] Hari Mankude commented on HDFS-3192: Would it be possible to post state transition diag

[jira] [Commented] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249096#comment-13249096 ] Hudson commented on HDFS-3226: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2036 (See [https

[jira] [Commented] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249093#comment-13249093 ] Hudson commented on HDFS-3226: -- Integrated in Hadoop-Common-trunk-Commit #2025 (See [https://

[jira] [Commented] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249090#comment-13249090 ] Hudson commented on HDFS-3226: -- Integrated in Hadoop-Hdfs-trunk-Commit #2100 (See [https://bu

[jira] [Updated] (HDFS-3146) Datanode should be able to register multiple network interfaces

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3146: -- Attachment: hdfs-3146.txt Patch attached. > Datanode should be able to register multipl

[jira] [Updated] (HDFS-3218) Use multiple remote DN interfaces for block transfer

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3218: -- Attachment: hdfs-3218.txt Patch attached. > Use multiple remote DN interfaces for block

[jira] [Updated] (HDFS-3216) DatanodeID should support multiple IP addresses

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3216: -- Attachment: hdfs-3216.txt Patch attached. > DatanodeID should support multiple IP addre

[jira] [Updated] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3226: -- Resolution: Fixed Fix Version/s: 2.0.0 Hadoop Flags: Reviewed Status: Resolved (w

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3004: -- Attachment: HDFS-3004.042.patch Same patch for jenkins. > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3211) JournalProtocol changes required for introducing epoch and fencing

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3211: - Hadoop Flags: Reviewed +1 patch looks good. > JournalProtocol cha

[jira] [Commented] (HDFS-3121) hdfs tests for HADOOP-8014

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249065#comment-13249065 ] Hudson commented on HDFS-3121: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2035 (See [https

[jira] [Updated] (HDFS-3110) libhdfs implementation of direct read API

2012-04-06 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3110: -- Component/s: performance > libhdfs implementation of direct read API > -

[jira] [Updated] (HDFS-3228) Use fadvise in local read path

2012-04-06 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3228: -- Component/s: performance hdfs client Target Version/s: 3.0.0 Fix Ve

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Allen Wittenauer (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249059#comment-13249059 ] Allen Wittenauer commented on HDFS-3004: Are we smart enough to not recover mixed v

[jira] [Commented] (HDFS-3121) hdfs tests for HADOOP-8014

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249038#comment-13249038 ] Hudson commented on HDFS-3121: -- Integrated in Hadoop-Common-trunk-Commit #2024 (See [https://

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249033#comment-13249033 ] Tsz Wo (Nicholas), SZE commented on HDFS-3004: -- @Eli, I would like to take a l

[jira] [Updated] (HDFS-3218) Use multiple remote DN interfaces for block transfer

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3218: -- Summary: Use multiple remote DN interfaces for block transfer (was: The client should be able to use mu

[jira] [Commented] (HDFS-3121) hdfs tests for HADOOP-8014

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249031#comment-13249031 ] Hudson commented on HDFS-3121: -- Integrated in Hadoop-Hdfs-trunk-Commit #2099 (See [https://bu

[jira] [Updated] (HDFS-3121) hdfs tests for HADOOP-8014

2012-04-06 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3121: -- Resolution: Fixed Fix Version/s: 3.0.0 2.0.0 Target Versio

[jira] [Created] (HDFS-3228) Use fadvise in local read path

2012-04-06 Thread Henry Robinson (Created) (JIRA)
Use fadvise in local read path -- Key: HDFS-3228 URL: https://issues.apache.org/jira/browse/HDFS-3228 Project: Hadoop HDFS Issue Type: Improvement Reporter: Henry Robinson Assignee: Henry R

[jira] [Commented] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249021#comment-13249021 ] Hadoop QA commented on HDFS-3226: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3224) Bug in check for DN re-registration with different storage ID

2012-04-06 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249008#comment-13249008 ] Eli Collins commented on HDFS-3224: --- Btw here was the code before HDFS-3144. Host2NodesMa

[jira] [Resolved] (HDFS-3223) Auto HA: add zkfc to hadoop-daemon.sh script

2012-04-06 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3223. --- Resolution: Fixed Fix Version/s: Auto failover (HDFS-3042) Hadoop Flags: Reviewed Committe

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248933#comment-13248933 ] Eli Collins commented on HDFS-3004: --- Latest rev looks great. +1 to HDFS-3004.042.patch @

[jira] [Commented] (HDFS-1940) Datanode can have more than one copy of same block when a failed disk is coming back in datanode

2012-04-06 Thread Ravi Prakash (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248924#comment-13248924 ] Ravi Prakash commented on HDFS-1940: I checked in 0.23.3 (d60e9678bbc4d52fb9ab5d65363d4

[jira] [Updated] (HDFS-2505) Add a test to verify getFileChecksum works with ViewFS

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2505: - Resolution: Fixed Fix Version/s: (was: 0.24.0) 3.0.0

[jira] [Commented] (HDFS-3223) Auto HA: add zkfc to hadoop-daemon.sh script

2012-04-06 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248897#comment-13248897 ] Eli Collins commented on HDFS-3223: --- +1 > Auto HA: add zkfc to hadoop-da

[jira] [Commented] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248895#comment-13248895 ] Eli Collins commented on HDFS-3226: --- +1 pending jenkins > Allow GetConf

[jira] [Commented] (HDFS-3211) JournalProtocol changes required for introducing epoch and fencing

2012-04-06 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248886#comment-13248886 ] Hadoop QA commented on HDFS-3211: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3092) Enable journal protocol based editlog streaming for standby namenode

2012-04-06 Thread Kihwal Lee (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248783#comment-13248783 ] Kihwal Lee commented on HDFS-3092: -- I imagine a newly brought up or recovering journal dae

[jira] [Updated] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3226: -- Status: Patch Available (was: Open) > Allow GetConf tool to print arbitrary keys >

[jira] [Updated] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3226: -- Attachment: hdfs-3226.txt Attached patch adds: {{hdfs getconf -confKey foo}} which will read and print

[jira] [Created] (HDFS-3227) Mavenise libhdfs tests

2012-04-06 Thread Henry Robinson (Created) (JIRA)
Mavenise libhdfs tests -- Key: HDFS-3227 URL: https://issues.apache.org/jira/browse/HDFS-3227 Project: Hadoop HDFS Issue Type: Improvement Components: libhdfs Reporter: Henry Robinson Fi

[jira] [Created] (HDFS-3226) Allow GetConf tool to print arbitrary keys

2012-04-06 Thread Todd Lipcon (Created) (JIRA)
Allow GetConf tool to print arbitrary keys -- Key: HDFS-3226 URL: https://issues.apache.org/jira/browse/HDFS-3226 Project: Hadoop HDFS Issue Type: Improvement Components: tools Affects Ve

[jira] [Commented] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248756#comment-13248756 ] Colin Patrick McCabe commented on HDFS-3004: just to avoid confusion, the above

[jira] [Updated] (HDFS-3225) Revist upgrade snapshots, roll back, finalize to enable rolling upgrades

2012-04-06 Thread Sanjay Radia (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-3225: --- Description: With introduction of wire comaptibility, HDFS is ready for rolling upgrades. Various desi

[jira] [Commented] (HDFS-3225) Revist upgrade snapshots, roll back, finalize to enable rolling upgrades

2012-04-06 Thread Sanjay Radia (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248744#comment-13248744 ] Sanjay Radia commented on HDFS-3225: HDFS's upgrade snapshot feature is a unique and po

[jira] [Commented] (HDFS-3134) harden edit log loader against malformed or malicious input

2012-04-06 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248722#comment-13248722 ] Hadoop QA commented on HDFS-3134: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248716#comment-13248716 ] Todd Lipcon commented on HDFS-2983: --- Hey Sanjay. I agree that the snapshot-on-upgrade fea

[jira] [Created] (HDFS-3225) Revist upgrade snapshots, roll back, finalize to enable rolling upgrades

2012-04-06 Thread Sanjay Radia (Created) (JIRA)
Revist upgrade snapshots, roll back, finalize to enable rolling upgrades Key: HDFS-3225 URL: https://issues.apache.org/jira/browse/HDFS-3225 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-3224) Bug in check for DN re-registration with different storage ID

2012-04-06 Thread Eli Collins (Created) (JIRA)
Bug in check for DN re-registration with different storage ID - Key: HDFS-3224 URL: https://issues.apache.org/jira/browse/HDFS-3224 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

2012-04-06 Thread Sanjay Radia (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248693#comment-13248693 ] Sanjay Radia commented on HDFS-2983: Upgrades involves snapshots on NN and DNs. Snapsho

[jira] [Commented] (HDFS-3119) Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248689#comment-13248689 ] Tsz Wo (Nicholas), SZE commented on HDFS-3119: -- +1 on the patch. Uma, I will

[jira] [Updated] (HDFS-3211) JournalProtocol changes required for introducing epoch and fencing

2012-04-06 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3211: -- Attachment: HDFS-3211.txt The patch is complete and read for review. I added a test for fence me

[jira] [Updated] (HDFS-3134) harden edit log loader against malformed or malicious input

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3134: --- Attachment: HDFS-3134.002.patch > harden edit log loader against malformed or mali

[jira] [Updated] (HDFS-3223) Auto HA: add zkfc to hadoop-daemon.sh script

2012-04-06 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3223: -- Attachment: hdfs-3223.txt Simple patch for the branch. > Auto HA: add zkfc to hadoop-d

[jira] [Created] (HDFS-3223) Auto HA: add zkfc to hadoop-daemon.sh script

2012-04-06 Thread Todd Lipcon (Created) (JIRA)
Auto HA: add zkfc to hadoop-daemon.sh script Key: HDFS-3223 URL: https://issues.apache.org/jira/browse/HDFS-3223 Project: Hadoop HDFS Issue Type: Improvement Components: auto-failover, s

[jira] [Commented] (HDFS-3222) DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block.

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248667#comment-13248667 ] Todd Lipcon commented on HDFS-3222: --- Nice catch, Uma. I think we can use the length field

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

2012-04-06 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248658#comment-13248658 ] Aaron T. Myers commented on HDFS-2983: -- That sounds like a fine proposal to me, Todd.

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248649#comment-13248649 ] Tsz Wo (Nicholas), SZE commented on HDFS-3219: -- Consider the permission of fil

[jira] [Commented] (HDFS-2505) Add a test to verify getFileChecksum works with ViewFS

2012-04-06 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248640#comment-13248640 ] Hudson commented on HDFS-2505: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2033 (See [https

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248628#comment-13248628 ] Tsz Wo (Nicholas), SZE commented on HDFS-3219: -- Oops, you are right that I sho

[jira] [Commented] (HDFS-3134) harden edit log loader against malformed or malicious input

2012-04-06 Thread Colin Patrick McCabe (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248624#comment-13248624 ] Colin Patrick McCabe commented on HDFS-3134: > Strictly speaking, "readPositive

[jira] [Commented] (HDFS-3217) ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception

2012-04-06 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248621#comment-13248621 ] Hari Mankude commented on HDFS-3217: bq.I disagree. It is an explicit decision to not h

[jira] [Updated] (HDFS-3055) Implement recovery mode for branch-1

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3055: --- Attachment: HDFS-3055-b1.004.patch * update patch to reflect comments from HDFS-3004

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-04-06 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248617#comment-13248617 ] Eli Collins commented on HDFS-3219: --- But per #1 visible length is per replica not per blo

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248609#comment-13248609 ] Tsz Wo (Nicholas), SZE commented on HDFS-3219: -- They are file's visible length

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-04-06 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248599#comment-13248599 ] Eli Collins commented on HDFS-3219: --- "visible length" #1 is a dynamic property (the # byt

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248595#comment-13248595 ] Todd Lipcon commented on HDFS-2983: --- Here's another proposal which I think makes sense:

[jira] [Updated] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3219: -- Description: HDFS-2288 there are two definition of visible length, or rather we're using the same name

[jira] [Created] (HDFS-3222) DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block.

2012-04-06 Thread Uma Maheswara Rao G (Created) (JIRA)
DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. - Key: HDFS-3222 URL: https:/

[jira] [Commented] (HDFS-3217) ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248589#comment-13248589 ] Todd Lipcon commented on HDFS-3217: --- I disagree. It is an explicit decision to not have t

[jira] [Commented] (HDFS-3212) Persist the epoch received by the JournalService

2012-04-06 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248587#comment-13248587 ] Todd Lipcon commented on HDFS-3212: --- bq. Todd, if you are referring to creating a edit lo

[jira] [Updated] (HDFS-3134) harden edit log loader against malformed or malicious input

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3134: - Component/s: name-node +1 patch looks good Strictly speaking, "readPositiveVInt"

[jira] [Updated] (HDFS-3221) Update docs for HDFS-3140 (multiple interfaces)

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3221: -- Target Version/s: Multiple interfaces (HDFS-3140) > Update docs for HDFS-3140 (multiple interfaces)

[jira] [Updated] (HDFS-3218) The client should be able to use multiple remote DN interfaces for block transfer

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3218: -- Target Version/s: Multiple interfaces (HDFS-3140) > The client should be able to use multiple remote

[jira] [Updated] (HDFS-3149) The client should blacklist failed local/remote network interface pairs

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3149: -- Target Version/s: Multiple interfaces (HDFS-3140) (was: 0.23.3) > The client should blacklist faile

[jira] [Updated] (HDFS-3146) Datanode should be able to register multiple network interfaces

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3146: -- Target Version/s: Multiple interfaces (HDFS-3140) (was: 0.23.3) > Datanode should be able to regist

[jira] [Updated] (HDFS-3140) Support multiple network interfaces

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3140: -- Target Version/s: Multiple interfaces (HDFS-3140) > Support multiple network interfaces > --

[jira] [Updated] (HDFS-3147) The Namenode should be able to filter DN interfaces given to clients

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3147: -- Target Version/s: Multiple interfaces (HDFS-3140) (was: 2.0.0) > The Namenode should be able to fil

[jira] [Updated] (HDFS-3216) DatanodeID should support multiple IP addresses

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3216: -- Target Version/s: Multiple interfaces (HDFS-3140) > DatanodeID should support multiple IP addresses

[jira] [Commented] (HDFS-3150) Add option for clients to contact DNs via hostname in branch-1

2012-04-06 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248578#comment-13248578 ] Tsz Wo (Nicholas), SZE commented on HDFS-3150: -- Eli, I can understand that it

[jira] [Created] (HDFS-3221) Update docs for HDFS-3140 (multiple interfaces)

2012-04-06 Thread Eli Collins (Created) (JIRA)
Update docs for HDFS-3140 (multiple interfaces) --- Key: HDFS-3221 URL: https://issues.apache.org/jira/browse/HDFS-3221 Project: Hadoop HDFS Issue Type: Sub-task Components: documentation

[jira] [Updated] (HDFS-3134) harden edit log loader against malformed or malicious input

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3134: --- Status: Patch Available (was: Open) > harden edit log loader against malformed or

[jira] [Updated] (HDFS-3134) harden edit log loader against malformed or malicious input

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3134: --- Attachment: HDFS-3134.001.patch * In the edit log loader, don't try to allocate arrays

  1   2   >