[jira] [Resolved] (HDFS-1583) Improve backup-node sync performance by wrapping RPC parameters

2011-03-21 Thread Liyin Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Liang resolved HDFS-1583. --- Resolution: Fixed This bug has been fixed by HADOOP-6949. > Improve backup-node sync performance by w

[jira] [Updated] (HDFS-1583) Improve backup-node sync performance by wrapping RPC parameters

2011-03-21 Thread Liyin Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Liang updated HDFS-1583: -- Status: Open (was: Patch Available) HADOOP-6949 has been accepted and committed. > Improve backup-node

[jira] [Updated] (HDFS-1773) Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists

2011-03-21 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1773: --- Attachment: HDFS-1773-2.patch Discussed with Nicholas about the first approach by removing datanode fr

[jira] [Updated] (HDFS-1773) Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists

2011-03-21 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1773: --- Attachment: HDFS-1773.patch The problem was that after a datanode is registered with a namenode, it is

[jira] [Commented] (HDFS-1751) Intrinsic limits for HDFS files, directories

2011-03-21 Thread Robert Chansler (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009552#comment-13009552 ] Robert Chansler commented on HDFS-1751: --- First, I must ‘fess up that “intrinsic” was

[jira] [Updated] (HDFS-1738) change hdfs jmxget to return an empty string instead of null when an attribute value is not available.

2011-03-21 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1738: --- Description: Currently the tool, hdfs jmx returns null in case of an attribute value is not available

[jira] [Commented] (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms

2011-03-21 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009512#comment-13009512 ] Jitendra Nath Pandey commented on HDFS-1580: A few comments. 1. > JournalManag

[jira] [Commented] (HDFS-1362) Provide volume management functionality for DataNode

2011-03-21 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009456#comment-13009456 ] Sanjay Radia commented on HDFS-1362: Steps 1 and 2 are done by the operator and step 3

[jira] [Updated] (HDFS-1773) Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists

2011-03-21 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1773: --- Priority: Minor (was: Major) > Remove a datanode from cluster if include list is not empty and this d

[jira] [Created] (HDFS-1773) Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists

2011-03-21 Thread Tanping Wang (JIRA)
Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists Key: HDFS-1773

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2011-03-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009447#comment-13009447 ] Konstantin Shvachko commented on HDFS-1172: --- I think this makes a lot of sense.

[jira] [Commented] (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009408#comment-13009408 ] Todd Lipcon commented on HDFS-1521: --- The error is: 2011-03-21 14:07:49,247 ERROR namenod

[jira] [Commented] (HDFS-1583) Improve backup-node sync performance by wrapping RPC parameters

2011-03-21 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009405#comment-13009405 ] Matt Foley commented on HDFS-1583: -- HADOOP-6949 has been accepted and committed. Respectf

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2011-03-21 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009404#comment-13009404 ] Hairong Kuang commented on HDFS-1172: - A block under construction keeps track of the pi

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2011-03-21 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009403#comment-13009403 ] Hairong Kuang commented on HDFS-1172: - I worked on a similar solution for our internal

[jira] [Commented] (HDFS-1750) fs -ls hftp://file not working

2011-03-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009399#comment-13009399 ] Hudson commented on HDFS-1750: -- Integrated in Hadoop-Hdfs-trunk-Commit #569 (See [https://hud

[jira] [Commented] (HDFS-1750) fs -ls hftp://file not working

2011-03-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009401#comment-13009401 ] Tsz Wo (Nicholas), SZE commented on HDFS-1750: -- >> Should we create a bug for

[jira] [Commented] (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009398#comment-13009398 ] Hudson commented on HDFS-1521: -- Integrated in Hadoop-Hdfs-trunk-Commit #569 (See [https://hud

[jira] [Updated] (HDFS-1772) atime and mtime are different from hdfs:// and hftp://

2011-03-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1772: - Attachment: TestListPathServlet.patch TestListPathServlet.patch: Here a test illus

[jira] [Created] (HDFS-1772) atime and mtime are different from hdfs:// and hftp://

2011-03-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
atime and mtime are different from hdfs:// and hftp:// -- Key: HDFS-1772 URL: https://issues.apache.org/jira/browse/HDFS-1772 Project: Hadoop HDFS Issue Type: Bug Components: name

[jira] [Reopened] (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-1521: --- For some reason this is causing TestBackupNode to fail - surprised we didn't see this in the Hudson QA ru

[jira] [Updated] (HDFS-1750) fs -ls hftp://file not working

2011-03-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1750: - Resolution: Fixed Fix Version/s: 0.23.0 0.22.0

[jira] [Updated] (HDFS-1750) fs -ls hftp://file not working

2011-03-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1750: - Attachment: h1750_20110314_0.21.patch h1750_20110314_0.21.patch: for 0.21 > fs -l

[jira] [Commented] (HDFS-1538) Refactor more startup and image loading code out of FSImage

2011-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009351#comment-13009351 ] Hadoop QA commented on HDFS-1538: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1538) Refactor more startup and image loading code out of FSImage

2011-03-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1538: -- Affects Version/s: (was: 0.22.0) Status: Patch Available (was: Open) > Refactor more

[jira] [Updated] (HDFS-1538) Refactor more startup and image loading code out of FSImage

2011-03-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1538: -- Attachment: hdfs-1538.txt Now that HDFS-1521 has been committed, here's a patch for this against trunk.

[jira] [Updated] (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1521: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Comm

[jira] [Updated] (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1521: -- Fix Version/s: 0.23.0 > Persist transaction ID on disk between NN restarts > ---

[jira] [Commented] (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms

2011-03-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009291#comment-13009291 ] Todd Lipcon commented on HDFS-1580: --- I'm not sure I agree with your point that rolling sh

[jira] [Commented] (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009266#comment-13009266 ] Konstantin Shvachko commented on HDFS-1767: --- Great analysis indeed, Matt. Can we

[jira] [Commented] (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2011-03-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009167#comment-13009167 ] Kihwal Lee commented on HDFS-941: - Nice work! I performed a basic test and got results compa

[jira] [Commented] (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms

2011-03-21 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009138#comment-13009138 ] Ivan Kelly commented on HDFS-1580: -- This depends on whether we want the roll operation exp

[jira] [Commented] (HDFS-1623) High Availability Framework for HDFS NN

2011-03-21 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009130#comment-13009130 ] Ivan Kelly commented on HDFS-1623: -- {quote} > How does heartbeat deal with network partiti