[jira] [Commented] (HDFS-2879) Change FSDataset to package private

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199579#comment-13199579 ] Hudson commented on HDFS-2879: -- Integrated in Hadoop-Common-0.23-Commit #478 (See [https://bu

[jira] [Commented] (HDFS-2879) Change FSDataset to package private

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199577#comment-13199577 ] Hudson commented on HDFS-2879: -- Integrated in Hadoop-Hdfs-trunk-Commit #1722 (See [https://bu

[jira] [Commented] (HDFS-2879) Change FSDataset to package private

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199575#comment-13199575 ] Hudson commented on HDFS-2879: -- Integrated in Hadoop-Common-trunk-Commit #1651 (See [https://

[jira] [Updated] (HDFS-2879) Change FSDataset to package private

2012-02-02 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2879: - Resolution: Fixed Fix Version/s: 0.23.1 0.24.0 Hadoo

[jira] [Commented] (HDFS-2879) Change FSDataset to package private

2012-02-02 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199569#comment-13199569 ] Tsz Wo (Nicholas), SZE commented on HDFS-2879: -- The javadoc warning is the cas

[jira] [Updated] (HDFS-2814) NamenodeMXBean does not account for svn revision in the version information

2012-02-02 Thread Jitendra Nath Pandey (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-2814: --- Resolution: Fixed Target Version/s: 0.23.1, 1.0.1 (was: 1.0.1, 0.23.1)

[jira] [Assigned] (HDFS-2866) Standby does not start up due to a gap in transaction id

2012-02-02 Thread Jitendra Nath Pandey (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-2866: -- Assignee: Hari Mankude > Standby does not start up due to a gap in transacti

[jira] [Updated] (HDFS-2808) HA: haadmin should use namenode ids

2012-02-02 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2808: -- Summary: HA: haadmin should use namenode ids (was: HA: Use logical names in haadmin) > HA: haadmin

[jira] [Commented] (HDFS-2785) Update webhdfs and httpfs for host-based token support

2012-02-02 Thread Jitendra Nath Pandey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199550#comment-13199550 ] Jitendra Nath Pandey commented on HDFS-2785: The last change in the patch i.e.

[jira] [Updated] (HDFS-2808) HA: Use logical names in haadmin

2012-02-02 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2808: -- Attachment: hdfs-2808.txt Patch attached. Previous patch plus introduces an haadmin wide nameservice pa

[jira] [Created] (HDFS-2886) CreateEditLogs should generate a realistic edit log.

2012-02-02 Thread Konstantin Shvachko (Created) (JIRA)
CreateEditLogs should generate a realistic edit log. Key: HDFS-2886 URL: https://issues.apache.org/jira/browse/HDFS-2886 Project: Hadoop HDFS Issue Type: Sub-task Components: nam

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Konstantin Shvachko (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199535#comment-13199535 ] Konstantin Shvachko commented on HDFS-2718: --- Intended to fix CreateEditLogs in a

[jira] [Commented] (HDFS-1857) Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-list

2012-02-02 Thread Jonathan Eagles (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199517#comment-13199517 ] Jonathan Eagles commented on HDFS-1857: --- https://jira.codehaus.org/browse/MJAVADOC-30

[jira] [Commented] (HDFS-2792) HA: Make fsck work

2012-02-02 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199495#comment-13199495 ] Eli Collins commented on HDFS-2792: --- How about the following? - hdfs fsck should not requ

[jira] [Resolved] (HDFS-2769) HA: When HA is enabled with a shared edits dir, that dir should be marked required

2012-02-02 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2769. --- Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks ATM. > HA:

[jira] [Commented] (HDFS-2769) HA: When HA is enabled with a shared edits dir, that dir should be marked required

2012-02-02 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199489#comment-13199489 ] Eli Collins commented on HDFS-2769: --- +1 > HA: When HA is enabled with a

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199455#comment-13199455 ] Bikas Saha commented on HDFS-2863: -- Thanks! > Failures observed if dfs.ed

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199454#comment-13199454 ] Aaron T. Myers commented on HDFS-2863: -- +1, the latest patch looks good to me. Thanks

[jira] [Updated] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2863: - Attachment: HDFS-2863.HDFS-1623.patch Got it after a git pull. Attached. > Failures obser

[jira] [Resolved] (HDFS-2860) HA: TestDFSRollback#testRollback is failing

2012-02-02 Thread Aaron T. Myers (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2860. -- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Thanks

[jira] [Commented] (HDFS-2860) HA: TestDFSRollback#testRollback is failing

2012-02-02 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199441#comment-13199441 ] Eli Collins commented on HDFS-2860: --- +1 sorry should have caught this when filing!

[jira] [Updated] (HDFS-2860) HA: TestDFSRollback#testRollback is failing

2012-02-02 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2860: - Attachment: HDFS-2860-HDFS-1623.patch Trivial patch attached that just changes the expected except

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199408#comment-13199408 ] Aaron T. Myers commented on HDFS-2863: -- bq. I did not find a TestHAConfiguration in th

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199405#comment-13199405 ] Hudson commented on HDFS-2718: -- Integrated in Hadoop-Hdfs-22-branch #125 (See [https://builds

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199406#comment-13199406 ] Hudson commented on HDFS-2877: -- Integrated in Hadoop-Hdfs-22-branch #125 (See [https://builds

[jira] [Updated] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2863: - Attachment: HDFS-2863.HDFS-1623.patch I split the tests and renamed the one with shared edits to contain H

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199384#comment-13199384 ] Bikas Saha commented on HDFS-2863: -- I think we are mixing unit tests and functional tests

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199380#comment-13199380 ] Aaron T. Myers commented on HDFS-2863: -- bq. I added the TestFSNamesystem to be a class

[jira] [Updated] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2863: - Attachment: HDFS-2863.HDFS-1623.patch new patch. > Failures observed if dfs.edits.dir and

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199370#comment-13199370 ] Bikas Saha commented on HDFS-2863: -- 1.Will do 2.I added the TestFSNamesystem to be a class

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199371#comment-13199371 ] Aaron T. Myers commented on HDFS-2718: -- bq. I think the construction of filenames in T

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199367#comment-13199367 ] Todd Lipcon commented on HDFS-2718: --- No major issues, but this is fairly critical code an

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199365#comment-13199365 ] Aaron T. Myers commented on HDFS-2863: -- Thanks for adding the test. A few small commen

[jira] [Updated] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2863: - Attachment: HDFS-2863.HDFS-1623.patch Found Joiner on Google. Thanks anyways. Attached latest patch with

[jira] [Commented] (HDFS-2880) Protocol buffer changes to add support multiple storages

2012-02-02 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199360#comment-13199360 ] Hadoop QA commented on HDFS-2880: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2848) hdfs corruption appended to blocks is not detected by fs commands or fsck

2012-02-02 Thread Ravi Prakash (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199344#comment-13199344 ] Ravi Prakash commented on HDFS-2848: Talked to Nathan. He discovered that DirectoryScan

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199336#comment-13199336 ] Hudson commented on HDFS-2877: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1662 (See [https

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199337#comment-13199337 ] Hudson commented on HDFS-2877: -- Integrated in Hadoop-Mapreduce-0.23-Commit #488 (See [https:/

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Konstantin Shvachko (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199330#comment-13199330 ] Konstantin Shvachko commented on HDFS-2718: --- Glad to have your attention, Todd. W

[jira] [Commented] (HDFS-2854) SecurityUtil.buildTokenService returns java.net.UnknownHostException when using paths like viewfs://default/some/path

2012-02-02 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199327#comment-13199327 ] Daryn Sharp commented on HDFS-2854: --- The main problem is the {{TokenCache}}. It assumes

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199326#comment-13199326 ] Aaron T. Myers commented on HDFS-2863: -- bq. I did not assign editDirs = uniqueEditDirs

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199316#comment-13199316 ] Bikas Saha commented on HDFS-2863: -- I did not assign editDirs = uniqueEditDirs because I d

[jira] [Assigned] (HDFS-2854) SecurityUtil.buildTokenService returns java.net.UnknownHostException when using paths like viewfs://default/some/path

2012-02-02 Thread Daryn Sharp (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-2854: - Assignee: Daryn Sharp > SecurityUtil.buildTokenService returns java.net.UnknownHostException w

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199309#comment-13199309 ] Todd Lipcon commented on HDFS-2718: --- Looking at what was committed to trunk, I found a co

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199303#comment-13199303 ] Hudson commented on HDFS-2877: -- Integrated in Hadoop-Common-0.23-Commit #474 (See [https://bu

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199296#comment-13199296 ] Hudson commented on HDFS-2877: -- Integrated in Hadoop-Hdfs-0.23-Commit #464 (See [https://buil

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199293#comment-13199293 ] Hudson commented on HDFS-2877: -- Integrated in Hadoop-Common-trunk-Commit #1647 (See [https://

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199290#comment-13199290 ] Hudson commented on HDFS-2877: -- Integrated in Hadoop-Hdfs-trunk-Commit #1718 (See [https://bu

[jira] [Commented] (HDFS-2408) DFSClient#getNumCurrentReplicas is package private in 205 but public in branch-0.20-append

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199292#comment-13199292 ] Aaron T. Myers commented on HDFS-2408: -- bq. Can we do the same thing for 0.23 and trun

[jira] [Resolved] (HDFS-2861) HA: checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN

2012-02-02 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2861. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Contributed

[jira] [Commented] (HDFS-2848) hdfs corruption appended to blocks is not detected by fs commands or fsck

2012-02-02 Thread Ravi Prakash (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199285#comment-13199285 ] Ravi Prakash commented on HDFS-2848: Ran append on a corrupted file. The corruption is

[jira] [Updated] (HDFS-2880) Protocol buffer changes to add support multiple storages

2012-02-02 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2880: -- Attachment: HDFS-2880.txt HDFS-2880.txt Updated patch to fix test issue.

[jira] [Updated] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2877: -- Resolution: Fixed Fix Version/s: 0.22.1 1.1.0 0.

[jira] [Commented] (HDFS-2863) Failures observed if dfs.edits.dir and shared.edits.dir have same directories.

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199277#comment-13199277 ] Aaron T. Myers commented on HDFS-2863: -- The patch largely looks good, Bikas. A few com

[jira] [Commented] (HDFS-2879) Change FSDataset to package private

2012-02-02 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199269#comment-13199269 ] Hadoop QA commented on HDFS-2879: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2785) Update webhdfs and httpfs for host-based token support

2012-02-02 Thread Robert Joseph Evans (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199239#comment-13199239 ] Robert Joseph Evans commented on HDFS-2785: --- I am a bit confused about updating t

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199232#comment-13199232 ] Aaron T. Myers commented on HDFS-2877: -- +1, the patch looks good to me.

[jira] [Resolved] (HDFS-2858) DFSUtil.getSuffixIDs silently ignores exception in NetUtils.createSocketAddr

2012-02-02 Thread Bikas Saha (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved HDFS-2858. -- Resolution: Fixed Fixed in patch for -[HDFS-2859|https://issues.apache.org/jira/browse/HDFS-2859]-

[jira] [Commented] (HDFS-2784) Update hftp and hdfs for host-based token support

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199223#comment-13199223 ] Hudson commented on HDFS-2784: -- Integrated in Hadoop-Mapreduce-0.23-Commit #487 (See [https:/

[jira] [Commented] (HDFS-2814) NamenodeMXBean does not account for svn revision in the version information

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199224#comment-13199224 ] Hudson commented on HDFS-2814: -- Integrated in Hadoop-Mapreduce-0.23-Commit #487 (See [https:/

[jira] [Updated] (HDFS-2879) Change FSDataset to package private

2012-02-02 Thread Tsz Wo (Nicholas), SZE (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2879: - Attachment: h2879_20120202b.patch Thanks Suresh for the review. h2879_20120202b.p

[jira] [Created] (HDFS-2885) Remove "federation" from the nameservice config options

2012-02-02 Thread Eli Collins (Created) (JIRA)
Remove "federation" from the nameservice config options --- Key: HDFS-2885 URL: https://issues.apache.org/jira/browse/HDFS-2885 Project: Hadoop HDFS Issue Type: Improvement Affects Vers

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199180#comment-13199180 ] Hudson commented on HDFS-2718: -- Integrated in Hadoop-Mapreduce-0.23-Commit #486 (See [https:/

[jira] [Commented] (HDFS-2784) Update hftp and hdfs for host-based token support

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199163#comment-13199163 ] Hudson commented on HDFS-2784: -- Integrated in Hadoop-Common-0.23-Commit #473 (See [https://bu

[jira] [Commented] (HDFS-2814) NamenodeMXBean does not account for svn revision in the version information

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199164#comment-13199164 ] Hudson commented on HDFS-2814: -- Integrated in Hadoop-Common-0.23-Commit #473 (See [https://bu

[jira] [Commented] (HDFS-2814) NamenodeMXBean does not account for svn revision in the version information

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199161#comment-13199161 ] Hudson commented on HDFS-2814: -- Integrated in Hadoop-Hdfs-0.23-Commit #463 (See [https://buil

[jira] [Commented] (HDFS-2784) Update hftp and hdfs for host-based token support

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199160#comment-13199160 ] Hudson commented on HDFS-2784: -- Integrated in Hadoop-Hdfs-0.23-Commit #463 (See [https://buil

[jira] [Commented] (HDFS-2784) Update hftp and hdfs for host-based token support

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199150#comment-13199150 ] Hudson commented on HDFS-2784: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1661 (See [https

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199149#comment-13199149 ] Hudson commented on HDFS-2718: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1661 (See [https

[jira] [Updated] (HDFS-2690) trunk doesn't build on clean of .m2 - /bkjournal/pom.xml error

2012-02-02 Thread Jitendra Nath Pandey (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-2690: --- Resolution: Fixed Status: Resolved (was: Patch Available) Fixed by HDFS-234.

[jira] [Commented] (HDFS-2690) trunk doesn't build on clean of .m2 - /bkjournal/pom.xml error

2012-02-02 Thread Jitendra Nath Pandey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199135#comment-13199135 ] Jitendra Nath Pandey commented on HDFS-2690: I think this is not needed anymore

[jira] [Created] (HDFS-2884) TestDecommission.testDecommissionFederation fails intermittently

2012-02-02 Thread Eli Collins (Created) (JIRA)
TestDecommission.testDecommissionFederation fails intermittently Key: HDFS-2884 URL: https://issues.apache.org/jira/browse/HDFS-2884 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199132#comment-13199132 ] Hudson commented on HDFS-2718: -- Integrated in Hadoop-Common-0.23-Commit #472 (See [https://bu

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199129#comment-13199129 ] Hudson commented on HDFS-2718: -- Integrated in Hadoop-Hdfs-0.23-Commit #462 (See [https://buil

[jira] [Commented] (HDFS-2784) Update hftp and hdfs for host-based token support

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199117#comment-13199117 ] Hudson commented on HDFS-2784: -- Integrated in Hadoop-Common-trunk-Commit #1646 (See [https://

[jira] [Commented] (HDFS-2784) Update hftp and hdfs for host-based token support

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199116#comment-13199116 ] Hudson commented on HDFS-2784: -- Integrated in Hadoop-Hdfs-trunk-Commit #1717 (See [https://bu

[jira] [Commented] (HDFS-2785) Update webhdfs and httpfs for host-based token support

2012-02-02 Thread Jitendra Nath Pandey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199113#comment-13199113 ] Jitendra Nath Pandey commented on HDFS-2785: Please update with test results so

[jira] [Updated] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Konstantin Shvachko (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-2718: -- Resolution: Fixed Fix Version/s: 0.22.1 0.23.1

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199104#comment-13199104 ] Hudson commented on HDFS-2718: -- Integrated in Hadoop-Common-trunk-Commit #1645 (See [https://

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

2012-02-02 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199101#comment-13199101 ] Hudson commented on HDFS-2718: -- Integrated in Hadoop-Hdfs-trunk-Commit #1716 (See [https://bu

[jira] [Commented] (HDFS-2408) DFSClient#getNumCurrentReplicas is package private in 205 but public in branch-0.20-append

2012-02-02 Thread Gregory Chanan (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199103#comment-13199103 ] Gregory Chanan commented on HDFS-2408: -- Can we do the same thing for 0.23 and trunk?

[jira] [Commented] (HDFS-2303) jsvc needs to be recompilable

2012-02-02 Thread Alejandro Abdelnur (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199085#comment-13199085 ] Alejandro Abdelnur commented on HDFS-2303: -- Well that was an almost :) Don't know

[jira] [Commented] (HDFS-2883) trash behavior needs to be improved to be consistent so that only server side configs are enforced

2012-02-02 Thread Arpit Gupta (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199075#comment-13199075 ] Arpit Gupta commented on HDFS-2883: --- The following was noticed. namenode is running with

[jira] [Created] (HDFS-2883) trash behavior needs to be improved to be consistent so that only server side configs are enforced

2012-02-02 Thread Arpit Gupta (Created) (JIRA)
trash behavior needs to be improved to be consistent so that only server side configs are enforced -- Key: HDFS-2883 URL: https://issues.apache.org/jira/browse/HDFS-28

[jira] [Commented] (HDFS-2303) jsvc needs to be recompilable

2012-02-02 Thread Allen Wittenauer (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199069#comment-13199069 ] Allen Wittenauer commented on HDFS-2303: If I didn't have to spend the time upgradi

[jira] [Commented] (HDFS-2303) jsvc needs to be recompilable

2012-02-02 Thread Alejandro Abdelnur (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199066#comment-13199066 ] Alejandro Abdelnur commented on HDFS-2303: -- You are correct, but different from JA

[jira] [Commented] (HDFS-2808) HA: Use logical names in haadmin

2012-02-02 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199059#comment-13199059 ] Eli Collins commented on HDFS-2808: --- s/"slash"/"dash"/ > HA: Use logical

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199054#comment-13199054 ] Todd Lipcon commented on HDFS-2877: --- No, because on a local disk, if the process crashes,

[jira] [Created] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2012-02-02 Thread Todd Lipcon (Created) (JIRA)
DN continues to start up, even if block pool fails to initialize Key: HDFS-2882 URL: https://issues.apache.org/jira/browse/HDFS-2882 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199041#comment-13199041 ] Hari Mankude commented on HDFS-2877: Also, in non-HA situation, if namenode dies and co

[jira] [Updated] (HDFS-2808) HA: Use logical names in haadmin

2012-02-02 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2808: -- Attachment: hdfs-2808.txt As part of switching from host:ipc targets to logical namenode IDs we need to

[jira] [Commented] (HDFS-2874) HA: edit log should log to shared dirs before local dirs

2012-02-02 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199031#comment-13199031 ] Todd Lipcon commented on HDFS-2874: --- bq. Adding any type of write ordering to edit log up

[jira] [Commented] (HDFS-2874) HA: edit log should log to shared dirs before local dirs

2012-02-02 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199028#comment-13199028 ] Hari Mankude commented on HDFS-2874: Adding any type of write ordering to edit log upda

[jira] [Commented] (HDFS-2303) jsvc needs to be recompilable

2012-02-02 Thread Allen Wittenauer (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199000#comment-13199000 ] Allen Wittenauer commented on HDFS-2303: But jsvc isn't an OS-installable package o

[jira] [Commented] (HDFS-2303) jsvc needs to be recompilable

2012-02-02 Thread Alejandro Abdelnur (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198982#comment-13198982 ] Alejandro Abdelnur commented on HDFS-2303: -- @Allen regarding using JARs bundled in

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

2012-02-02 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198983#comment-13198983 ] Todd Lipcon commented on HDFS-2877: --- Uma's got it -- the RandomAccessFile constructor wil

[jira] [Commented] (HDFS-2303) jsvc needs to be recompilable

2012-02-02 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198955#comment-13198955 ] Aaron T. Myers commented on HDFS-2303: -- bq. ... and my point was that if we're going t

[jira] [Commented] (HDFS-2848) hdfs corruption appended to blocks is not detected by fs commands or fsck

2012-02-02 Thread Ravi Prakash (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198948#comment-13198948 ] Ravi Prakash commented on HDFS-2848: BlockPoolSliceScanner is not going to detect this

[jira] [Commented] (HDFS-2303) jsvc needs to be recompilable

2012-02-02 Thread Allen Wittenauer (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198945#comment-13198945 ] Allen Wittenauer commented on HDFS-2303: In 1.x, the current situation hasn't cause

[jira] [Commented] (HDFS-2861) HA: checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN

2012-02-02 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198941#comment-13198941 ] Eli Collins commented on HDFS-2861: --- +1 lgtm > HA: checkpointing should

  1   2   >