[jira] [Updated] (HDFS-4001) TestSafeMode#testInitializeReplQueuesEarly may time out

2012-10-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4001: -- Attachment: timeout.txt.gz Full test log attached. > TestSafeMode#testInitializeReplQue

[jira] [Created] (HDFS-4001) TestSafeMode#testInitializeReplQueuesEarly may time out

2012-10-02 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4001: - Summary: TestSafeMode#testInitializeReplQueuesEarly may time out Key: HDFS-4001 URL: https://issues.apache.org/jira/browse/HDFS-4001 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-3753) Tests don't run with native libraries

2012-10-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13468340#comment-13468340 ] Eli Collins commented on HDFS-3753: --- Looks like TestNativeCodeLoader is failing in some o

[jira] [Created] (HDFS-4000) TestParallelLocalRead fails with "input ByteBuffers must be direct buffers"

2012-10-02 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4000: - Summary: TestParallelLocalRead fails with "input ByteBuffers must be direct buffers" Key: HDFS-4000 URL: https://issues.apache.org/jira/browse/HDFS-4000 Project: Hadoop HDF

[jira] [Updated] (HDFS-3996) Add debug log removed in HDFS-3873 back

2012-10-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3996: -- Target Version/s: 2.0.3-alpha Status: Patch Available (was: Open) > Add debug log rem

[jira] [Updated] (HDFS-3996) Add debug log removed in HDFS-3873 back

2012-10-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3996: -- Attachment: hdfs-3996.txt Patch attached. > Add debug log removed in HDFS-3873 back > -

[jira] [Updated] (HDFS-3753) Tests don't run with native libraries

2012-10-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3753: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.2-alpha)

[jira] [Created] (HDFS-3996) Add debug log removed in HDFS-3873 back

2012-10-02 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3996: - Summary: Add debug log removed in HDFS-3873 back Key: HDFS-3996 URL: https://issues.apache.org/jira/browse/HDFS-3996 Project: Hadoop HDFS Issue Type: Bug Affec

[jira] [Commented] (HDFS-3753) Tests don't run with native libraries

2012-10-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467901#comment-13467901 ] Eli Collins commented on HDFS-3753: --- +1 looks great Nit: LD_LIBRARY_PATH shouldn't be i

[jira] [Commented] (HDFS-3461) HFTP should use the same port & protocol for getting the delegation token

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465306#comment-13465306 ] Eli Collins commented on HDFS-3461: --- Also, this patch needs to support KSSL anyway otherw

[jira] [Created] (HDFS-3989) Remove duplicate Http server SSL code

2012-09-27 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3989: - Summary: Remove duplicate Http server SSL code Key: HDFS-3989 URL: https://issues.apache.org/jira/browse/HDFS-3989 Project: Hadoop HDFS Issue Type: Bug C

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465270#comment-13465270 ] Eli Collins commented on HDFS-1312: --- There are issues with just modifying the placement p

[jira] [Commented] (HDFS-3983) Hftp should support both SPNEGO and KSSL

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465083#comment-13465083 ] Eli Collins commented on HDFS-3983: --- Yes, it's already broken in trunk. HDFS-3699 tracks

[jira] [Updated] (HDFS-3983) Hftp should support both SPNEGO and KSSL

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3983: -- Component/s: security Summary: Hftp should support both SPNEGO and KSSL (was: Hftp should not u

[jira] [Updated] (HDFS-3983) Hftp should not use the https port

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3983: -- Status: Open (was: Patch Available) > Hftp should not use the https port >

[jira] [Commented] (HDFS-3983) Hftp should not use the https port

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465073#comment-13465073 ] Eli Collins commented on HDFS-3983: --- Btw I'm going to hold off on committing this patch f

[jira] [Commented] (HDFS-3983) Hftp should not use the https port

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465064#comment-13465064 ] Eli Collins commented on HDFS-3983: --- Actually Tucu pointed out offline that you need two

[jira] [Commented] (HDFS-3983) Hftp should not use the https port

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465007#comment-13465007 ] Eli Collins commented on HDFS-3983: --- By having Hftp and WebHdfs support https (via HADOOP

[jira] [Commented] (HDFS-3983) Hftp should not use the https port

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464904#comment-13464904 ] Eli Collins commented on HDFS-3983: --- Btw per your comment wrt Hsftp, I haven't tested it.

[jira] [Commented] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-09-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464878#comment-13464878 ] Eli Collins commented on HDFS-3873: --- I'm saying we should re-introduce the "LOG.debug("er

[jira] [Created] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

2012-09-27 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3985: - Summary: TestMulitipleNNDataBlockScanner may hang Key: HDFS-3985 URL: https://issues.apache.org/jira/browse/HDFS-3985 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3984) TestAuditLogs#testAuditWebHdfs flaky

2012-09-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3984: - Summary: TestAuditLogs#testAuditWebHdfs flaky Key: HDFS-3984 URL: https://issues.apache.org/jira/browse/HDFS-3984 Project: Hadoop HDFS Issue Type: Bug Co

[jira] [Resolved] (HDFS-3968) TestPersistBlocks seems to fail intermittently

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3968. --- Resolution: Duplicate Dupe of HDFS-3664. > TestPersistBlocks seems to fail intermitte

[jira] [Commented] (HDFS-3971) Add a resume feature to the copyFromLocal and put commands

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464475#comment-13464475 ] Eli Collins commented on HDFS-3971: --- Yea, something like rsync or Sqoop for file systems

[jira] [Updated] (HDFS-3983) Hftp should not use the https port

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3983: -- Attachment: hdfs-3983.txt Updated patch attached. Makes the same updates to TestHftpDelegationToken that

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464425#comment-13464425 ] Eli Collins commented on HDFS-1312: --- This one is on my radar, just haven't had time to ge

[jira] [Updated] (HDFS-3983) Hftp should not use the https port

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3983: -- Status: Patch Available (was: Open) > Hftp should not use the https port >

[jira] [Updated] (HDFS-3983) Hftp should not use the https port

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3983: -- Attachment: hdfs-3983.txt Patch attached. I verified on a secure cluster that hftp now works w/o setting

[jira] [Assigned] (HDFS-3753) Tests don't run with native libraries

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3753: - Assignee: Colin Patrick McCabe > Tests don't run with native libraries > -

[jira] [Resolved] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3931. --- Resolution: Fixed > TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken > --

[jira] [Reopened] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reopened HDFS-3931: --- > TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken >

[jira] [Assigned] (HDFS-3983) Hftp should not use the https port

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3983: - Assignee: Eli Collins > Hftp should not use the https port > -

[jira] [Created] (HDFS-3983) Hftp should not use the https port

2012-09-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3983: - Summary: Hftp should not use the https port Key: HDFS-3983 URL: https://issues.apache.org/jira/browse/HDFS-3983 Project: Hadoop HDFS Issue Type: Bug Affects Ve

[jira] [Commented] (HDFS-3873) Hftp assumes security is disabled if token fetch fails

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464348#comment-13464348 ] Eli Collins commented on HDFS-3873: --- Hey Daryn, With this change we no longer log the ex

[jira] [Updated] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3972: -- Resolution: Fixed Fix Version/s: 2.0.2-alpha Target Version/s: (was: 3.0.0, 2.0.2-alph

[jira] [Commented] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464169#comment-13464169 ] Eli Collins commented on HDFS-3972: --- Test failures are unrelated: HDFS-3811 - TestPersis

[jira] [Commented] (HDFS-3910) DFSTestUtil#waitReplication should timeout

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464156#comment-13464156 ] Eli Collins commented on HDFS-3910: --- @Arun, I verified that HBase does not use DFSTestUti

[jira] [Commented] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-25 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463335#comment-13463335 ] Eli Collins commented on HDFS-3972: --- +1 pending jenkins, looks great > T

[jira] [Commented] (HDFS-3966) For branch-1, TestFileCreation should use JUnit4 to make assumeTrue work

2012-09-21 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460886#comment-13460886 ] Eli Collins commented on HDFS-3966: --- +1 looks good > For branch-1, Test

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-21 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460831#comment-13460831 ] Eli Collins commented on HDFS-3932: --- Steve, wrt #1, yes, I tested on a machine with three

[jira] [Commented] (HDFS-3148) The client should be able to use multiple local interfaces for data transfer

2012-09-21 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460829#comment-13460829 ] Eli Collins commented on HDFS-3148: --- Thanks Jing, I'll review. > The cli

[jira] [Updated] (HDFS-3964) Make NN log of fs.defaultFS debug rather than info

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3964: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.3-alpha)

[jira] [Updated] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3931: -- Priority: Minor (was: Major) Target Version/s: (was: 2.0.2-alpha) Fix Version/s: 2.

[jira] [Commented] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460228#comment-13460228 ] Eli Collins commented on HDFS-3931: --- Thanks for the explanation Andy. +1 to the latest pa

[jira] [Updated] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3932: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.3-alpha)

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460207#comment-13460207 ] Eli Collins commented on HDFS-3932: --- +1 to the latest patch. Thanks for the suggestion Da

[jira] [Updated] (HDFS-3964) Make NN log of fs.defaultFS debug rather than info

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3964: -- Description: HDFS-3939 added a log where the NN clobbers fs.defaultFS, this is used to determine the add

[jira] [Updated] (HDFS-3964) Make NN log of fs.defaultFS debug rather than info

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3964: -- Status: Patch Available (was: Open) > Make NN log of fs.defaultFS debug rather than info >

[jira] [Updated] (HDFS-3964) Make NN log of fs.defaultFS debug rather than info

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3964: -- Attachment: hdfs-3964.txt Trivial patch attached. > Make NN log of fs.defaultFS debug r

[jira] [Created] (HDFS-3964) Make NN log of fs.defaultFS debug rather than info

2012-09-20 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3964: - Summary: Make NN log of fs.defaultFS debug rather than info Key: HDFS-3964 URL: https://issues.apache.org/jira/browse/HDFS-3964 Project: Hadoop HDFS Issue Type: Bu

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460006#comment-13460006 ] Eli Collins commented on HDFS-3932: --- getNameNodeRpcAddressForHttpServer can be replaced e

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-20 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459740#comment-13459740 ] Eli Collins commented on HDFS-3932: --- NetUtils#getConnectAddress claims it returns the loo

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459305#comment-13459305 ] Eli Collins commented on HDFS-3932: --- +1 pending jenkins. I sanity tested using the Web UI

[jira] [Updated] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3932: -- Hadoop Flags: Reviewed Status: Patch Available (was: Open) > NameNode Web UI broken if th

[jira] [Commented] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459300#comment-13459300 ] Eli Collins commented on HDFS-3931: --- bq. What's the downside to increasing waitReplicatio

[jira] [Updated] (HDFS-3949) NameNodeRpcServer#join should join on both client and server RPC servers

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3949: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.3-alpha)

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459263#comment-13459263 ] Eli Collins commented on HDFS-3932: --- - Rather than loop through IPs I think it would be b

[jira] [Commented] (HDFS-3950) QJM: misc TODO cleanup, improved log messages, etc

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459215#comment-13459215 ] Eli Collins commented on HDFS-3950: --- Makes sense. > QJM: misc TODO clean

[jira] [Updated] (HDFS-3947) If there are multiple edit logs with the same fstime, Recovery Mode should load a different one than the normal loading process

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3947: -- Status: Open (was: Patch Available) > If there are multiple edit logs with the same fstime, Recover

[jira] [Commented] (HDFS-3956) QJM: purge temporary files when no longer within retention period

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459169#comment-13459169 ] Eli Collins commented on HDFS-3956: --- +1 looks great > QJM: purge tempora

[jira] [Commented] (HDFS-3959) Jersey warnings due to WebHDFS binding "/"

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459149#comment-13459149 ] Eli Collins commented on HDFS-3959: --- Here's all the warnings: Sep 17, 2012 5:01:28 PM co

[jira] [Created] (HDFS-3959) Jersey warnings due to WebHDFS binding "/"

2012-09-19 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3959: - Summary: Jersey warnings due to WebHDFS binding "/" Key: HDFS-3959 URL: https://issues.apache.org/jira/browse/HDFS-3959 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458953#comment-13458953 ] Eli Collins commented on HDFS-3931: --- Oops, auto-submitted. Looks like the patch needs to

[jira] [Commented] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458943#comment-13458943 ] Eli Collins commented on HDFS-3931: --- waitReplicas > TestDatanodeBlockSc

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458938#comment-13458938 ] Eli Collins commented on HDFS-3932: --- - determineHttpAddress would be better named somethi

[jira] [Commented] (HDFS-3955) QJM: Make acceptRecovery() atomic

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458911#comment-13458911 ] Eli Collins commented on HDFS-3955: --- +1 New design and code looks great.

[jira] [Commented] (HDFS-3950) QJM: misc TODO cleanup, improved log messages, etc

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458871#comment-13458871 ] Eli Collins commented on HDFS-3950: --- +1 Worth making the output buffer size configurable

[jira] [Commented] (HDFS-3951) datanode web ui does not work over HTTPS when datanode is started in secure mode

2012-09-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458851#comment-13458851 ] Eli Collins commented on HDFS-3951: --- +1 looks great. > datanode web ui

[jira] [Updated] (HDFS-3947) If there are multiple edit logs with the same fstime, Recovery Mode should load a different one than the normal loading process

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3947: -- Status: Open (was: Patch Available) Jenkins doesn't run test-patch on branch-1 patches. Please run test

[jira] [Updated] (HDFS-3939) NN RPC address cleanup

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3939: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.3-alpha)

[jira] [Updated] (HDFS-3949) NameNodeRpcServer#join should join on both client and server RPC servers

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3949: -- Attachment: hdfs-3949.txt Patch attached, same change from HDFS-3939. > NameNodeRpcServ

[jira] [Assigned] (HDFS-3949) NameNodeRpcServer#join should join on both client and server RPC servers

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3949: - Assignee: Eli Collins > NameNodeRpcServer#join should join on both client and server RPC serve

[jira] [Updated] (HDFS-3949) NameNodeRpcServer#join should join on both client and server RPC servers

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3949: -- Status: Patch Available (was: Open) > NameNodeRpcServer#join should join on both client and server

[jira] [Created] (HDFS-3949) NameNodeRpcServer#join should join on both client and server RPC servers

2012-09-18 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3949: - Summary: NameNodeRpcServer#join should join on both client and server RPC servers Key: HDFS-3949 URL: https://issues.apache.org/jira/browse/HDFS-3949 Project: Hadoop HDFS

[jira] [Updated] (HDFS-3936) MiniDFSCluster shutdown races with BlocksMap usage

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3936: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.2-alpha)

[jira] [Resolved] (HDFS-2051) TestBlockRecovery.testErrorReplicas is timing out

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2051. --- Resolution: Fixed No longer seeing this. > TestBlockRecovery.testErrorReplicas is tim

[jira] [Commented] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457944#comment-13457944 ] Eli Collins commented on HDFS-3948: --- Here's the full backtrace: {noformat} testNamenodeR

[jira] [Created] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-09-18 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3948: - Summary: TestWebHDFS#testNamenodeRestart is racy Key: HDFS-3948 URL: https://issues.apache.org/jira/browse/HDFS-3948 Project: Hadoop HDFS Issue Type: Bug Affe

[jira] [Commented] (HDFS-3944) Httpfs resolveAuthority() is not resolving host correctly

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457617#comment-13457617 ] Eli Collins commented on HDFS-3944: --- +1 > Httpfs resolveAuthority() is n

[jira] [Updated] (HDFS-3936) MiniDFSCluster shutdown races with BlocksMap usage

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3936: -- Summary: MiniDFSCluster shutdown races with BlocksMap usage (was: MiniDFSCluster shutdown may fail due

[jira] [Resolved] (HDFS-3933) Unclean exit in ReplicationMonitor#run occasionally causes tests to fail

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3933. --- Resolution: Duplicate Now that we can see the root cause, this is a dupe of HDFS-3936. {noformat} 201

[jira] [Updated] (HDFS-3946) Separate client and server uses of NN#getAddress

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3946: -- Description: The use of the various static NN#getAddress methods are hard to follow because they're used

[jira] [Created] (HDFS-3946) Separate client and server uses of NN#getAddress

2012-09-17 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3946: - Summary: Separate client and server uses of NN#getAddress Key: HDFS-3946 URL: https://issues.apache.org/jira/browse/HDFS-3946 Project: Hadoop HDFS Issue Type: Impr

[jira] [Created] (HDFS-3945) HDFS conf is loading MR and YARN config files

2012-09-17 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3945: - Summary: HDFS conf is loading MR and YARN config files Key: HDFS-3945 URL: https://issues.apache.org/jira/browse/HDFS-3945 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457474#comment-13457474 ] Eli Collins commented on HDFS-3932: --- The issue is that the NN passes the rpc listener add

[jira] [Commented] (HDFS-3943) QJM: remove currently unused "md5sum" field.

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457363#comment-13457363 ] Eli Collins commented on HDFS-3943: --- +1 looks good > QJM: remove current

[jira] [Commented] (HDFS-2148) Address all the federation TODOs

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457330#comment-13457330 ] Eli Collins commented on HDFS-2148: --- Hey Suresh, Think the remaining TODOs will get addr

[jira] [Updated] (HDFS-3939) NN RPC address cleanup

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3939: -- Summary: NN RPC address cleanup (was: Some NN#getNameNodeAddress cleanup) > NN RPC address cleanup

[jira] [Updated] (HDFS-3939) Some NN#getNameNodeAddress cleanup

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3939: -- Attachment: hdfs-3939.txt Thanks Daryn! Yes the test failure is unrelated (HDFS-3931). Updated patch wi

[jira] [Commented] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13456776#comment-13456776 ] Eli Collins commented on HDFS-3931: --- Looks like 5s isn't enough? Failed on jenkins above

[jira] [Commented] (HDFS-3936) MiniDFSCluster shutdown may fail due to BlocksMap#getBlockCollection NPE

2012-09-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13456770#comment-13456770 ] Eli Collins commented on HDFS-3936: --- bq. But, but... I looked at LightWeightGSet.java and

[jira] [Updated] (HDFS-3936) MiniDFSCluster shutdown may fail due to BlocksMap#getBlockCollection NPE

2012-09-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3936: -- Attachment: hdfs-3936.txt Updated patch attached. > MiniDFSCluster shutdown may fail du

[jira] [Created] (HDFS-3940) Add Gset#clear method

2012-09-14 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3940: - Summary: Add Gset#clear method Key: HDFS-3940 URL: https://issues.apache.org/jira/browse/HDFS-3940 Project: Hadoop HDFS Issue Type: Improvement Affects Version

[jira] [Commented] (HDFS-3936) MiniDFSCluster shutdown may fail due to BlocksMap#getBlockCollection NPE

2012-09-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13456253#comment-13456253 ] Eli Collins commented on HDFS-3936: --- Looping and adding a timeout to the test revealed th

[jira] [Updated] (HDFS-3939) Some NN#getNameNodeAddress cleanup

2012-09-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3939: -- Status: Patch Available (was: Open) > Some NN#getNameNodeAddress cleanup >

[jira] [Updated] (HDFS-3939) Some NN#getNameNodeAddress cleanup

2012-09-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3939: -- Attachment: hdfs-3939.txt Patch attached. > Some NN#getNameNodeAddress cleanup > --

[jira] [Created] (HDFS-3939) Some NN#getNameNodeAddress cleanup

2012-09-14 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3939: - Summary: Some NN#getNameNodeAddress cleanup Key: HDFS-3939 URL: https://issues.apache.org/jira/browse/HDFS-3939 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-3566) Custom Replication Policy for Azure

2012-09-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13456232#comment-13456232 ] Eli Collins commented on HDFS-3566: --- Sumadhur, for branch-1 we use {{ant test-patch}} and

[jira] [Updated] (HDFS-3936) MiniDFSCluster shutdown may fail due to BlocksMap#getBlockCollection NPE

2012-09-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3936: -- Attachment: hdfs-3936.txt Patch attached. BlocksMap#close now empties the blocks map. Not a fix for the

[jira] [Commented] (HDFS-3936) MiniDFSCluster shutdown may fail due to BlocksMap#getBlockCollection NPE

2012-09-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13456204#comment-13456204 ] Eli Collins commented on HDFS-3936: --- Colin, Good point - HDFS-1114 added it because some

<    1   2   3   4   5   6   7   8   9   10   >