Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-04 Thread Eli Collins
+1 for another rc. There have been quite a few issues found (handful marked blocker) and this is only the first release candidate, seems like the point of having multiple release candidates is to iterate with another one that addresses the major issues found with the previous one. On Fri, Apr 4,

Re: Deprecate BackupNode

2013-12-04 Thread Eli Collins
I'm still +1. Thanks for picking this back up Suresh. On Wed, Dec 4, 2013 at 3:06 PM, Suresh Srinivas wrote: > It is almost an year a jira proposed deprecating backup node - > https://issues.apache.org/jira/browse/HDFS-4114. > > Maintaining it adds unnecessary work. As an example, when I added s

Re: Deprecate hftp / hsftp

2013-11-26 Thread Eli Collins
Hey Haohui, Seems reasonable to mark hftp and hsftp as deprecated in 2.x and remove them from trunk (for 3.x). Thanks, Eli On Tuesday, November 26, 2013, Haohui Mai wrote: > Hi, > > Recently I've been focusing on fixing hftp / hsftp / webhdfs / swebhdfs in > various set ups. Now we have reached

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-22 Thread Eli Collins
On Mon, Oct 21, 2013 at 9:50 PM, Arun C Murthy wrote: > > On Oct 18, 2013, at 2:17 PM, Eli Collins wrote: > > On Fri, Oct 18, 2013 at 2:10 PM, Arun C Murthy wrote: > > Folks, > > Currently http://hadoop.apache.org/docs/stable/ points to hadoop-1. With > hadoop-2 goi

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-18 Thread Eli Collins
On Fri, Oct 18, 2013 at 2:10 PM, Arun C Murthy wrote: > Folks, > > Currently http://hadoop.apache.org/docs/stable/ points to hadoop-1. With > hadoop-2 going GA, should we just point that to hadoop-2? > > Couple of options: > # Have stable1/stable2 links: >http://hadoop.apache.org/docs/stab

Re: symlink support in Hadoop 2 GA

2013-09-18 Thread Eli Collins
On Wed, Sep 18, 2013 at 5:45 AM, Steve Loughran wrote: > On 18 September 2013 12:53, Alejandro Abdelnur wrote: > > > On Wed, Sep 18, 2013 at 11:29 AM, Steve Loughran > >wrote: > > > > > I'm reluctant for this as while delaying the release, because we are > > going > > > to find problems all the

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Eli Collins
(Looping in Arun since this impacts 2.x releases) I updated the versions on HADOOP-8040 and sub-tasks to reflect where the changes have landed. All of these changes (modulo HADOOP-9417) were merged to branch-2.1 and are in the 2.1.0 release. While symlinks are in 2.1.0 I don't think we can really

[jira] [Resolved] (HDFS-5176) WebHDFS should support logical service names in URIs

2013-09-09 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-5176. --- Resolution: Duplicate Yes, thanks for the reference Arpit. I didn't find that when searching. Cl

[jira] [Created] (HDFS-5176) WebHDFS should support logical service names in URIs

2013-09-09 Thread Eli Collins (JIRA)
Eli Collins created HDFS-5176: - Summary: WebHDFS should support logical service names in URIs Key: HDFS-5176 URL: https://issues.apache.org/jira/browse/HDFS-5176 Project: Hadoop HDFS Issue Type

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-17 Thread Eli Collins
+1 On Friday, May 17, 2013, Thomas Graves wrote: > Hello all, > > We've had a few critical issues come up in 0.23.7 that I think warrants a > 0.23.8 release. The main one is MAPREDUCE-5211. There are a couple of > other issues that I want finished up and get in before we spin it. Those > includ

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Eli Collins
On Fri, Apr 26, 2013 at 2:42 PM, Suresh Srinivas wrote: > Eli, I will post a more detailed reply soon. But one small correction: > > > I'm also not sure there's currently consensus on what an incompatible >> change is. For example, I think HADOOP-9151 is incompatible because it >> broke client/ser

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Eli Collins
On Fri, Apr 26, 2013 at 11:15 AM, Arun C Murthy wrote: > > On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik wrote: > >> On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy wrote: >> >>> With that in mind, I really want to make a serious push to lock down APIs >>> and wire-protocols for hadoop-2.0.5-beta

[jira] [Resolved] (HDFS-4653) 4 unit tests in TestFcHdfsSymlink failed on trunk

2013-04-03 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-4653. --- Resolution: Not A Problem Thanks Junping, and sorry for the noise! I reverted HADOOP-9357 so this is

Re: VOTE: HDFS-347 merge

2013-02-27 Thread Eli Collins
have a configuration option that enables it. > > So in addition to dfs.client.use.legacy.blockreader, which we already > have, we would have dfs.client.use.legacy.blockreader.local. > > Does that make sense? > > best, > Colin > > > On Wed, Feb 27, 2013 at 12:06 PM

Re: VOTE: HDFS-347 merge

2013-02-27 Thread Eli Collins
On Wed, Feb 27, 2013 at 11:45 AM, sanjay Radia wrote: > > On Feb 26, 2013, at 1:51 PM, Eli Collins wrote: > >> it doesn't seem right to hold up 347 up for Windows support given that >> Windows support has not been merged to trunk yet, is not in any Apache >> relea

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-27 Thread Eli Collins
Bobby raises some good questions. A related one, since most current developers won't add Windows support for new features that are platform specific is it assumed that Windows development will either lag or will people actively work on keeping Windows up with the latest? And vice versa in case Wi

Re: VOTE: HDFS-347 merge

2013-02-26 Thread Eli Collins
On Tue, Feb 26, 2013 at 11:35 AM, Suresh Srinivas wrote: >> >> >> I assume you mean in trunk? Given that ATM's proposal is to only >> remove HDFS-2246 from branch-2 once (a) we're confident in HDFS-347 >> and (b) adds Windows support, and we won't be releasing from trunk any >> time soon - from

Re: VOTE: HDFS-347 merge

2013-02-26 Thread Eli Collins
On Tue, Feb 26, 2013 at 9:33 AM, Suresh Srinivas wrote: >> >> >> There's no reason to maintain multiple implementations of the same >> feature, that's why per the 2246 jira it was proposed as a "good short >> term solution till HDFS-347 is completed". Why is ATM's compromise >> unacceptable? >>

Re: VOTE: HDFS-347 merge

2013-02-25 Thread Eli Collins
On Mon, Feb 25, 2013 at 4:09 PM, Suresh Srinivas wrote: > ATM's suggestion of removing HDFS-2246 in trunk, but not branch-2, is >> a rational compromise: it allows some period for others to adapt, but >> not an indefinite one. It's not clear what you're proposing, if >> anything. >> > > > > I am n

Re: VOTE: HDFS-347 merge

2013-02-25 Thread Eli Collins
On Mon, Feb 25, 2013 at 1:50 PM, Chris Douglas wrote: > On Mon, Feb 25, 2013 at 1:16 PM, Eli Collins wrote: >> I think we need a transition period when any kinks are worked out of >> 347 but I don't think we need one alpha/beta release where both >> mechanisms are s

Re: VOTE: HDFS-347 merge

2013-02-25 Thread Eli Collins
a short term solution and we should not keep it > there forever. However, we still need a transition period to replace an old > mechanism by a new one. No? > > Tsz-Wo > > > > > ____________ > From: Eli Collins > To: "hdfs-dev@hadoop.apach

Re: VOTE: HDFS-347 merge

2013-02-25 Thread Eli Collins
On Sat, Feb 23, 2013 at 4:23 PM, Tsz Wo Sze wrote: > I still do not see a valid reason to remove HDFS-2246 immediately. Some > users may have insecure clusters and they don't want to change their > configuration. Because it doesn't make sense to support multiple mechanisms for the same thing.

Re: VOTE: HDFS-347 merge

2013-02-22 Thread Eli Collins
On Thu, Feb 21, 2013 at 1:24 PM, Chris Douglas wrote: > On Wed, Feb 20, 2013 at 5:12 PM, Aaron T. Myers wrote: >> Given that the only substantive concerns with HDFS-347 seem to be about >> Windows support for local reads, for now we only merge this branch to >> trunk. Support for doing HDFS-2246

Re: Heads up - merge branch-trunk-win to trunk

2013-02-07 Thread Eli Collins
Thanks for the update Suresh. Has any testing been done on the branch on Linux aside from running the unit tests? Thanks, Eli On Thu, Feb 7, 2013 at 5:42 PM, Suresh Srinivas wrote: > The support for Hadoop on Windows was proposed in > HADOOP-8079

Re: Release numbering for branch-2 releases

2013-01-31 Thread Eli Collins
ur Roadmap wiki and other docs post this > discussion. > > thanks, > Arun > > > > On Jan 30, 2013, at 4:21 PM, Eli Collins wrote: > > > Thanks for bringing this up Arun. One of the issues is that we > > haven't been clear about what type of compatibility

Re: Release numbering for branch-2 releases

2013-01-30 Thread Eli Collins
Thanks for bringing this up Arun. One of the issues is that we haven't been clear about what type of compatibility breakages are allowed, and which are not. For example, renaming FileSystem#open is incompatible, and not OK, regardless of the alpha/beta tag. Breaking a server/server APIs is OK pr

[jira] [Created] (HDFS-4383) Document the lease limits

2013-01-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4383: - Summary: Document the lease limits Key: HDFS-4383 URL: https://issues.apache.org/jira/browse/HDFS-4383 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-3636) TestMetricsSystemImpl#testInitFirst failed

2013-01-10 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3636. --- Resolution: Duplicate Looks like HADOOP-8981 fixes this. Resolving this as a dupe

[jira] [Created] (HDFS-4378) Create a StorageID class

2013-01-09 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4378: - Summary: Create a StorageID class Key: HDFS-4378 URL: https://issues.apache.org/jira/browse/HDFS-4378 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-4377) Some trivial DN comment cleanup

2013-01-09 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4377: - Summary: Some trivial DN comment cleanup Key: HDFS-4377 URL: https://issues.apache.org/jira/browse/HDFS-4377 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Resolved] (HDFS-3984) TestAuditLogs#testAuditWebHdfs flaky

2012-12-06 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3984. --- Resolution: Duplicate HDFS-4055 ended up fixing this. > TestAuditL

Re: profiling hdfs write path

2012-12-04 Thread Eli Collins
On Tue, Dec 4, 2012 at 9:39 AM, Radim Kolar wrote: > >> If you're just going to insult us, please stay away. We don't need >> your help unless you're going to be constructive. > > Good units tests will catch code modifications like: > Agree. Want to write some? Would love to see patches like t

[jira] [Created] (HDFS-4227) Document dfs.namenode.resource.*

2012-11-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4227: - Summary: Document dfs.namenode.resource.* Key: HDFS-4227 URL: https://issues.apache.org/jira/browse/HDFS-4227 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4226) TestFsck may fail with RuntimeException

2012-11-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4226: - Summary: TestFsck may fail with RuntimeException Key: HDFS-4226 URL: https://issues.apache.org/jira/browse/HDFS-4226 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4217) DatanodeDescriptor#isAlive and needKeyUpdate should be private

2012-11-20 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4217: - Summary: DatanodeDescriptor#isAlive and needKeyUpdate should be private Key: HDFS-4217 URL: https://issues.apache.org/jira/browse/HDFS-4217 Project: Hadoop HDFS

Re: seems like HDFS-4156 backport to branch-2 is breaking compilation

2012-11-17 Thread Eli Collins
Fixed. On Sat, Nov 17, 2012 at 8:18 PM, Alejandro Abdelnur wrote: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile > (default-testCompile) on project hadoop-hdfs: Compilation failure: > Compilation failure: > [ERROR] > /Users/tucu/src/apache/had

[jira] [Created] (HDFS-4201) NPE in BPServiceActor#sendHeartBeat

2012-11-16 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4201: - Summary: NPE in BPServiceActor#sendHeartBeat Key: HDFS-4201 URL: https://issues.apache.org/jira/browse/HDFS-4201 Project: Hadoop HDFS Issue Type: Bug

Re: FileSystem.getFileChecksum() returns null on LocalFileSystem

2012-11-14 Thread Eli Collins
It's not implemented for local file system (RawLocalFileSystem), see the javadoc from FileSystem: * @return The file checksum. The default return value is null, * which indicates that no checksum algorithm is implemented * in the corresponding FileSystem. Given that LocalFileSystem ex

[jira] [Reopened] (HDFS-4048) Use ERROR instead of INFO for volume failure logs

2012-11-08 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reopened HDFS-4048: --- Forgot to mention, the previous test failure was unrelated. Since we're just changing loglevels n

[jira] [Resolved] (HDFS-4048) Use ERROR instead of INFO for volume failure logs

2012-11-08 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-4048. --- Resolution: Fixed > Use ERROR instead of INFO for volume failure l

[jira] [Created] (HDFS-4156) Seeking to a negative position should throw an IOE

2012-11-06 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4156: - Summary: Seeking to a negative position should throw an IOE Key: HDFS-4156 URL: https://issues.apache.org/jira/browse/HDFS-4156 Project: Hadoop HDFS Issue Type

Re: Status of CheckpointNode and BackupNode

2012-10-26 Thread Eli Collins
daemons that exist, etc. All >> I've seen them do is increase confusion among users and be a maintenance >> burden on developers. >> >> -- >> Aaron T. Myers >> Software Engineer, Cloudera >> >> >> >> On Mon, Oct 15, 2012 at 12:12 PM, Eli C

[jira] [Created] (HDFS-4114) Remove the BackupNode and CheckpointNode

2012-10-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4114: - Summary: Remove the BackupNode and CheckpointNode Key: HDFS-4114 URL: https://issues.apache.org/jira/browse/HDFS-4114 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-16 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4068: - Summary: DatanodeID and DatanodeInfo member should be private Key: HDFS-4068 URL: https://issues.apache.org/jira/browse/HDFS-4068 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-16 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4067: - Summary: TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException Key: HDFS-4067 URL: https://issues.apache.org/jira/browse/HDFS-4067 Project: Hadoop HDFS

[jira] [Created] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4061: - Summary: TestBalancer and TestUnderReplicatedBlocks need timeouts Key: HDFS-4061 URL: https://issues.apache.org/jira/browse/HDFS-4061 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4060) TestHSync#testSequenceFileSync failed

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4060: - Summary: TestHSync#testSequenceFileSync failed Key: HDFS-4060 URL: https://issues.apache.org/jira/browse/HDFS-4060 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4058) DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4058: - Summary: DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order Key: HDFS-4058 URL: https://issues.apache.org/jira/browse/HDFS-4058

[jira] [Created] (HDFS-4054) Increase the invalidation rate based on the pending deletion count

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4054: - Summary: Increase the invalidation rate based on the pending deletion count Key: HDFS-4054 URL: https://issues.apache.org/jira/browse/HDFS-4054 Project: Hadoop HDFS

Status of CheckpointNode and BackupNode

2012-10-15 Thread Eli Collins
Hey gang, Is anyone using the BackupNode and/or CheckpointNode? I'm not aware of anyone using them, and the only outstanding related jira is HDFS-2064, which has been open for over a year and doesn't seem to be making progress. For the past three years the code has only been maintained as part

[DISCUSS] Increasing the default block size

2012-10-15 Thread Eli Collins
Heads up - I filed HDFS-4053 to increase the default HDFS block size in trunk for v3. It's been 64mb forever, and most production clusters I'm aware of use a higher value, it's worth considering changing the default. Thanks, Eli

[jira] [Created] (HDFS-4053) Increase the default block size

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4053: - Summary: Increase the default block size Key: HDFS-4053 URL: https://issues.apache.org/jira/browse/HDFS-4053 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-4051) TestRBWBlockInvalidation.testBlockInvalidationWhenRBWReplicaMissedInDN failed

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4051: - Summary: TestRBWBlockInvalidation.testBlockInvalidationWhenRBWReplicaMissedInDN failed Key: HDFS-4051 URL: https://issues.apache.org/jira/browse/HDFS-4051 Project: Hadoop

[jira] [Created] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-10-12 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4047: - Summary: BPServiceActor has nested shouldRun loops Key: HDFS-4047 URL: https://issues.apache.org/jira/browse/HDFS-4047 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4035) LightWeightGSet and LightWeightHashSet increment a volatile without synchronization

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4035: - Summary: LightWeightGSet and LightWeightHashSet increment a volatile without synchronization Key: HDFS-4035 URL: https://issues.apache.org/jira/browse/HDFS-4035 Project

[jira] [Created] (HDFS-4034) Remove redundant null checks

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4034: - Summary: Remove redundant null checks Key: HDFS-4034 URL: https://issues.apache.org/jira/browse/HDFS-4034 Project: Hadoop HDFS Issue Type: Sub-task Affects

[jira] [Created] (HDFS-4033) Miscellaneous findbugs 2 fixes

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4033: - Summary: Miscellaneous findbugs 2 fixes Key: HDFS-4033 URL: https://issues.apache.org/jira/browse/HDFS-4033 Project: Hadoop HDFS Issue Type: Sub-task Affects

[jira] [Created] (HDFS-4032) Specify the charset explicitly rather than rely on the default

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4032: - Summary: Specify the charset explicitly rather than rely on the default Key: HDFS-4032 URL: https://issues.apache.org/jira/browse/HDFS-4032 Project: Hadoop HDFS

[jira] [Created] (HDFS-4031) Update findbugsExcludeFile.xml to reflect

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4031: - Summary: Update findbugsExcludeFile.xml to reflect Key: HDFS-4031 URL: https://issues.apache.org/jira/browse/HDFS-4031 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4030) BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4030: - Summary: BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs Key: HDFS-4030 URL: https://issues.apache.org/jira/browse/HDFS-4030

[jira] [Created] (HDFS-4029) GenerationStamp should use an AtomicLong

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4029: - Summary: GenerationStamp should use an AtomicLong Key: HDFS-4029 URL: https://issues.apache.org/jira/browse/HDFS-4029 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4027) NameNodeResourceChecker$CheckedVolume should provide more info when DF fails

2012-10-10 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4027: - Summary: NameNodeResourceChecker$CheckedVolume should provide more info when DF fails Key: HDFS-4027 URL: https://issues.apache.org/jira/browse/HDFS-4027 Project: Hadoop

[jira] [Created] (HDFS-4023) TestHAStateTransitions#testSecretManagerState failed

2012-10-09 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4023: - Summary: TestHAStateTransitions#testSecretManagerState failed Key: HDFS-4023 URL: https://issues.apache.org/jira/browse/HDFS-4023 Project: Hadoop HDFS Issue Type

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-10-08 Thread Eli Collins
On Mon, Oct 8, 2012 at 7:21 PM, Suresh Srinivas wrote: > On Mon, Oct 8, 2012 at 6:20 PM, Todd Lipcon wrote: > >> On Mon, Oct 8, 2012 at 6:01 PM, Suresh Srinivas > >wrote: >> >> > Todd, >> > >> > As I indicated in my comments on the jira, I think some of the design >> > discussions and further sim

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-10-08 Thread Eli Collins
Sanjay, Suresh, I don't think we should block the merge on discussion about parts of the design. It's great that you guys are coming up to speed on the design and have feedback. We're confident the feedback can be addressed in follow-on jiras (just as federation and HA have been iterated on after

[jira] [Created] (HDFS-4020) TestRBWBlockInvalidation may time out

2012-10-08 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4020: - Summary: TestRBWBlockInvalidation may time out Key: HDFS-4020 URL: https://issues.apache.org/jira/browse/HDFS-4020 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4018) TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup

2012-10-08 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4018: - Summary: TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup Key: HDFS-4018 URL: https://issues.apache.org/jira/browse/HDFS-4018

[jira] [Created] (HDFS-4014) Fix warnings found by findbugs2

2012-10-05 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4014: - Summary: Fix warnings found by findbugs2 Key: HDFS-4014 URL: https://issues.apache.org/jira/browse/HDFS-4014 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-4008) TestBalancerWithEncryptedTransfer needs a timeout

2012-10-05 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4008: - Summary: TestBalancerWithEncryptedTransfer needs a timeout Key: HDFS-4008 URL: https://issues.apache.org/jira/browse/HDFS-4008 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4006) TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit

2012-10-04 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4006: - Summary: TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit Key: HDFS-4006 URL: https://issues.apache.org/jira/browse/HDFS-4006

[jira] [Resolved] (HDFS-3910) DFSTestUtil#waitReplication should timeout

2012-10-04 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3910. --- Resolution: Fixed Fix Version/s: (was: 2.0.2-alpha) 2.0.3-alpha

[jira] [Created] (HDFS-4003) test-patch should build the common native libs before running hdfs tests

2012-10-03 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4003: - Summary: test-patch should build the common native libs before running hdfs tests Key: HDFS-4003 URL: https://issues.apache.org/jira/browse/HDFS-4003 Project: Hadoop HDFS

[jira] [Created] (HDFS-4001) TestSafeMode#testInitializeReplQueuesEarly may time out

2012-10-02 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4001: - Summary: TestSafeMode#testInitializeReplQueuesEarly may time out Key: HDFS-4001 URL: https://issues.apache.org/jira/browse/HDFS-4001 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4000) TestParallelLocalRead fails with "input ByteBuffers must be direct buffers"

2012-10-02 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4000: - Summary: TestParallelLocalRead fails with "input ByteBuffers must be direct buffers" Key: HDFS-4000 URL: https://issues.apache.org/jira/browse/HDFS-4000 Proje

[jira] [Created] (HDFS-3996) Add debug log removed in HDFS-3873 back

2012-10-02 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3996: - Summary: Add debug log removed in HDFS-3873 back Key: HDFS-3996 URL: https://issues.apache.org/jira/browse/HDFS-3996 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3989) Remove duplicate Http server SSL code

2012-09-27 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3989: - Summary: Remove duplicate Http server SSL code Key: HDFS-3989 URL: https://issues.apache.org/jira/browse/HDFS-3989 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

2012-09-27 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3985: - Summary: TestMulitipleNNDataBlockScanner may hang Key: HDFS-3985 URL: https://issues.apache.org/jira/browse/HDFS-3985 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3984) TestAuditLogs#testAuditWebHdfs flaky

2012-09-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3984: - Summary: TestAuditLogs#testAuditWebHdfs flaky Key: HDFS-3984 URL: https://issues.apache.org/jira/browse/HDFS-3984 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-3968) TestPersistBlocks seems to fail intermittently

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3968. --- Resolution: Duplicate Dupe of HDFS-3664. > TestPersistBlocks seems to f

[jira] [Resolved] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3931. --- Resolution: Fixed > TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is bro

[jira] [Reopened] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reopened HDFS-3931: --- > TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is bro

[jira] [Created] (HDFS-3983) Hftp should not use the https port

2012-09-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3983: - Summary: Hftp should not use the https port Key: HDFS-3983 URL: https://issues.apache.org/jira/browse/HDFS-3983 Project: Hadoop HDFS Issue Type: Bug Affects

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Eli Collins
On Wed, Sep 26, 2012 at 10:50 AM, Todd Lipcon wrote: > On Tue, Sep 25, 2012 at 11:21 PM, Konstantin Shvachko > wrote: >> I think this is a great work, Todd. >> And I think we should not merge it into trunk or other branches. >> As I suggested earlier on this list I think this should be spinned of

Re: Commits breaking compilation of MR 'classic' tests

2012-09-25 Thread Eli Collins
How about adding this step to the MR PreCommit jenkins job so it's run as part test-patch? On Tue, Sep 25, 2012 at 7:48 PM, Arun C Murthy wrote: > Committers, > > As most people are aware, the MapReduce 'classic' tests (in > hadoop-mapreduce-project/src/test) still need to built using ant since

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-25 Thread Eli Collins
+1 Awesome work Todd. On Tue, Sep 25, 2012 at 4:02 PM, Todd Lipcon wrote: > Dear fellow HDFS developers, > > Per my email thread last week ("Heads up: merge for QJM branch soon" > at http://markmail.org/message/vkyh5culdsuxdb6t) I would like to > propose merging the HDFS-3077 branch into trunk.

[jira] [Created] (HDFS-3964) Make NN log of fs.defaultFS debug rather than info

2012-09-20 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3964: - Summary: Make NN log of fs.defaultFS debug rather than info Key: HDFS-3964 URL: https://issues.apache.org/jira/browse/HDFS-3964 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3959) Jersey warnings due to WebHDFS binding "/"

2012-09-19 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3959: - Summary: Jersey warnings due to WebHDFS binding "/" Key: HDFS-3959 URL: https://issues.apache.org/jira/browse/HDFS-3959 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-3949) NameNodeRpcServer#join should join on both client and server RPC servers

2012-09-18 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3949: - Summary: NameNodeRpcServer#join should join on both client and server RPC servers Key: HDFS-3949 URL: https://issues.apache.org/jira/browse/HDFS-3949 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-2051) TestBlockRecovery.testErrorReplicas is timing out

2012-09-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2051. --- Resolution: Fixed No longer seeing this. > TestBlockRecovery.testErrorReplicas

[jira] [Created] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-09-18 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3948: - Summary: TestWebHDFS#testNamenodeRestart is racy Key: HDFS-3948 URL: https://issues.apache.org/jira/browse/HDFS-3948 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-3933) Unclean exit in ReplicationMonitor#run occasionally causes tests to fail

2012-09-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3933. --- Resolution: Duplicate Now that we can see the root cause, this is a dupe of HDFS-3936. {noformat

[jira] [Created] (HDFS-3946) Separate client and server uses of NN#getAddress

2012-09-17 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3946: - Summary: Separate client and server uses of NN#getAddress Key: HDFS-3946 URL: https://issues.apache.org/jira/browse/HDFS-3946 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3945) HDFS conf is loading MR and YARN config files

2012-09-17 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3945: - Summary: HDFS conf is loading MR and YARN config files Key: HDFS-3945 URL: https://issues.apache.org/jira/browse/HDFS-3945 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3940) Add Gset#clear method

2012-09-14 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3940: - Summary: Add Gset#clear method Key: HDFS-3940 URL: https://issues.apache.org/jira/browse/HDFS-3940 Project: Hadoop HDFS Issue Type: Improvement Affects

[jira] [Created] (HDFS-3939) Some NN#getNameNodeAddress cleanup

2012-09-14 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3939: - Summary: Some NN#getNameNodeAddress cleanup Key: HDFS-3939 URL: https://issues.apache.org/jira/browse/HDFS-3939 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-3937) The BlockManager should not use the FSN lock

2012-09-13 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3937: - Summary: The BlockManager should not use the FSN lock Key: HDFS-3937 URL: https://issues.apache.org/jira/browse/HDFS-3937 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-3936) MiniDFSCluster shutdown may fail due to BlocksMap#getBlockCollection NPE

2012-09-13 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3936: - Summary: MiniDFSCluster shutdown may fail due to BlocksMap#getBlockCollection NPE Key: HDFS-3936 URL: https://issues.apache.org/jira/browse/HDFS-3936 Project: Hadoop HDFS

[jira] [Created] (HDFS-3935) QJM: Add JournalNode to the start / stop scripts

2012-09-13 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3935: - Summary: QJM: Add JournalNode to the start / stop scripts Key: HDFS-3935 URL: https://issues.apache.org/jira/browse/HDFS-3935 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3933) Unclean exit in ReplicationMonitor#run occasionally causes tests to fail

2012-09-12 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3933: - Summary: Unclean exit in ReplicationMonitor#run occasionally causes tests to fail Key: HDFS-3933 URL: https://issues.apache.org/jira/browse/HDFS-3933 Project: Hadoop HDFS

[jira] [Created] (HDFS-3932) NameNode Web UI broken if the rpc-address is set to the wildcard

2012-09-12 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3932: - Summary: NameNode Web UI broken if the rpc-address is set to the wildcard Key: HDFS-3932 URL: https://issues.apache.org/jira/browse/HDFS-3932 Project: Hadoop HDFS

  1   2   3   4   5   6   7   >