[jira] [Created] (HADOOP-8587) HarFileSystem access of harMetaCache isn't threadsafe

2012-07-10 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8587: --- Summary: HarFileSystem access of harMetaCache isn't threadsafe Key: HADOOP-8587 URL: https://issues.apache.org/jira/browse/HADOOP-8587 Project: Hadoop C

[jira] [Created] (HADOOP-8586) Fixup a bunch of SPNEGO misspellings

2012-07-10 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8586: --- Summary: Fixup a bunch of SPNEGO misspellings Key: HADOOP-8586 URL: https://issues.apache.org/jira/browse/HADOOP-8586 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-8584) test-patch.sh should not immediately exit when no tests are added or modified

2012-07-10 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8584. - Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed I've committed

[jira] [Resolved] (HADOOP-8554) KerberosAuthenticator should use the configured principal

2012-07-06 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8554. - Resolution: Invalid You're right, thanks for the explanation, I didn't realize the

[jira] [Created] (HADOOP-8568) DNS#reverseDns fails on IPv6 addresses

2012-07-05 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8568: --- Summary: DNS#reverseDns fails on IPv6 addresses Key: HADOOP-8568 URL: https://issues.apache.org/jira/browse/HADOOP-8568 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-8565) AuthenticationFilter#doFilter warns unconditionally when using SPNEGO

2012-07-05 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8565: --- Summary: AuthenticationFilter#doFilter warns unconditionally when using SPNEGO Key: HADOOP-8565 URL: https://issues.apache.org/jira/browse/HADOOP-8565 Project: Hadoop

[jira] [Created] (HADOOP-8554) KerberosAuthenticator should use the configured principal

2012-07-03 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8554: --- Summary: KerberosAuthenticator should use the configured principal Key: HADOOP-8554 URL: https://issues.apache.org/jira/browse/HADOOP-8554 Project: Hadoop Common

[jira] [Resolved] (HADOOP-8546) missing hdfs user guide and command pages from hadoop project page

2012-07-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8546. - Resolution: Duplicate Per HDFS-3458 the forest docs needed to be ported to APT

Re: Clarification about 2.* branches

2012-06-06 Thread Eli Collins
when we have dead branches lying around. > > Regarding 0.23.*, you are right, I was about to send a separate email > regarding those too. > > Thanks, > +Vinod > > > On Jun 6, 2012, at 2:10 PM, Eli Collins wrote: > >> Hey Vinod, >> >> Out of curiosity, w

Re: Clarification about 2.* branches

2012-06-06 Thread Eli Collins
On Wed, Jun 6, 2012 at 2:10 PM, Eli Collins wrote: > Hey Vinod, > > Out of curiosity, why delete the branch?  Might make spelunking for > svn revs that correspond to a release hard.  If we're deleting old > release branches might as well delete the others (branch-0.23.0,

Re: Clarification about 2.* branches

2012-06-06 Thread Eli Collins
Hey Vinod, Out of curiosity, why delete the branch? Might make spelunking for svn revs that correspond to a release hard. If we're deleting old release branches might as well delete the others (branch-0.23.0, branch-0.23.0-rc0, branch-0.23.1, branch-0.23.2, etc) as well? Thanks, Eli On Wed, Ju

Re: Clarification about 2.* branches

2012-06-05 Thread Eli Collins
Hey Vinod, fyi I updated CHANGES.txt yesterday to reflect the 2.0.0-alpha release on trunk and branch-2. branch-2.0.0-alpha was just the release branch Arun used for 2.0.0-alpha, we'll create a new branch (2.0.1-alpha) for the next release. Thanks, Eli On Tue, Jun 5, 2012 at 4:40 PM, Vinod Kuma

Hadoop view on Jenkins

2012-06-04 Thread Eli Collins
Hey gang, fyi, I created a view in jenkins so you can see all the enabled Hadoop builds: https://builds.apache.org/view/Hadoop Thanks, Eli

[jira] [Resolved] (HADOOP-8430) Backport new FileSystem methods introduced by HADOOP-8014 to branch-1

2012-06-04 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8430. - Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0) Thanks

[jira] [Created] (HADOOP-8463) hadoop.security.auth_to_local needs a key definition and doc

2012-05-31 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8463: --- Summary: hadoop.security.auth_to_local needs a key definition and doc Key: HADOOP-8463 URL: https://issues.apache.org/jira/browse/HADOOP-8463 Project: Hadoop Common

[jira] [Created] (HADOOP-8431) Running distcp wo args throws IllegalArgumentException

2012-05-23 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8431: --- Summary: Running distcp wo args throws IllegalArgumentException Key: HADOOP-8431 URL: https://issues.apache.org/jira/browse/HADOOP-8431 Project: Hadoop Common

[jira] [Created] (HADOOP-8430) Backport new FileSystem methods introduced by HADOOP-8014 to branch-1

2012-05-23 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8430: --- Summary: Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 Key: HADOOP-8430 URL: https://issues.apache.org/jira/browse/HADOOP-8430 Project: Hadoop

[jira] [Created] (HADOOP-8427) Convert Forrest docs to APT

2012-05-23 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8427: --- Summary: Convert Forrest docs to APT Key: HADOOP-8427 URL: https://issues.apache.org/jira/browse/HADOOP-8427 Project: Hadoop Common Issue Type: Task

Re: cmake

2012-05-23 Thread Eli Collins
On Wed, May 23, 2012 at 8:58 AM, Owen O'Malley wrote: > After a quick look at cmake, it seems reasonable. Please use feature tests > rather than OS tests. (By that I mean that if Solaris needs "foobar.h" and > RHEL needs "sys/foobar.h" to get the definition for foobar, the code should > ifdef whet

Re: cmake

2012-05-21 Thread Eli Collins
+1 having a build tool that supports multiple platforms is worth the dependency. I've also had good experiences with cmake. On Mon, May 21, 2012 at 6:00 PM, Colin McCabe wrote: > Hi all, > > We'd like to use CMake instead of autotools to build native (C/C++) code in > Hadoop.  There are a lot

[jira] [Created] (HADOOP-8422) FileSystem#getDefaultBlockSize

2012-05-21 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8422: --- Summary: FileSystem#getDefaultBlockSize Key: HADOOP-8422 URL: https://issues.apache.org/jira/browse/HADOOP-8422 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-7069) Replace forrest with supported framework

2012-05-21 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7069. - Resolution: Fixed Fix Version/s: (was: 0.24.0) 2.0.0

Re: [VOTE - RELEASE PLAN] create branch-1.1 and make release candidate 1.1.0

2012-05-17 Thread Eli Collins
+1 Thanks Matt On Thu, May 17, 2012 at 6:52 PM, Matt Foley wrote: > Hi all, > I would like to branch "branch-1.1" from the current HEAD of branch-1, > and proceed to make a release candidate for hadoop-1.1.0 from it. > I'm also hereby offering to be Release Manager for branch-1.1, as I have > b

[jira] [Created] (HADOOP-8407) packaging templates duplicates the conf directories

2012-05-17 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8407: --- Summary: packaging templates duplicates the conf directories Key: HADOOP-8407 URL: https://issues.apache.org/jira/browse/HADOOP-8407 Project: Hadoop Common

Common/Hdfs trunk Jenkins jobs should be blue now

2012-05-16 Thread Eli Collins
Hey gang, Just a heads up.. all the "Result = FAILURE" messages that jenkins comments on jira when patches get merged should be fixed now. These were due to the Hadoop-Common-trunk and Hadoop-Hdfs-trunk jobs failing due to being misconfigured. I configured them to just build, so only the precomm

[jira] [Resolved] (HADOOP-8404) etc/hadoop in binary tarball missing hadoop-env.sh

2012-05-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8404. - Resolution: Duplicate Dupe of HADOOP-8287 > etc/hadoop in binary tarb

[jira] [Created] (HADOOP-8400) All commands warn "Kerberos krb5 configuration not found" when security is not enabled

2012-05-15 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8400: --- Summary: All commands warn "Kerberos krb5 configuration not found" when security is not enabled Key: HADOOP-8400 URL: https://issues.apache.org/jira/browse/H

[jira] [Created] (HADOOP-8398) Cleanup BlockLocation

2012-05-13 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8398: --- Summary: Cleanup BlockLocation Key: HADOOP-8398 URL: https://issues.apache.org/jira/browse/HADOOP-8398 Project: Hadoop Common Issue Type: Improvement

[jira] [Resolved] (HADOOP-8224) Don't hardcode hdfs.audit.logger in the scripts

2012-05-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8224. - Resolution: Fixed Fix Version/s: 2.0.0 Hadoop Flags: Reviewed I've committed

[jira] [Created] (HADOOP-8392) Add YARN audit logging to log4j.properties

2012-05-11 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8392: --- Summary: Add YARN audit logging to log4j.properties Key: HADOOP-8392 URL: https://issues.apache.org/jira/browse/HADOOP-8392 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-8391) Hadoop-auth should use log4j

2012-05-11 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8391: --- Summary: Hadoop-auth should use log4j Key: HADOOP-8391 URL: https://issues.apache.org/jira/browse/HADOOP-8391 Project: Hadoop Common Issue Type: Improvement

Re: Test failures in TestFileSystemCanonicalization

2012-05-10 Thread Eli Collins
f course, look > into the cause/fix as time allows. > > On Wed, May 9, 2012 at 9:42 PM, Eli Collins wrote: >> Do you get the same failure with JDK6? >> >> On Wednesday, May 9, 2012, Trevor Robinson wrote: >> >>> Does anyone know anything about these test fa

Re: Test failures in TestFileSystemCanonicalization

2012-05-09 Thread Eli Collins
Do you get the same failure with JDK6? On Wednesday, May 9, 2012, Trevor Robinson wrote: > Does anyone know anything about these test failures in 0.23.1 > (+cdh4b2) and trunk? > > Failed tests: > testShortAuthority(org.apache.hadoop.fs.TestFileSystemCanonicalization): > expected: but was: > tes

[jira] [Resolved] (HADOOP-8348) Server$Listener.getAddress(..) may throw NullPointerException

2012-05-07 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8348. - Resolution: Duplicate This is a dupe of HDFS-3328. > Ser

[jira] [Created] (HADOOP-8365) Provide ability to disable working sync

2012-05-07 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8365: --- Summary: Provide ability to disable working sync Key: HADOOP-8365 URL: https://issues.apache.org/jira/browse/HADOOP-8365 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-8207) createproxy() in TestHealthMonitor is throwing NPE

2012-04-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8207. - Resolution: Duplicate > createproxy() in TestHealthMonitor is throwing

[jira] [Resolved] (HADOOP-8230) Enable sync by default and disable append

2012-04-27 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8230. - Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0

Re: Java 7 and Hadoop

2012-04-26 Thread Eli Collins
On Thu, Apr 26, 2012 at 2:03 PM, Scott Carey wrote: > Java 7 update 4 has been released.  It is even available for MacOS X from > Oracle: > http://www.oracle.com/technetwork/java/javase/downloads/jdk-7u4-downloads-1591156.html > > Java 6 will reach end of life in about 6 months.   After that poin

Re: Java 7 and Hadoop

2012-04-26 Thread Eli Collins
Hey Scott, Nice. Please update this page with your experience when you get a chance: http://wiki.apache.org/hadoop/HadoopJavaVersions Thanks, Eli On Thu, Apr 26, 2012 at 2:03 PM, Scott Carey wrote: > Java 7 update 4 has been released.  It is even available for MacOS X from > Oracle: > http:/

[jira] [Created] (HADOOP-8316) Audit logging should be disabled by default

2012-04-25 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8316: --- Summary: Audit logging should be disabled by default Key: HADOOP-8316 URL: https://issues.apache.org/jira/browse/HADOOP-8316 Project: Hadoop Common Issue Type

Re: Hadoop-1.0.3 and 1.1 release / code freeze proposals

2012-04-24 Thread Eli Collins
On Fri, Apr 20, 2012 at 6:02 PM, Matt Foley wrote: > Hi all, > a couple major bugs have shown up in Hadoop-1.0.2.  I propose to make a > 1.0.3 release containing fixes for: >  - MAPREDUCE-4154 > streaming > MR job succeeds even if the streamin

[jira] [Created] (HADOOP-8299) ViewFs doesn't work with a slash mount point

2012-04-20 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8299: --- Summary: ViewFs doesn't work with a slash mount point Key: HADOOP-8299 URL: https://issues.apache.org/jira/browse/HADOOP-8299 Project: Hadoop Common

[jira] [Created] (HADOOP-8298) ViewFs merge mounts

2012-04-20 Thread Eli Collins (JIRA)
Eli Collins created HADOOP-8298: --- Summary: ViewFs merge mounts Key: HADOOP-8298 URL: https://issues.apache.org/jira/browse/HADOOP-8298 Project: Hadoop Common Issue Type: New Feature

[jira] [Created] (HADOOP-8287) etc/hadoop is missing hadoop-env.sh

2012-04-16 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins The etc/hadoop directory in the tarball is missing hadoop-env.sh. It should be copied over like the other files in share/hadoop/common/templates/conf. Noticed templates/conf also contains mapred-site.xml and taskcontroller.cfg, we should remove those while we&#x

[jira] [Resolved] (HADOOP-8209) Add option to relax build-version check for branch-1

2012-04-12 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8209. - Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0

[jira] [Reopened] (HADOOP-8273) PowerPc missing dependency of commons-daemon-1.0.2-bin-linux-ppc64.tar.gz

2012-04-12 Thread Eli Collins (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reopened HADOOP-8273: - > PowerPc missing dependency of commons-daemon-1.0.2-bin-linux-ppc64.tar

[jira] [Resolved] (HADOOP-8269) Fix some javadoc warnings on branch-1

2012-04-11 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8269. - Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0

[jira] [Created] (HADOOP-8269) Fix some javadoc warnings on branch-1

2012-04-11 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins Assignee: Eli Collins Attachments: hadoop-8269.txt There are some javadoc warnings on branch-1, let's fix them. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators:

Re: Requirements for patch review

2012-04-04 Thread Eli Collins
On Wed, Apr 4, 2012 at 2:12 PM, Todd Lipcon wrote: > Hi folks, > > Some discussion between Nicholas, Aaron, and me started in the > comments of HDFS-3168 which I think is better exposed on the mailing > list instead of trailing an already-committed JIRA. > > The question at hand is what the policy

[jira] [Created] (HADOOP-8238) NetUtils#getHostNameOfIP blows up if given ip:port string w/o port

2012-04-01 Thread Eli Collins (Created) (JIRA)
: Bug Reporter: Eli Collins Assignee: Eli Collins NetUtils#getHostNameOfIP blows up if not given a string of form ip:port, because the regex matches the port optionally but the code requires a semicolon. It also doesn't check the given string for null. -- This messa

Re: Build failed in Jenkins: Hadoop-Common-trunk #364

2012-04-01 Thread Eli Collins
2 at 2:21 AM, Apache Jenkins Server wrote: > See <https://builds.apache.org/job/Hadoop-Common-trunk/364/changes> > > Changes: > > [eli] HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by > Eli Collins > > [eli] HADOOP-8211. Update common

[jira] [Created] (HADOOP-8237) HADOOP-8159 causes TestJobInProgress#testLocality to fail

2012-03-30 Thread Eli Collins (Created) (JIRA)
Versions: 1.1.0 Reporter: Eli Collins Assignee: Colin Patrick McCabe The following in TestJobInProgress#testLocality: {code} Node r2n4 = new NodeBase("/default/rack2/s1/node4"); nt.add(r2n4); {code} violates the check introduced by HADOOP-8159: {noformat

[jira] [Resolved] (HADOOP-8222) bin/hadoop should allow callers to set jsvc pidfile even when not-detached

2012-03-29 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8222. - Resolution: Not A Problem This doesn't apply to branch-1 or branch-2.

[jira] [Created] (HADOOP-8230) Enable sync by default and disable append

2012-03-29 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins Assignee: Eli Collins Per HDFS-3120 for 1.x let's: - Always enable the sync path, which is currently only enabled if dfs.support.append is set - Remove the dfs.support.append configuration option. We'll keep the code paths though in case we ever fix

[jira] [Resolved] (HADOOP-5640) Allow ServicePlugins to hook callbacks into key service events

2012-03-29 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-5640. - Resolution: Won't Fix > Allow ServicePlugins to hook callbacks into key servic

[jira] [Resolved] (HADOOP-6757) NullPointerException for hadoop clients launched from streaming tasks

2012-03-29 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-6757. - Resolution: Fixed I think this is fixed in branch-1, and is not relevant to other releases

[jira] [Created] (HADOOP-8224) Don't hardcode hdfs.audit.logger in the scripts

2012-03-29 Thread Eli Collins (Created) (JIRA)
nents: conf Affects Versions: 2.0.0 Reporter: Eli Collins The HADOOP_*OPTS defined for HDFS in hadoop-env.sh hard-code the hdfs.audit.logger (is explicitly set via "-Dhdfs.audit.logger=INFO,RFAAUDIT") so it's not overridable. Let's allow someone to overr

Re: [RESULT] - [VOTE] Rename hadoop branches post hadoop-1.x

2012-03-29 Thread Eli Collins
On Thu, Mar 29, 2012 at 8:00 AM, Owen O'Malley wrote: > On Wed, Mar 28, 2012 at 5:11 PM, Doug Cutting wrote: > >> On 03/28/2012 12:39 PM, Owen O'Malley wrote: >> > [ ... ] So the RM of the 2 branch needs to make the call of what >> > should be 2.1 vs 3.0. >> >> I thought these were community deci

Re: Regarding HDFS-234 (Integration with BookKeeper logging system)

2012-03-29 Thread Eli Collins
Hi Uma, I don't think anyone is planning on merging it. If you want to try it out and merge it, go for it. Thanks, Eli On Thu, Mar 29, 2012 at 2:16 AM, Uma Maheswara Rao G wrote: > Hi Todd, Aaron, Suresh, > >  Are we going to merge this JIRA into 23 version? > > > Regards, > Uma > > > _

[jira] [Created] (HADOOP-8211) Update commons-net version to 3.1

2012-03-25 Thread Eli Collins (Created) (JIRA)
Update commons-net version to 3.1 - Key: HADOOP-8211 URL: https://issues.apache.org/jira/browse/HADOOP-8211 Project: Hadoop Common Issue Type: Sub-task Reporter: Eli Collins Assignee

[jira] [Created] (HADOOP-8210) Common side of HDFS-3148

2012-03-25 Thread Eli Collins (Created) (JIRA)
Common side of HDFS-3148 Key: HADOOP-8210 URL: https://issues.apache.org/jira/browse/HADOOP-8210 Project: Hadoop Common Issue Type: Sub-task Reporter: Eli Collins Assignee: Eli Collins

[jira] [Created] (HADOOP-8209) Add option to enable DN and TT rolling upgrades in branch-1

2012-03-25 Thread Eli Collins (Created) (JIRA)
Affects Versions: 1.0.0 Reporter: Eli Collins Assignee: Eli Collins In 1.x DNs currently refuse to connect to NNs if their build *revision* (ie svn revision) do not match. TTs refuse to connect to JTs if their build *version* (version, revision, user, and source

Re: Proto files

2012-03-24 Thread Eli Collins
Good idea, no reason we shouldn't, the build probably wasn't updated to include the who we added then. File a jira? On Saturday, March 24, 2012, Ralph Castain wrote: > Hi folks > > I notice that the .proto files are not present in the built tarball. This presents a problem to those of us working

Heads up wrt last upgrade-able version on 0.23

2012-03-23 Thread Eli Collins
Hey gang, I filed HDFS-3137 so that the 0.23 releases would only support upgrades from Hadoop version 0.18 or later. People on versions before 0.18 (don't think there are many, if any, people running these) would have to upgrade to a version like 1.0 and then upgrade again from there if they want

[jira] [Created] (HADOOP-8200) Remove HADOOP_[JOBTRACKER|TASKTRACKER]_OPTS

2012-03-22 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins Assignee: Eli Collins Priority: Minor Attachments: hadoop-8200.txt The HADOOP_[JOBTRACKER|TASKTRACKER]_OPTS env variables are no longer in trunk/23 since there's no MR1 implementation and the tests don't use them. This makes

[jira] [Created] (HADOOP-8198) Support multiple network interfaces

2012-03-21 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins Assignee: Eli Collins Hadoop does not currently utilize multiple network interfaces, which is a common user request, and important in enterprise environments. This jira covers a proposal for enhancements to Hadoop so it better utilizes multiple network

[jira] [Created] (HADOOP-8195) Backport FileContext to branch-1

2012-03-20 Thread Eli Collins (Created) (JIRA)
Backport FileContext to branch-1 Key: HADOOP-8195 URL: https://issues.apache.org/jira/browse/HADOOP-8195 Project: Hadoop Common Issue Type: New Feature Components: fs Reporter: Eli

Re: GSoC benefits

2012-03-20 Thread Eli Collins
> even required? You could get a big win even on a multi-core system (the tests themselves don't effectively use multiple cores, so running multiple tests in parallel would give you a speedup even on a laptop (if you have sufficient memory). Thanks, Eli > > Good Day, > qballer &

Re: GSoC benefits

2012-03-19 Thread Eli Collins
Hey Doron, These links are a good starting point: http://wiki.apache.org/hadoop/HowToContribute http://wiki.apache.org/hadoop/ProjectSuggestions http://wiki.apache.org/hadoop/HadoopResearchProjects I'd also checkout unresolved new features in jira. This query is a starting point. You can edit th

Re: Release with PB and HA

2012-03-17 Thread Eli Collins
ot of effort trying to make them > compatible. > > This work should be wrapped up in a few weeks. > Hey Suresh, How's this working going? What jiras track it? Thanks, Eli > Regards, > Suresh > > On Fri, Mar 9, 2012 at 10:11 AM, Eli Collins wrote: > >> Hey gan

Re: [PLAN] Freeze date, Hadoop 1.0.2 RC

2012-03-14 Thread Eli Collins
On Wed, Mar 14, 2012 at 4:41 PM, Suresh Srinivas wrote: > Matt, > > HADOOP-4855/HDFS-3075 adds capability to restore failed storage directories > on the namenode. This helps > in not having to restart the Namenode for flaky NFS storage directories and > improves operability. It has already been co

[jira] [Created] (HADOOP-8162) Hadoop 1.0 has duplicate and conflicting conf directories

2012-03-12 Thread Eli Collins (Created) (JIRA)
Components: conf Affects Versions: 1.0.0 Reporter: Eli Collins In branch-1 and friends conf/* differs quite a bit from src/packages/templates/conf*. Eg log4j.properties is quite different. I don't think the package artifact needs different configuration settings, and HADOOP

Re: Release with PB and HA

2012-03-11 Thread Eli Collins
pend a lot of effort trying to make them > compatible. > Do all these changes have jiras with target version 0.23.3? Thanks, Eli > This work should be wrapped up in a few weeks. > > Regards, > Suresh > > On Fri, Mar 9, 2012 at 10:11 AM, Eli Collins wrote: > >&g

Release with PB and HA

2012-03-09 Thread Eli Collins
Hey gang, Now that branch-23 has PB and (almost) HA checked in, it would be good to get these out into the wild so more people can start kicking the tires. How about we cut a 23.3 release soon from branch-23? Or perhaps re-branch 23.2 if that's easier. Thanks, Eli

[jira] [Created] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

2012-03-08 Thread Eli Collins (Created) (JIRA)
Affects Versions: 0.24.0 Reporter: Eli Collins Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins: Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String -- This messa

[jira] [Created] (HADOOP-8156) Remove ability to specify a custom nameserver for an interface in DNS.java

2012-03-08 Thread Eli Collins (Created) (JIRA)
Issue Type: Improvement Components: conf Reporter: Eli Collins Assignee: Eli Collins A long time ago HADOOP-497 introduced the option to specify a specific nameserver to use when looking up the hostname of an interface specified in the config (eg by

[jira] [Created] (HADOOP-8154) DNS#getIPs shouldn't silently return the local host IP for bogus interface names

2012-03-08 Thread Eli Collins (Created) (JIRA)
adoop Common Issue Type: Bug Components: conf Reporter: Eli Collins Assignee: Eli Collins DNS#getIPs silently returns the local host IP for bogus interface names. In this case let's throw an UnknownHostException. This is technically an incompatbile

[jira] [Created] (HADOOP-8150) 23 release docs links are broken for MR and HDFS

2012-03-07 Thread Eli Collins (Created) (JIRA)
23 release docs links are broken for MR and HDFS - Key: HADOOP-8150 URL: https://issues.apache.org/jira/browse/HADOOP-8150 Project: Hadoop Common Issue Type: Bug Reporter: Eli

Re: Some s3n improvements to the 1.0 branch? Also, is there a 1.1.0 planned?

2012-03-05 Thread Eli Collins
Hey Jagane, You can target your patches against branch-1.0, and then mark them with fixVersion 1.0.2 if you'd like the RM to pull them in for the next dot release. Thanks, Eli On Mon, Mar 5, 2012 at 9:47 AM, Jagane Sundar wrote: > Hello All, > > I would like to make some enhancements to the s3

[jira] [Resolved] (HADOOP-8111) cannot see userlogs from the web

2012-02-26 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8111. - Resolution: Duplicate Dupe of MAPREDUCE-2920. MAPREDUCE-2415 broke this feature

[jira] [Created] (HADOOP-8105) HADOOP-8013 breaks the Hive 0.8 tests

2012-02-22 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins Priority: Blocker The FilterFileSystem javadoc says "The class FilterFileSystem itself simply overrides all methods of FileSystem with versions that pass all requests to the contained file system." initialize(URI, Configuration) is p

[jira] [Created] (HADOOP-8075) Lower native-hadoop library log from info to debug

2012-02-15 Thread Eli Collins (Created) (JIRA)
Components: native Affects Versions: 0.23.0 Reporter: Eli Collins The following log shows up in all commands. It's useful to have it in the server log, but let's figure out a way so that it isn't logged eg every time you cat a file. {noformat} [eli@centos6 ~]$ hadoop fs

[jira] [Created] (HADOOP-8074) Small bug in hadoop error message for unknown commands

2012-02-14 Thread Eli Collins (Created) (JIRA)
Components: scripts Affects Versions: 0.24.0 Reporter: Eli Collins Assignee: Colin Patrick McCabe Priority: Trivial Fix For: 0.23.2 The hadoop fs command should be more user friendly if the user forgets the dash before the command. Also, this should say

[jira] [Created] (HADOOP-8041) HA: log a warning when a failover is first attempted

2012-02-08 Thread Eli Collins (Created) (JIRA)
Components: ha Affects Versions: HA Branch (HDFS-1623) Reporter: Eli Collins Currently we always warn for each client operation made to a NN we've failed over to: {noformat} hadoop-0.24.0-SNAPSHOT $ ./bin/hdfs dfs -lsr / 12/02/08 17:43:04 WARN retry.RetryInvocationHandler: Exce

[jira] [Created] (HADOOP-8040) Add symlink support to FileSystem

2012-02-08 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins Assignee: Eli Collins HADOOP-6421 added symbolic links to FileContext. Resolving symlinks is done on the client-side, and therefore requires client support. An HDFS symlink (created by FileContext) when accessed by FileSystem will result in an

[jira] [Created] (HADOOP-8036) TestViewFsTrash assumes the user's home directory is 2 levels deep

2012-02-07 Thread Eli Collins (Created) (JIRA)
Type: Bug Components: test Affects Versions: 0.23.0 Reporter: Eli Collins Looks like HADOOP-7974 didn't fix the issue. Still get "Path /var already exists as dir; cannot create link here Stacktrace" when running on jenkins with home dir /var/lib

[jira] [Created] (HADOOP-8034) Add comment/docs to enable assertions in hadoop-env.sh

2012-02-07 Thread Eli Collins (Created) (JIRA)
Components: conf Affects Versions: 1.0.0, 0.23.0 Reporter: Eli Collins Assignee: Eli Collins For testing it's useful to enable jvm assertions. Let's add a commented out line to hadoop-env.sh that sets the "-enableassertions" and "-enablesyst

[jira] [Created] (HADOOP-8033) HADOOP_JAVA_PLATFORM_OPS is no longer respected

2012-02-07 Thread Eli Collins (Created) (JIRA)
: conf Affects Versions: 0.23.0, 0.22.0 Reporter: Eli Collins Priority: Minor HADOOP-6284 introduced HADOOP_JAVA_PLATFORM_OPS and it's in branch-1, however it's not in trunk or 22, 23. It's referenced in hadoop-env.sh (commented out) but not actually use

[jira] [Resolved] (HADOOP-7958) HA: failover should error out if either host is not specified in the configs

2012-02-03 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7958. - Resolution: Duplicate > HA: failover should error out if either host is not specified

[jira] [Created] (HADOOP-8008) Document how to change the default loglevels

2012-01-30 Thread Eli Collins (Created) (JIRA)
: documentation Reporter: Eli Collins The hadoop.root.logger defined in log4j.properties is only used by applications. The scripts (bin and daemons) always set it to HADOOP_ROOT_LOGGER or "INFO,console" so the installed log4j.properties appears to be ignored. The wiki doesn't c

[jira] [Resolved] (HADOOP-7570) hadoop-config.sh needs to be updated post MR2

2012-01-30 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7570. - Resolution: Fixed Like HADOOP-7571 looks like this was fixed in the maven reorg

[jira] [Resolved] (HADOOP-7938) HA: the FailoverController should optionally fence the active during failover

2012-01-30 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7938. - Resolution: Fixed Hadoop Flags: Reviewed Fixed the nit and committed. Thanks for the

[jira] [Resolved] (HADOOP-7983) HA: failover should be able to pass args to fencers

2012-01-30 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7983. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Todd. I filed HADOOP-8007 and committed

[jira] [Created] (HADOOP-8007) HA: use substitution token for fencing argument

2012-01-30 Thread Eli Collins (Created) (JIRA)
Affects Versions: HA Branch (HDFS-1623) Reporter: Eli Collins Assignee: Eli Collins Per HADOOP-7983 currently the fencer always passes the target host:port to fence as the first argument to the fence script, it would be better to use a substitution token. That is to say

[jira] [Resolved] (HADOOP-6844) Update docs to reflect new jar names

2012-01-26 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-6844. - Resolution: Duplicate HADOOP-7247 duped this. > Update docs to reflect new

[jira] [Created] (HADOOP-7991) HA: the FailoverController should check the standby is ready before failing over

2012-01-24 Thread Eli Collins (Created) (JIRA)
Common Issue Type: Sub-task Components: ha Affects Versions: HA Branch (HDFS-1623) Reporter: Eli Collins Assignee: Eli Collins The FC in preFailoverChecks should check that the target service is ready for failover (eg in the case of HDFS, that it&#

[jira] [Resolved] (HADOOP-7571) hadoop-config.sh needs to be updated post mavenization

2012-01-24 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7571. - Resolution: Fixed Looks like this was fixed. > hadoop-config.sh needs to

[jira] [Created] (HADOOP-7984) Add hadoop command verbose and debug options

2012-01-19 Thread Eli Collins (Created) (JIRA)
Reporter: Eli Collins Priority: Minor It would be helpful if bin/hadoop have verbose and debug flags. Currently users need to set an env variable or prefix the command (eg "HADOOP_ROOT_LOGGER=DEBUG,console hadoop distcp") which isn't very user friendly. W

[jira] [Created] (HADOOP-7983) HA: failover should be able to pass args to fencers

2012-01-18 Thread Eli Collins (Created) (JIRA)
: ha Affects Versions: HA Branch (HDFS-1623) Reporter: Eli Collins Assignee: Eli Collins Currently fencing method args are passed in the config (eg "sshfence(host1,8022)" indicates to fence the service running on port 8022 on host1. The target service to fe

[jira] [Created] (HADOOP-7978) TestHostnameFilter should work with localhost or localhost.localdomain

2012-01-16 Thread Eli Collins (Created) (JIRA)
Issue Type: Test Components: fs, test Affects Versions: 0.23.0 Reporter: Eli Collins TestHostnameFilter may currently fail with the following: {noformat} Error Message null expected: but was: Stacktrace junit.framework.ComparisonFailure: null expected: but was

<    1   2   3   4   5   >