Re: [VOTE] 0.20.205.0 Release Candidate 2

The vote has closed, with the following tally (including my own non-binding +1): +1 binding: 4 +1 non-binding: 6 -1 binding: 0 -1 non-binding: 0 The vote passes, ten to zero, with four PMC members voting in favor. We have a 0.20.205.0 release, with both security and append/hflush

Re: Publishing maven snapshots for 0.23?

Looks like recent snapshots have been pushed for common and hdfs, but not mapred/mapreduce: https://repository.apache.org/content/repositories/snapshots/org/apache/hado op/hadoop-mapred/0.23.0-SNAPSHOT/ https://repository.apache.org/content/repositories/snapshots/org/apache/hado op/hadoop-mapreduc

[jira] [Created] (HADOOP-7750) DataNode: Cannot start secure cluster without privileged resources | tags/release-0.20.205.0-rc2

DataNode: Cannot start secure cluster without privileged resources | tags/release-0.20.205.0-rc2 - Key: HADOOP-7750 URL: https://issues.apache.org/jira/browse/HADOOP-

Re: Publishing maven snapshots for 0.23?

Thanks Giri! mahadev On Fri, Oct 14, 2011 at 3:30 PM, giridharan kesavan wrote: > > Okay, I ve done the 0.23 commit setup. > Builds up and running for common/hdfs and Mapred > > https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/ > https://builds.apache.org/view/G-L/vie

[jira] [Resolved] (HADOOP-7655) provide a small validation script that smoke tests the installed cluster

[ https://issues.apache.org/jira/browse/HADOOP-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-7655. Resolution: Fixed Fix Version/s: 0.23.0 Release Note: Committed to trunk and v23, since

Re: Publishing maven snapshots for 0.23?

Okay, I ve done the 0.23 commit setup. Builds up and running for common/hdfs and Mapred https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Had

Re: Publishing maven snapshots for 0.23?

I've just uploaded a patch for MAPREDUCE-3003. What is left to test is to get HDFS/MR2 running for a build and run an example. I don't think I'll have a chance to do that test today. If somebody volunteers and does the run and +1 then it can be committed to trunk and on Monday or Tuesday we can

Re: Publishing maven snapshots for 0.23?

I was able to publish HDFS and Common, but couldn't publish MR/YARN due to: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-deploy-plugin:2.5:deploy (default-deploy) on project hadoop-yarn-api: Deployment failed: repository element was not specified in the POM inside distributionMana

Re: Publishing maven snapshots for 0.23?

+1, thanks Todd. On Oct 14, 2011, at 12:53 PM, Todd Lipcon wrote: > On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan > wrote: >> Todd, >> I like the idea of setting up commit builds for 23 branch; I can set this >> up. > > OK. Mind if I manually mvn deploy for now? Some HBase work is blocke

Re: Publishing maven snapshots for 0.23?

On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan wrote: > Todd, > I like the idea of setting up commit builds for 23 branch; I can set this > up. OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it. -Todd > > On 10/14/11 12:23 PM, Todd Lipcon wrote: >> >> Looks like

Re: Publishing maven snapshots for 0.23?

Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. -Giri On 10/14/11 12:23 PM, Todd Lipcon wrote: Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add "mvn deploy" to the Hadoop-*-0.23-Buil

Re: Publishing maven snapshots for 0.23?

Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add "mvn deploy" to the Hadoop-*-0.23-Build targets (which run nightly), or (b) add a cross-project "0.23-commit" build which is triggered on any commit to 0.23 and does a mvn de

Publishing maven snapshots for 0.23?

It seems that we're not publishing maven snapshots correctly. I'm not entirely sure why, but if you look at: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/ you'll see the latest snapshots are from 9/14 or so. Anyone have any idea what's going on here? -Tod

Re: 0.23 & trunk tars, we'll we publishing 1 tar per component or a single tar? What about source tar?

Other approach would be asking which tar to build. mapred-tar (mapred and common) hdfs-tar (hdfs and common) hadoop-tar (all) In this case, hbase can just use hdfs-tar. -Bharath From: Ravi Teja To: mapreduce-...@hadoop.apache.org; common-dev@hadoop.apache.org

Re: Web Crawler in hadoop - Unresponsive after a while

You would probably be happier using an industrial strength crawler. Check out Bixo. http://bixolabs.com/about/focused-crawler/ On Thu, Oct 13, 2011 at 5:13 PM, Aishwarya Venkataraman < avenk...@cs.ucsd.edu> wrote: > Hello, > > I trying to make my web crawling go faster with hadoop. My mapper

[jira] [Created] (HADOOP-7749) Add NetUtils call which provides more help in exception messages

Add NetUtils call which provides more help in exception messages Key: HADOOP-7749 URL: https://issues.apache.org/jira/browse/HADOOP-7749 Project: Hadoop Common Issue Type: Impr

Re: [VOTE] 0.20.205.0 Release Candidate 2

+1 (non binding) No blocking issues found in Yahoo QE regression testing. Performance testing showed no performance regression when compared with 204. Scott sb...@yahoo-inc.com On 10/12/11 12:18 PM, "Arpit Gupta" wrote: >Deployed to a cluster of 20 servers, with security and append features >

Build failed in Jenkins: Hadoop-Common-trunk #196

See Changes: [acmurthy] MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for containers. Contributed by John George. [jitendra] MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen. [acmurthy]