Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-13 Thread Ramya Sunil
+1 (non binding) Deployed on a single node and a 20node cluster with security turned on and off. Ran Hadoop benchmarks, a few end-end tests and functional tests covering distributed cache, capacity scheduler, decommissioning etc Also ran end-end tests on Pig 0.9.x and a few system tests on Hbase 0

[jira] [Created] (HADOOP-7748) Print exception message when failed to move to trash.

2011-10-13 Thread Liyin Liang (Created) (JIRA)
Print exception message when failed to move to trash. -- Key: HADOOP-7748 URL: https://issues.apache.org/jira/browse/HADOOP-7748 Project: Hadoop Common Issue Type: Bug Affects Versions

Web crawler on hadoop becomes unresponsive

2011-10-13 Thread Aishwarya Venkataraman
Hello, I trying to make my web crawling go faster with hadoop. My mapper just consists of a few lines and my reducer is an IdentityReducer while read line;do #result="`wget -O - --timeout=500 http://$line 2>&1`" echo $result done I am crawling about 50,000 sites. But my mapper always seems t

Re: Web Crawler in hadoop - Unresponsive after a while

2011-10-13 Thread Aishwarya Venkataraman
Thanks Otis, I will check that out. On Thu, Oct 13, 2011 at 7:03 PM, Otis Gospodnetic < otis_gospodne...@yahoo.com> wrote: > Aishwarya, you should probably ask on the -user list. > Moreover, you should probably just look at and use Nutch, which uses MR > under the hood for fetching and other task

Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-13 Thread Eric Yang
+1 (non-binding) Exercised Hadoop 0.20.205 with HBase 0.90.4+, Pig 0.9.1+, Chukwa trunk on 20 nodes clusters, works fine. regards, Eric On Oct 13, 2011, at 5:46 PM, Aaron T. Myers wrote: > +1 (non-binding) > > I downloaded the tar ball and deployed on a 6 node cluster with security > disabled

Re: Web Crawler in hadoop - Unresponsive after a while

2011-10-13 Thread Otis Gospodnetic
Aishwarya, you should probably ask on the -user list. Moreover, you should probably just look at and use Nutch, which uses MR under the hood for fetching and other tasks - see http://nutch.apache.org/ Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Hadoop - HBase Hadoop ecosystem se

Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-13 Thread Mahadev Konar
+1. Downloaded the bits, set up a single node cluster and ran example jobs. Works fine. thanks mahadev On Thu, Oct 13, 2011 at 5:46 PM, Aaron T. Myers wrote: > +1 (non-binding) > > I downloaded the tar ball and deployed on a 6 node cluster with security > disabled. I put a few files and ran a fe

[jira] [Resolved] (HADOOP-7509) Improve message when Authentication is required

2011-10-13 Thread Ravi Prakash (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved HADOOP-7509. -- Resolution: Fixed Release Note: Thanks Aaron and Suresh! Marking as resolved fixed since

Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-13 Thread Aaron T. Myers
+1 (non-binding) I downloaded the tar ball and deployed on a 6 node cluster with security disabled. I put a few files and ran a few MR jobs, mostly to calculate the value of Pi. All worked fine. Curiously, the estimated value of Pi was once determined to be "4.", but I suspect

[jira] [Created] (HADOOP-7747) reloginFromKeytab in UGI should use checkTGTAndReloginFromKeytab

2011-10-13 Thread Jitendra Nath Pandey (Created) (JIRA)
reloginFromKeytab in UGI should use checkTGTAndReloginFromKeytab - Key: HADOOP-7747 URL: https://issues.apache.org/jira/browse/HADOOP-7747 Project: Hadoop Common Issue Type: Bu

Web Crawler in hadoop - Unresponsive after a while

2011-10-13 Thread Aishwarya Venkataraman
Hello, I trying to make my web crawling go faster with hadoop. My mapper just consists of a single line and my reducer is an IdentityReducer while read line;do #result="`wget -O - --timeout=500 http://$line 2>&1`" echo $result done I am crawling about 50,000 sites. But my mapper always seems

Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-13 Thread Arun C Murthy
+1 Downloaded release, verified checksums and ran a single node cluster. Arun On Oct 7, 2011, at 5:10 PM, Matt Foley wrote: > Many thanks to the community members who tried out RC1, and found several > critical or blocker bugs. > These have been resolved and I have now posted RC2 at > http://p

Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-13 Thread Tom White
+1 Checksums and signatures were OK. I also ran an API compatibility check (https://issues.apache.org/jira/browse/HADOOP-7035, https://github.com/tomwhite/hadoop-compatibility-tools) and it passed. There were three errors, all false positives: Class org.apache.hadoop.fs.HarFileSystem "E1.2 - A

[jira] [Created] (HADOOP-7746) RunJar doesn't consider hadoop.tmp.dir argument

2011-10-13 Thread Konstantin Pelykh (Created) (JIRA)
RunJar doesn't consider hadoop.tmp.dir argument --- Key: HADOOP-7746 URL: https://issues.apache.org/jira/browse/HADOOP-7746 Project: Hadoop Common Issue Type: Bug Components: util Aff

Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-13 Thread Matt Foley
Hello, The 7-day vote on 0.20.205.0-rc2 is closing tomorrow. Very few people have voted. Please consider trying and voting on this release candidate. Thank you. Best regards, --Matt (RM) On Fri, Oct 7, 2011 at 5:10 PM, Matt Foley wrote: > Many thanks to the community members who tried out RC1

[jira] [Created] (HADOOP-7745) I switched variable names in HADOOP-7509

2011-10-13 Thread Ravi Prakash (Created) (JIRA)
I switched variable names in HADOOP-7509 Key: HADOOP-7745 URL: https://issues.apache.org/jira/browse/HADOOP-7745 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.24.0 Reporte

[jira] [Reopened] (HADOOP-7509) Improve message when Authentication is required

2011-10-13 Thread Ravi Prakash (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reopened HADOOP-7509: -- Switched between CommonConfigurationKeys.HADOOP_SECURITY_AUTHENTICATION and CommonConfigurationKe

[jira] [Created] (HADOOP-7744) Incorrect exit code for hadoop-core-test tests when exception thrown

2011-10-13 Thread Jonathan Eagles (Created) (JIRA)
Incorrect exit code for hadoop-core-test tests when exception thrown Key: HADOOP-7744 URL: https://issues.apache.org/jira/browse/HADOOP-7744 Project: Hadoop Common Issue Ty

[jira] [Created] (HADOOP-7743) Add Maven profile to create a full source tarball

2011-10-13 Thread Alejandro Abdelnur (Created) (JIRA)
Add Maven profile to create a full source tarball - Key: HADOOP-7743 URL: https://issues.apache.org/jira/browse/HADOOP-7743 Project: Hadoop Common Issue Type: Improvement Components:

[jira] [Created] (HADOOP-7742) Evolve metrics2 in 0.23 and trunk to allow coexistence with 0.20-security releases

2011-10-13 Thread Luke Lu (Created) (JIRA)
Evolve metrics2 in 0.23 and trunk to allow coexistence with 0.20-security releases -- Key: HADOOP-7742 URL: https://issues.apache.org/jira/browse/HADOOP-7742 Project: Had

[jira] [Created] (HADOOP-7741) Maven related JIRAs to backport to 0.23

2011-10-13 Thread Alejandro Abdelnur (Created) (JIRA)
Maven related JIRAs to backport to 0.23 --- Key: HADOOP-7741 URL: https://issues.apache.org/jira/browse/HADOOP-7741 Project: Hadoop Common Issue Type: Task Components: build Affects Versions:

Build failed in Jenkins: Hadoop-Common-trunk #195

2011-10-13 Thread Apache Jenkins Server
See Changes: [mahadev] HDFS-2401. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) [mahadev] MAPREDUCE-3133. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) [mahadev] H