Build failed in Jenkins: Hadoop-Common-trunk #789
See https://builds.apache.org/job/Hadoop-Common-trunk/789/changes Changes: [vinodkv] YARN-755. Renamed AllocateResponse.reboot to AllocateResponse.resync. Contributed by Bikas Saha. [vinodkv] YARN-756. Move Preemption* records to yarn.api where they really belong. Contributed by Jian He. [vinodkv] YARN-635 and MAPREDUCE-5301. Bug fix as the committed patch ended up being stale. [vinodkv] YARN-635. Renamed YarnRemoteException to YarnException. Contributed by Siddharth Seth. MAPREDUCE-5301. Updated MR code to work with YARN-635 changes of renaming YarnRemoteException to YarnException. Contributed by Siddharth Seth [jlowe] MAPREDUCE-5283. Over 10 different tests have near identical implementations of AppContext. Committed by Sandy Ryza [vinodkv] YARN-757. Changed TestRMRestart to use the default scheduler to avoid test failures. Contributed by Bikas Saha. [suresh] HADOOP-9481. Move from trunk to release 2.1.0 section [jlowe] Move HADOOP-9287 in CHANGES.txt after committing to branch-2 [vinodkv] YARN-748. Moved BuilderUtils from yarn-common to yarn-server-common for eventual retirement. Contributed by Jian He. MAPREDUCE-5297. Updated MR App since BuilderUtils is no longer public after YARN-748. Contributed by Jian He. [acmurthy] MAPREDUCE-5245. Added back constants to JobConf to fix incompatibilities. Contributed by Zhijie Shen. [acmurthy] YARN-726. Fix queue finish time fields in web-ui for ResourceManager. Contributed by Mayank Bansal. [acmurthy] MAPREDUCE-5300. Moved to INCOMPATIBLE CHANGES section in CHANGES.txt. [acmurthy] MAPREDUCE-5299. Changed jira number for the commit in CHANGES.txt. [acmurthy] MAPREDUCE-5300. Fix backward incompatibility for o.a.h.mapreduce.filecache.DistributedCache. Contributed by Zhijie Shen. [acmurthy] MAPREDUCE-5296. Fix backward incompatibility for JobControl by adding the omitted addJob. Contributed by Zhijie Shen. [acmurthy] MAPREDUCE-5220. Fix backward incompatibility for TaskCompletionEvent by adding back setTaskID. Contributed by Zhijie Shen. [jeagles] HADOOP-9614. smart-test-patch.sh hangs for new version of patch (2.7.1) (Ravi Prakash via jeagles) [acmurthy] YARN-398. Make it possible to specify hard locality constraints in resource requests for CapacityScheduler. Contributed by Arun C. Murthy. [cmccabe] Remove extra code that code erroneously committed in HDFS-3934 (cmccabe) [tucu] YARN-326. Add multi-resource scheduling to the fair scheduler. (sandyr via tucu) [cmccabe] Add needed file for HDFS-3934 (cmccabe) [cmccabe] HDFS-3934. duplicative dfs_hosts entries handled wrong. (cmccabe) [tomwhite] MAPREDUCE-5036. Default shuffle handler port should not be 8080. Contributed by Sandy Ryza. [jlowe] Move HADOOP-9397 to 2.1.0-beta after merging it into branch-2. [jlowe] MAPREDUCE-5268. Improve history server startup performance. Contributed by Karthik Kambatla -- [...truncated 47949 lines...] Adding reference: maven.dependency.classpath Adding reference: maven.compile.classpath Adding reference: maven.runtime.classpath Adding reference: maven.test.classpath Adding reference: maven.plugin.classpath Adding reference: maven.project Adding reference: maven.project.helper Adding reference: maven.local.repository [DEBUG] Initialize Maven Ant Tasks parsing buildfile jar:file:/home/jenkins/.m2/repository/org/apache/maven/plugins/maven-antrun-plugin/1.6/maven-antrun-plugin-1.6.jar!/org/apache/maven/ant/tasks/antlib.xml with URI = jar:file:/home/jenkins/.m2/repository/org/apache/maven/plugins/maven-antrun-plugin/1.6/maven-antrun-plugin-1.6.jar!/org/apache/maven/ant/tasks/antlib.xml from a zip file parsing buildfile jar:file:/home/jenkins/.m2/repository/org/apache/ant/ant/1.8.1/ant-1.8.1.jar!/org/apache/tools/ant/antlib.xml with URI = jar:file:/home/jenkins/.m2/repository/org/apache/ant/ant/1.8.1/ant-1.8.1.jar!/org/apache/tools/ant/antlib.xml from a zip file Class org.apache.maven.ant.tasks.AttachArtifactTask loaded from parent loader (parentFirst) +Datatype attachartifact org.apache.maven.ant.tasks.AttachArtifactTask Class org.apache.maven.ant.tasks.DependencyFilesetsTask loaded from parent loader (parentFirst) +Datatype dependencyfilesets org.apache.maven.ant.tasks.DependencyFilesetsTask Setting project property: test.build.dir - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target/test-dir Setting project property: test.exclude.pattern - _ Setting project property: hadoop.assemblies.version - 3.0.0-SNAPSHOT Setting project property: test.exclude - _ Setting project property: distMgmtSnapshotsId - apache.snapshots.https Setting project property: project.build.sourceEncoding - UTF-8 Setting project property: distMgmtSnapshotsUrl - https://repository.apache.org/content/repositories/snapshots Setting project property: distMgmtStagingUrl - https://repository.apache.org/service/local/staging/deploy/maven2 Setting project property: test.build.data -
Re: [VOTE] Release Apache Hadoop 0.23.8
+1 - Verified signatures and checksums - Verified MAPREDUCE-5211 was present in CHANGES.txt and source - Built from source, deployed single-node cluster, ran example jobs Jason On 05/28/2013 11:00 AM, Thomas Graves wrote: I've created a release candidate (RC0) for hadoop-0.23.8 that I would like to release. This release is a sustaining release with several important bug fixes in it. The most critical one is MAPREDUCE-5211. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.8-candidate-0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.8-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. I am +1 (binding). thanks, Tom Graves
[jira] [Created] (HADOOP-9618) Add thread which detects JVM pauses
Todd Lipcon created HADOOP-9618: --- Summary: Add thread which detects JVM pauses Key: HADOOP-9618 URL: https://issues.apache.org/jira/browse/HADOOP-9618 Project: Hadoop Common Issue Type: New Feature Components: util Affects Versions: 3.0.0 Reporter: Todd Lipcon Assignee: Todd Lipcon Often times users struggle to understand what happened when a long JVM pause (GC or otherwise) causes things to malfunction inside a Hadoop daemon. For example, a long GC pause while logging an edit to the QJM may cause the edit to timeout, or a long GC pause may make other IPCs to the NameNode timeout. We should add a simple thread which loops on 1-second sleeps, and if the sleep ever takes significantly longer than 1 second, log a WARN. This will make GC pauses obvious in logs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Informal session on security design during Hadoop Summit, June 26th from 1:45 to 3:30 PT
I'm happy to announce that we have secured a time slot and space during Hadoop Summit NA dedicated to forward looking Hadoop security design collaboration. Currently, a room has been allocated on the 26th from 1:45 to 3:30 PT. Specific location will be available at the Summit and any changes in date or time will be announced publicly to the best of our abilities. Apologies for posting here in addition to HADOOP-9533 and HADOOP-9392 but I'm trying to get the word out.
Re: Informal session on security design during Hadoop Summit, June 26th from 1:45 to 3:30 PT
Dear Kevin, This is great. You guys should involve ComDev (dev@community.a.o) in this and notify them of the upcoming meeting to give them a heads up. Note that the meeting/discussions are fine, but no decisions RE: Knox or any Apache project for that matter should occur during the meeting -- those only happen at Apache an on list. It would be nice also to see if there is a way for remote participation e.g., via Google Hangout to allow for other folks to participate if they can. Cheers, Chris ++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++ -Original Message- From: Kevin Minder kevin.min...@hortonworks.com Reply-To: common-dev@hadoop.apache.org common-dev@hadoop.apache.org Date: Tuesday, June 4, 2013 12:33 PM To: common-dev@hadoop.apache.org common-dev@hadoop.apache.org Subject: Informal session on security design during Hadoop Summit, June 26th from 1:45 to 3:30 PT I'm happy to announce that we have secured a time slot and space during Hadoop Summit NA dedicated to forward looking Hadoop security design collaboration. Currently, a room has been allocated on the 26th from 1:45 to 3:30 PT. Specific location will be available at the Summit and any changes in date or time will be announced publicly to the best of our abilities. Apologies for posting here in addition to HADOOP-9533 and HADOOP-9392 but I'm trying to get the word out.
Re: [VOTE] Release Apache Hadoop 0.23.8
Thanks everyone for trying 0.23.8 out and voting. With 10 +1's (7 binding, 3 non-binding) and no -1's, the vote passes. I will push the release. Tom Graves On 5/28/13 11:00 AM, Thomas Graves tgra...@yahoo-inc.com wrote: I've created a release candidate (RC0) for hadoop-0.23.8 that I would like to release. This release is a sustaining release with several important bug fixes in it. The most critical one is MAPREDUCE-5211. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.8-candidate-0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.8-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. I am +1 (binding). thanks, Tom Graves
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
+1 Built from source and ran a couple of jobs in a pseudo-distributed cluster. Kihwal On 6/3/13 2:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 1/ \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
Cos, The name of the mds file for the binary tar is missing a . in your apache directory: hadoop-2.0.5-alphatar.gz.mds http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/hadoop-2.0.5-alphatar .gz.mds Contents of it are fine though so you might just add the .. Also the NOTICE.txt, README.txt, and LICENSE.txt files are missing from the top level directory in both the src and binary tar ball. Everything else looks good. Verified checksums, signatures, built, ran single node cluster. Thanks, Tom On 6/3/13 2:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 1/ \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
Good point Thomas - I have just fixed the name of the file. Nice catch! Sigh... these three text files... If anyone feels strongly about having them in place - I will update the tarballs and recalculate the checksums. Or just leave it as is, perhaps? So, either way is fine with me. Thanks, Cos On Tue, Jun 04, 2013 at 08:47PM, Thomas Graves wrote: Cos, The name of the mds file for the binary tar is missing a . in your apache directory: hadoop-2.0.5-alphatar.gz.mds http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/hadoop-2.0.5-alphatar .gz.mds Contents of it are fine though so you might just add the .. Also the NOTICE.txt, README.txt, and LICENSE.txt files are missing from the top level directory in both the src and binary tar ball. Everything else looks good. Verified checksums, signatures, built, ran single node cluster. Thanks, Tom On 6/3/13 2:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 1/ \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc 1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos
[jira] [Created] (HADOOP-9619) Mark stability of .proto files
Sanjay Radia created HADOOP-9619: Summary: Mark stability of .proto files Key: HADOOP-9619 URL: https://issues.apache.org/jira/browse/HADOOP-9619 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9620) Stabilize branch-2 on Windows
Chuan Liu created HADOOP-9620: - Summary: Stabilize branch-2 on Windows Key: HADOOP-9620 URL: https://issues.apache.org/jira/browse/HADOOP-9620 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Chuan Liu After merging trunk change into branch-2, we are seeing a new set of unit test failures in branch-2 on Windows. This an umbrella jira to track the remaining issues in branch-2 on Windows with the goal to stabilize branch-2 on Windows and achieve 100% unit test pass rate. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
