svn commit: r1439293 - /hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html
Author: mattf Date: Mon Jan 28 08:07:15 2013 New Revision: 1439293 URL: http://svn.apache.org/viewvc?rev=1439293view=rev Log: Hadoop 1.1.2-rc3 release candidate, with corrected release notes Modified: hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html Modified: hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html URL: http://svn.apache.org/viewvc/hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html?rev=1439293r1=1439292r2=1439293view=diff == --- hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html (original) +++ hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html Mon Jan 28 08:07:15 2013 @@ -54,11 +54,26 @@ h3Other Jiras (describe bug fixes and minor changes)/h3 ul +li a href=https://issues.apache.org/jira/browse/HADOOP-8418;HADOOP-8418/a. + Major bug reported by vicaya and fixed by crystal_gaoyu (security)br + bFix UGI for IBM JDK running on Windows/bbr + blockquoteThe login module and user principal classes are different for 32 and 64-bit Windows in IBM J9 JDK 6 SR10. Hadoop 1.0.3 does not run on either because it uses the 32 bit login module and the 64-bit user principal class./blockquote/li + +li a href=https://issues.apache.org/jira/browse/HADOOP-8561;HADOOP-8561/a. + Major improvement reported by vicaya and fixed by crystal_gaoyu (security)br + bIntroduce HADOOP_PROXY_USER for secure impersonation in child hadoop client processes/bbr + blockquoteTo solve the problem for an authenticated user to type hadoop shell commands in a web console, we can introduce an HADOOP_PROXY_USER environment variable to allow proper impersonation in the child hadoop client processes./blockquote/li + li a href=https://issues.apache.org/jira/browse/HADOOP-8880;HADOOP-8880/a. Major bug reported by gkesavan and fixed by gkesavan br bMissing jersey jars as dependency in the pom causes hive tests to fail/bbr blockquoteivy.xml has the dependency included where as the same dependency is not updated in the pom template./blockquote/li +li a href=https://issues.apache.org/jira/browse/HADOOP-9051;HADOOP-9051/a. + Minor test reported by mg...@vmware.com and fixed by vicaya (test)br + bÃant testà will build failed for trying to delete a file/bbr + blockquoteRun quot;ant testquot; on branch-1 of hadoop-common.brWhen the test process reach quot;test-core-excluding-commit-and-smokequot;brbrIt will invoke the quot;macro-test-runnerquot; to clear and rebuild the test environment.brThen the ant task command lt;delete dir=quot;@{test.dir}/logsquot; /gt;brfailed for trying to delete an non-existent file.brbrfollowing is the test result logs:brtest-core-excluding-commit-and-smoke:br [delete] Deleting: /home/jdu/bdc/hadoop-topology-branch1-new/hadoop-common/build/test/testsfailedbr [delete] Dele.../blockquote/li + li a href=https://issues.apache.org/jira/browse/HADOOP-9111;HADOOP-9111/a. Minor improvement reported by jingzhao and fixed by jingzhao (test)br bFix failed testcases with @ignore annotation In branch-1/bbr @@ -84,6 +99,21 @@ bquot;Text File Busyquot; errors launching MR tasks/bbr blockquoteSome very small percentage of tasks fail with a quot;Text file busyquot; error.brbrThe following was the original diagnosis:br{quote}brOur use of PrintWriter in TaskController.writeCommand is unsafe, since that class swallows all IO exceptions. Weapos;re not currently checking for errors, which Iapos;m seeing result in occasional task failures with the message quot;Text file busyquot; - assumedly because the close() call is failing silently for some reason.br{quote}br.. but turned out to be another issue as well (see below)/blockquote/li +li a href=https://issues.apache.org/jira/browse/MAPREDUCE-4272;MAPREDUCE-4272/a. + Major bug reported by vicaya and fixed by crystal_gaoyu (task)br + bSortedRanges.Range#compareTo is not spec compliant/bbr + blockquoteSortedRanges.Range#compareTo does not satisfy the requirement of Comparable#compareTo, where quot;the implementor must ensure {noformat}sgn(x.compareTo(y)) == -sgn(y.compareTo(x)){noformat} for all x and y.quot;brbrThis is manifested as TestStreamingBadRecords failures in alternative JDKs./blockquote/li + +li a href=https://issues.apache.org/jira/browse/MAPREDUCE-4396;MAPREDUCE-4396/a. + Minor bug reported by vicaya and fixed by crystal_gaoyu (client)br + bMake LocalJobRunner work with private distributed cache/bbr + blockquoteSome LocalJobRunner related unit tests fails if user directory permission and/or umask is too restrictive./blockquote/li + +li a href=https://issues.apache.org/jira/browse/MAPREDUCE-4397;MAPREDUCE-4397/a. + Major improvement reported by vicaya and fixed by crystal_gaoyu (task-controller)br + bIntroduce HADOOP_SECURITY_CONF_DIR for task-controller/bbr + blockquoteThe
svn commit: r1439481 - /hadoop/common/branches/branch-1.1/CHANGES.txt
Author: mattf Date: Mon Jan 28 16:33:19 2013 New Revision: 1439481 URL: http://svn.apache.org/viewvc?rev=1439481view=rev Log: update release date in CHANGES.txt for release candidate 1.1.2-rc4 Modified: hadoop/common/branches/branch-1.1/CHANGES.txt Modified: hadoop/common/branches/branch-1.1/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-1.1/CHANGES.txt?rev=1439481r1=1439480r2=1439481view=diff == --- hadoop/common/branches/branch-1.1/CHANGES.txt (original) +++ hadoop/common/branches/branch-1.1/CHANGES.txt Mon Jan 28 16:33:19 2013 @@ -1,6 +1,6 @@ Hadoop Change Log -Release 1.1.2 - 2012.12.07 +Release 1.1.2 - 2013.01.27 INCOMPATIBLE CHANGES
svn commit: r1439531 - /hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt
Author: suresh Date: Mon Jan 28 17:59:12 2013 New Revision: 1439531 URL: http://svn.apache.org/viewvc?rev=1439531view=rev Log: HADOOP-9247. Merge r1438698 from trunk Modified: hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt Modified: hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439531r1=1439530r2=1439531view=diff == --- hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 17:59:12 2013 @@ -134,6 +134,9 @@ Release 2.0.3-alpha - Unreleased HADOOP-9241. DU refresh interval is not configurable (harsh) +HADOOP-9247. Parametrize Clover generateXxx properties to make them +re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh) + OPTIMIZATIONS HADOOP-8866. SampleQuantiles#query is O(N^2) instead of O(N). (Andrew Wang
svn commit: r1439531 - /hadoop/common/branches/branch-2/pom.xml
Author: suresh Date: Mon Jan 28 17:59:12 2013 New Revision: 1439531 URL: http://svn.apache.org/viewvc?rev=1439531view=rev Log: HADOOP-9247. Merge r1438698 from trunk Modified: hadoop/common/branches/branch-2/pom.xml Modified: hadoop/common/branches/branch-2/pom.xml URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/pom.xml?rev=1439531r1=1439530r2=1439531view=diff == --- hadoop/common/branches/branch-2/pom.xml (original) +++ hadoop/common/branches/branch-2/pom.xml Mon Jan 28 17:59:12 2013 @@ -409,6 +409,18 @@ xsi:schemaLocation=http://maven.apache. properties cloverLicenseLocation${user.home}/.clover.license/cloverLicenseLocation cloverDatabase${project.build.directory}/clover/hadoop-coverage.db/cloverDatabase +!-- NB: This additional parametrization is made in order + to be able to re-define these properties with -Dk=v maven options. + By some reason the expressions declared in clover + docs like ${maven.clover.generateHtml} do not work in that way. + However, the below properties are confirmed to work: e.g. + -DcloverGenHtml=false switches off the Html generation. + The default values provided here exactly correspond to Clover defaults, so + the behavior is 100% backwards compatible. -- +cloverAlwaysReporttrue/cloverAlwaysReport +cloverGenHtmltrue/cloverGenHtml +cloverGenXmltrue/cloverGenXml +cloverGenHistoricalfalse/cloverGenHistorical /properties build plugins @@ -422,8 +434,10 @@ xsi:schemaLocation=http://maven.apache. cloverDatabase${cloverDatabase}/cloverDatabase targetPercentage50%/targetPercentage outputDirectory${project.build.directory}/clover/outputDirectory - generateHtmltrue/generateHtml - generateXmltrue/generateXml + alwaysReport${cloverAlwaysReport}/alwaysReport + generateHtml${cloverGenHtml}/generateHtml + generateXml${cloverGenXml}/generateXml + generateHistorical${cloverGenHistorical}/generateHistorical /configuration executions execution
svn commit: r1439533 - /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
Author: suresh Date: Mon Jan 28 17:59:37 2013 New Revision: 1439533 URL: http://svn.apache.org/viewvc?rev=1439533view=rev Log: HADOOP-9247. Merge r1438698 from trunk Modified: hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt Modified: hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439533r1=1439532r2=1439533view=diff == --- hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 17:59:37 2013 @@ -54,6 +54,9 @@ Release 0.23.6 - UNRELEASED HADOOP-9217. Print thread dumps when hadoop-common tests fail. (Andrey Klochkov via suresh) +HADOOP-9247. Parametrize Clover generateXxx properties to make them +re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh) + OPTIMIZATIONS BUG FIXES
svn commit: r1439533 - /hadoop/common/branches/branch-0.23/pom.xml
Author: suresh Date: Mon Jan 28 17:59:37 2013 New Revision: 1439533 URL: http://svn.apache.org/viewvc?rev=1439533view=rev Log: HADOOP-9247. Merge r1438698 from trunk Modified: hadoop/common/branches/branch-0.23/pom.xml Modified: hadoop/common/branches/branch-0.23/pom.xml URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/pom.xml?rev=1439533r1=1439532r2=1439533view=diff == --- hadoop/common/branches/branch-0.23/pom.xml (original) +++ hadoop/common/branches/branch-0.23/pom.xml Mon Jan 28 17:59:37 2013 @@ -392,6 +392,18 @@ properties cloverLicenseLocation${user.home}/.clover.license/cloverLicenseLocation cloverDatabase${project.build.directory}/clover/hadoop-coverage.db/cloverDatabase +!-- NB: This additional parametrization is made in order + to be able to re-define these properties with -Dk=v maven options. + By some reason the expressions declared in clover + docs like ${maven.clover.generateHtml} do not work in that way. + However, the below properties are confirmed to work: e.g. + -DcloverGenHtml=false switches off the Html generation. + The default values provided here exactly correspond to Clover defaults, so + the behavior is 100% backwards compatible. -- +cloverAlwaysReporttrue/cloverAlwaysReport +cloverGenHtmltrue/cloverGenHtml +cloverGenXmltrue/cloverGenXml +cloverGenHistoricalfalse/cloverGenHistorical /properties build plugins @@ -405,8 +417,10 @@ cloverDatabase${cloverDatabase}/cloverDatabase targetPercentage50%/targetPercentage outputDirectory${project.build.directory}/clover/outputDirectory - generateHtmltrue/generateHtml - generateXmltrue/generateXml + alwaysReport${cloverAlwaysReport}/alwaysReport + generateHtml${cloverGenHtml}/generateHtml + generateXml${cloverGenXml}/generateXml + generateHistorical${cloverGenHistorical}/generateHistorical /configuration executions execution
svn commit: r1439539 - /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
Author: suresh Date: Mon Jan 28 18:05:31 2013 New Revision: 1439539 URL: http://svn.apache.org/viewvc?rev=1439539view=rev Log: Move HADOOP-9247 to release 0.23.7 section in CHANGES.txt Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439539r1=1439538r2=1439539view=diff == --- hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 18:05:31 2013 @@ -152,9 +152,6 @@ Trunk (Unreleased) HADOOP-9245. mvn clean without running mvn install before fails. (Karthik Kambatla via suresh) -HADOOP-9247. Parametrize Clover generateXxx properties to make them -re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh) - BUG FIXES HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) @@ -1301,6 +1298,10 @@ Release 0.23.6 - UNRELEASED HADOOP-9242. Duplicate surefire plugin config in hadoop-common. (Andrey Klochkov via suresh) +HADOOP-9247. Parametrize Clover generateXxx properties to make them +re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh) + + OPTIMIZATIONS BUG FIXES
svn commit: r1439588 - /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
Author: tgraves Date: Mon Jan 28 19:18:10 2013 New Revision: 1439588 URL: http://svn.apache.org/viewvc?rev=1439588view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439588r1=1439587r2=1439588view=diff == --- hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 19:18:10 2013 @@ -1319,6 +1319,8 @@ Release 0.23.6 - UNRELEASED HADOOP-9097. Maven RAT plugin is not checking all source files (tgraves) +HADOOP-9255. relnotes.py missing last jira (tgraves) + Release 0.23.5 - 2012-11-28
svn commit: r1439588 - /hadoop/common/trunk/dev-support/relnotes.py
Author: tgraves Date: Mon Jan 28 19:18:10 2013 New Revision: 1439588 URL: http://svn.apache.org/viewvc?rev=1439588view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/trunk/dev-support/relnotes.py Modified: hadoop/common/trunk/dev-support/relnotes.py URL: http://svn.apache.org/viewvc/hadoop/common/trunk/dev-support/relnotes.py?rev=1439588r1=1439587r2=1439588view=diff == --- hadoop/common/trunk/dev-support/relnotes.py (original) +++ hadoop/common/trunk/dev-support/relnotes.py Mon Jan 28 19:18:10 2013 @@ -155,7 +155,7 @@ class JiraIter: end=1 count=100 while (at end): - params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at+1, 'maxResults':count}) + params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at, 'maxResults':count}) resp = urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params) data = json.loads(resp.read()) if (data.has_key('errorMessages')):
svn commit: r1439589 - /hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py
Author: tgraves Date: Mon Jan 28 19:18:14 2013 New Revision: 1439589 URL: http://svn.apache.org/viewvc?rev=1439589view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py Modified: hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py?rev=1439589r1=1439588r2=1439589view=diff == --- hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py (original) +++ hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py Mon Jan 28 19:18:14 2013 @@ -155,7 +155,7 @@ class JiraIter: end=1 count=100 while (at end): - params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at+1, 'maxResults':count}) + params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at, 'maxResults':count}) resp = urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params) data = json.loads(resp.read()) if (data.has_key('errorMessages')):
svn commit: r1439589 - /hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt
Author: tgraves Date: Mon Jan 28 19:18:14 2013 New Revision: 1439589 URL: http://svn.apache.org/viewvc?rev=1439589view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt Modified: hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439589r1=1439588r2=1439589view=diff == --- hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 19:18:14 2013 @@ -55,6 +55,8 @@ Release 0.23.6 - UNRELEASED HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool (Liang Xie via tgraves) +HADOOP-9255. relnotes.py missing last jira (tgraves) + Release 0.23.5 - 2012-11-28 INCOMPATIBLE CHANGES
svn commit: r1439601 - /hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt
Author: tgraves Date: Mon Jan 28 19:55:33 2013 New Revision: 1439601 URL: http://svn.apache.org/viewvc?rev=1439601view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt Modified: hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439601r1=1439600r2=1439601view=diff == --- hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 19:55:33 2013 @@ -1002,6 +1002,8 @@ Release 0.23.6 - UNRELEASED HADOOP-9097. Maven RAT plugin is not checking all source files (tgraves) +HADOOP-9255. relnotes.py missing last jira (tgraves) + Release 0.23.5 - 2012-11-28 INCOMPATIBLE CHANGES
svn commit: r1439601 - /hadoop/common/branches/branch-2/dev-support/relnotes.py
Author: tgraves Date: Mon Jan 28 19:55:33 2013 New Revision: 1439601 URL: http://svn.apache.org/viewvc?rev=1439601view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/branches/branch-2/dev-support/relnotes.py Modified: hadoop/common/branches/branch-2/dev-support/relnotes.py URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/dev-support/relnotes.py?rev=1439601r1=1439600r2=1439601view=diff == --- hadoop/common/branches/branch-2/dev-support/relnotes.py (original) +++ hadoop/common/branches/branch-2/dev-support/relnotes.py Mon Jan 28 19:55:33 2013 @@ -155,7 +155,7 @@ class JiraIter: end=1 count=100 while (at end): - params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at+1, 'maxResults':count}) + params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at, 'maxResults':count}) resp = urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params) data = json.loads(resp.read()) if (data.has_key('errorMessages')):
svn commit: r1439604 - /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
Author: tgraves Date: Mon Jan 28 19:58:26 2013 New Revision: 1439604 URL: http://svn.apache.org/viewvc?rev=1439604view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt Modified: hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439604r1=1439603r2=1439604view=diff == --- hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 19:58:26 2013 @@ -91,6 +91,8 @@ Release 0.23.6 - UNRELEASED HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool (Liang Xie via tgraves) +HADOOP-9255. relnotes.py missing last jira (tgraves) + Release 0.23.5 - 2012-11-28 INCOMPATIBLE CHANGES
svn commit: r1439604 - /hadoop/common/branches/branch-0.23/dev-support/relnotes.py
Author: tgraves Date: Mon Jan 28 19:58:26 2013 New Revision: 1439604 URL: http://svn.apache.org/viewvc?rev=1439604view=rev Log: HADOOP-9255. relnotes.py missing last jira (tgraves) Modified: hadoop/common/branches/branch-0.23/dev-support/relnotes.py Modified: hadoop/common/branches/branch-0.23/dev-support/relnotes.py URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/dev-support/relnotes.py?rev=1439604r1=1439603r2=1439604view=diff == --- hadoop/common/branches/branch-0.23/dev-support/relnotes.py (original) +++ hadoop/common/branches/branch-0.23/dev-support/relnotes.py Mon Jan 28 19:58:26 2013 @@ -155,7 +155,7 @@ class JiraIter: end=1 count=100 while (at end): - params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at+1, 'maxResults':count}) + params = urllib.urlencode({'jql': project in (HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') and resolution = Fixed, 'startAt':at, 'maxResults':count}) resp = urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params) data = json.loads(resp.read()) if (data.has_key('errorMessages')):
svn commit: r1439605 - /hadoop/common/tags/release-1.1.2-rc4/
Author: mattf Date: Mon Jan 28 20:06:54 2013 New Revision: 1439605 URL: http://svn.apache.org/viewvc?rev=1439605view=rev Log: Hadoop 1.1.2-rc4 release candidate. Added: hadoop/common/tags/release-1.1.2-rc4/ (props changed) - copied from r1439604, hadoop/common/branches/branch-1.1/ Propchange: hadoop/common/tags/release-1.1.2-rc4/ -- --- svn:ignore (added) +++ svn:ignore Mon Jan 28 20:06:54 2013 @@ -0,0 +1,9 @@ +build +build.properties +logs +.classpath +.git +.project +.settings +.launches +.externalToolBuilders Propchange: hadoop/common/tags/release-1.1.2-rc4/ -- --- svn:mergeinfo (added) +++ svn:mergeinfo Mon Jan 28 20:06:54 2013 @@ -0,0 +1,9 @@ +/hadoop/common/branches/branch-0.20:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 +/hadoop/common/branches/branch-0.20-append:955380,955398,955448,956329 +/hadoop/common/branches/branch-0.20-security-203:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 +/hadoop/common/branches/branch-0.20-security-204:1128390,1147228,1148069,1149316,1154413 +/hadoop/common/branches/branch-0.20-security-205:1174370,1174917,1176042,1176248,1176638,1176645,1202378 +/hadoop/common/branches/branch-1:1343738,1343992,1346167,1353893,1353928,1354390,1354773,1354798,1357994,1360011,1360940,1360944,1366295,1374605,1379653,1384742,1392637,1399786,1402728,1407625,1408450,1417238 +/hadoop/common/branches/branch-1.0:1214410,1291091,1330040,1334877 +/hadoop/core/branches/branch-0.19:713112 +/hadoop/core/trunk:727001,727117,727191,727212,727217,727228,727255,727869,728187,729052,729987,732385,732572,732613,732777,732838,732869,733887,734870,734916,736426,738328,738697,740077,740157,741703,741762,743745,743816,743892,744894,745180,746010,746206,746227,746233,746274,746338,746902-746903,746925,746944,746968,746970,747279,747289,747802,748084,748090,748783,749262,749318,749863,750533,752073,752609,752834,752836,752913,752932,753112-753113,753346,754645,754847,754927,755035,755226,755348,755370,755418,755426,755790,755905,755938,755960,755986,755998,756352,757448,757624,757849,758156,758180,759398,759932,760502,760783,761046,761482,761632,762216,762879,763107,763502,764967,765016,765809,765951,771607,771661,772844,772876,772884,772920,773889,776638,778962,778966,779893,781720,784661,785046,785569
svn commit: r1439620 - /hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java
Author: jlowe Date: Mon Jan 28 20:52:14 2013 New Revision: 1439620 URL: http://svn.apache.org/viewvc?rev=1439620view=rev Log: HADOOP-9246. Execution phase for hadoop-maven-plugin should be process-resources. Contributed by Karthik Kambatla and Chris Nauroth Modified: hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java Modified: hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java?rev=1439620r1=1439619r2=1439620view=diff == --- hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java (original) +++ hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java Mon Jan 28 20:52:14 2013 @@ -46,7 +46,7 @@ import java.util.TimeZone; * build. The version information includes build time, SCM URI, SCM branch, SCM * commit, and an MD5 checksum of the contents of the files in the codebase. */ -@Mojo(name=version-info, defaultPhase=LifecyclePhase.INITIALIZE) +@Mojo(name=version-info) public class VersionInfoMojo extends AbstractMojo { @Parameter(defaultValue=${project})
svn commit: r1439620 - in /hadoop/common/trunk/hadoop-common-project/hadoop-common: CHANGES.txt pom.xml
Author: jlowe Date: Mon Jan 28 20:52:14 2013 New Revision: 1439620 URL: http://svn.apache.org/viewvc?rev=1439620view=rev Log: HADOOP-9246. Execution phase for hadoop-maven-plugin should be process-resources. Contributed by Karthik Kambatla and Chris Nauroth Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439620r1=1439619r2=1439620view=diff == --- hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt (original) +++ hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 28 20:52:14 2013 @@ -328,6 +328,9 @@ Trunk (Unreleased) HADOOP-8589 ViewFs tests fail when tests and home dirs are nested (sanjay Radia) +HADOOP-9246 Execution phase for hadoop-maven-plugin should be +process-resources (Karthik Kambatla and Chris Nauroth via jlowe) + Release 2.0.3-alpha - Unreleased INCOMPATIBLE CHANGES Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml?rev=1439620r1=1439619r2=1439620view=diff == --- hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml (original) +++ hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml Mon Jan 28 20:52:14 2013 @@ -274,7 +274,7 @@ executions execution idversion-info/id -phasecompile/phase +phasegenerate-resources/phase goals goalversion-info/goal /goals
[Hadoop Wiki] Update of AmazonS3 by SteveLoughran
Dear Wiki user, You have subscribed to a wiki page or wiki category on Hadoop Wiki for change notification. The AmazonS3 page has been changed by SteveLoughran: http://wiki.apache.org/hadoop/AmazonS3?action=diffrev1=13rev2=14 Comment: remind people to keep their access key safe and out of SCM logs S3 Native FileSystem (URI scheme: s3n):: A native filesystem for reading and writing regular files on S3. The advantage of this filesystem is that you can access files on S3 that were written with other tools. Conversely, other tools can access files written using Hadoop. The disadvantage is the 5GB limit on file size imposed by S3. For this reason it is not suitable as a replacement for HDFS (which has support for very large files). - + S3 Block FileSystem (URI scheme: s3):: A block-based filesystem backed by S3. Files are stored as blocks, just like they are in HDFS. This permits efficient implementation of renames. This filesystem requires you to dedicate a bucket for the filesystem - you should not use an existing bucket containing files, or write other files to the same bucket. The files stored by this filesystem can be larger than 5GB, but they are not interoperable with other S3 tools. There are two ways that S3 can be used with Hadoop's Map/Reduce, either as a replacement for HDFS using the S3 block filesystem (i.e. using it as a reliable distributed filesystem with support for very large files) or as a convenient repository for data input to and output from MapReduce, using either S3 filesystem. In the second case - HDFS is still used for the Map/Reduce phase. Note also, that by using S3 as an input to MapReduce you lose the data locality optimization, which may be significant. + HDFS is still used for the Map/Reduce phase. Note also, that by using S3 as an input to MapReduce you lose the data locality optimization, which may be significant. = History = * The S3 block filesystem was introduced in Hadoop 0.10.0 ([[http://issues.apache.org/jira/browse/HADOOP-574|HADOOP-574]]), but this had a few bugs so you should use Hadoop 0.10.1 or later. @@ -79, +79 @@ bin/start-mapred.sh }}} + = Security = + + Your Amazon Secret Access Key is that: secret. If it gets known you have to go to the [[https://portal.aws.amazon.com/gp/aws/securityCredentials|Security Credentials]] page and revoke it. Try and avoid printing it in logs, or checking the XML configuration files into revision control. = Running bulk copies in and out of S3 = @@ -105, +108 @@ put: Input stream is not repeatable as 1048576 bytes have been written, exceeding the available buffer size of 131072 }}} - See [[https://issues.apache.org/jira/browse/HADOOP-882|HADOOP-882]] for discussion of the above issues and workarounds/fixes. + See [[https://issues.apache.org/jira/browse/HADOOP-882|HADOOP-882]] for discussion of the above issues and workarounds/fixes. = S3 Block FileSystem Version Numbers = From release 0.13.0 the S3 block filesystem stores a version number in the file metadata. This table lists the first Hadoop release for each version number.
svn commit: r1439714 - in /hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen: Hadoop20JHParser.java Job20LineHistoryEventEmitter.java TaskAttempt20LineEventEmit
Author: sseth Date: Tue Jan 29 00:21:58 2013 New Revision: 1439714 URL: http://svn.apache.org/viewvc?rev=1439714view=rev Log: MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen Modified: hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java Modified: hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java?rev=1439714r1=1439713r2=1439714view=diff == --- hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java (original) +++ hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java Tue Jan 29 00:21:58 2013 @@ -67,6 +67,11 @@ public class Hadoop20JHParser implements reader = new LineReader(input); } + public Hadoop20JHParser(LineReader reader) throws IOException { +super(); +this.reader = reader; + } + MapString, HistoryEventEmitter liveEmitters = new HashMapString, HistoryEventEmitter(); QueueHistoryEvent remainingEvents = new LinkedListHistoryEvent(); Modified: hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java?rev=1439714r1=1439713r2=1439714view=diff == --- hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java (original) +++ hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java Tue Jan 29 00:21:58 2013 @@ -76,6 +76,23 @@ public class Job20LineHistoryEventEmitte } String jobName = line.get(JOBNAME); String jobQueueName = line.get(JOB_QUEUE);// could be null + String workflowId = line.get(WORKFLOW_ID); + if (workflowId == null) { +workflowId = ; + } + String workflowName = line.get(WORKFLOW_NAME); + if (workflowName == null) { +workflowName = ; + } + String workflowNodeName = line.get(WORKFLOW_NODE_NAME); + if (workflowNodeName == null) { +workflowNodeName = ; + } + String workflowAdjacencies = line.get(WORKFLOW_ADJACENCIES); + if (workflowAdjacencies == null) { +workflowAdjacencies = ; + } + if (submitTime != null) { Job20LineHistoryEventEmitter that = @@ -86,7 +103,8 @@ public class Job20LineHistoryEventEmitte MapJobACL, AccessControlList jobACLs = new HashMapJobACL, AccessControlList(); return new JobSubmittedEvent(jobID, jobName, user, -that.originalSubmitTime, jobConf, jobACLs, jobQueueName); +that.originalSubmitTime, jobConf, jobACLs, jobQueueName, +workflowId, workflowName, workflowNodeName, workflowAdjacencies); } return null; Modified: hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java?rev=1439714r1=1439713r2=1439714view=diff == --- hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java (original) +++ hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java Tue Jan 29 00:21:58 2013 @@ -65,6 +65,14 @@ public abstract class TaskAttempt20LineE String taskType = line.get(TASK_TYPE); String trackerName = line.get(TRACKER_NAME); String httpPort = line.get(HTTP_PORT); + String locality = line.get(LOCALITY); + if (locality == null) { +locality = ; + } + String avataar = line.get(AVATAAR); + if (avataar == null) { +avataar = ; + } if (startTime != null taskType != null) { TaskAttempt20LineEventEmitter that = @@ -79,7 +87,8 @@ public abstract class TaskAttempt20LineE .parseInt(httpPort); return
svn commit: r1439715 - in /hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen: Hadoop20JHParser.java Job20LineHistoryEventEmitter.java TaskAttempt20L
Author: sseth Date: Tue Jan 29 00:23:27 2013 New Revision: 1439715 URL: http://svn.apache.org/viewvc?rev=1439715view=rev Log: merge MAPREDUCE-4838 from trunk. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen Modified: hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java Modified: hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java?rev=1439715r1=1439714r2=1439715view=diff == --- hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java (original) +++ hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java Tue Jan 29 00:23:27 2013 @@ -67,6 +67,11 @@ public class Hadoop20JHParser implements reader = new LineReader(input); } + public Hadoop20JHParser(LineReader reader) throws IOException { +super(); +this.reader = reader; + } + MapString, HistoryEventEmitter liveEmitters = new HashMapString, HistoryEventEmitter(); QueueHistoryEvent remainingEvents = new LinkedListHistoryEvent(); Modified: hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java?rev=1439715r1=1439714r2=1439715view=diff == --- hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java (original) +++ hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java Tue Jan 29 00:23:27 2013 @@ -76,6 +76,23 @@ public class Job20LineHistoryEventEmitte } String jobName = line.get(JOBNAME); String jobQueueName = line.get(JOB_QUEUE);// could be null + String workflowId = line.get(WORKFLOW_ID); + if (workflowId == null) { +workflowId = ; + } + String workflowName = line.get(WORKFLOW_NAME); + if (workflowName == null) { +workflowName = ; + } + String workflowNodeName = line.get(WORKFLOW_NODE_NAME); + if (workflowNodeName == null) { +workflowNodeName = ; + } + String workflowAdjacencies = line.get(WORKFLOW_ADJACENCIES); + if (workflowAdjacencies == null) { +workflowAdjacencies = ; + } + if (submitTime != null) { Job20LineHistoryEventEmitter that = @@ -86,7 +103,8 @@ public class Job20LineHistoryEventEmitte MapJobACL, AccessControlList jobACLs = new HashMapJobACL, AccessControlList(); return new JobSubmittedEvent(jobID, jobName, user, -that.originalSubmitTime, jobConf, jobACLs, jobQueueName); +that.originalSubmitTime, jobConf, jobACLs, jobQueueName, +workflowId, workflowName, workflowNodeName, workflowAdjacencies); } return null; Modified: hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java?rev=1439715r1=1439714r2=1439715view=diff == --- hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java (original) +++ hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java Tue Jan 29 00:23:27 2013 @@ -65,6 +65,14 @@ public abstract class TaskAttempt20LineE String taskType = line.get(TASK_TYPE); String trackerName = line.get(TRACKER_NAME); String httpPort = line.get(HTTP_PORT); + String locality = line.get(LOCALITY); + if (locality == null) { +locality = ; + } + String avataar = line.get(AVATAAR); + if (avataar == null) { +avataar = ; + } if
svn commit: r1439737 - /hadoop/common/tags/release-0.23.6-rc1/
Author: tgraves Date: Tue Jan 29 03:35:19 2013 New Revision: 1439737 URL: http://svn.apache.org/viewvc?rev=1439737view=rev Log: Hadoop 0.23.6-rc1 release Added: hadoop/common/tags/release-0.23.6-rc1/ (props changed) - copied from r1439736, hadoop/common/branches/branch-0.23.6/ Propchange: hadoop/common/tags/release-0.23.6-rc1/ -- --- svn:ignore (added) +++ svn:ignore Tue Jan 29 03:35:19 2013 @@ -0,0 +1,5 @@ +.classpath +.git +.project +.settings +target Propchange: hadoop/common/tags/release-0.23.6-rc1/ -- --- svn:mergeinfo (added) +++ svn:mergeinfo Tue Jan 29 03:35:19 2013 @@ -0,0 +1 @@ +/hadoop/common/trunk:1161777,1161781,1162188,1162421,1162491,1162499,1162613,1162928,1162954,1162979,1163050,1163069,1163490,1163768,1163852,1163858,1163981,1164255,1164301,1164339,1166009,1166402,1167001,1167383,1167662,1170085,1170379,1170459,1171297,1172916,1173402,1176550,1177487,1177531,1177859,1177864,1182189,1182205,1182214,1189613,1189932,1189982,1195575,1196113,1196129,1204114,1204117,1204122,1204124,1204129,1204131,1204177,1204370,1204376,1204388,1205260,1205697,1206786,1206830,1207694,1208153,1208313,1212021,1212062,1212073,1212084,1213537,1213586,1213592-1213593,1213954,1214046,1220510,1221348,1225114,1225192,1225456,1225489,1225591,1226211,1226239,1226350,1227091,1227165,1227423,1227964,1229347,1230398,1231569,1231572,1231627,1231640,1233605,1234555,1235135,1235137,1235956,1236456,1239752,1240897,1240928,1243065,1243104,1244766,1245751,1245762,1293419,1304099,1351818,1373683,1382409
svn commit: r1439738 - /hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
Author: tgraves Date: Tue Jan 29 03:37:03 2013 New Revision: 1439738 URL: http://svn.apache.org/viewvc?rev=1439738view=rev Log: Preparing for release 0.23.6 rc1 Modified: hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html Modified: hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html?rev=1439738r1=1439737r2=1439738view=diff == --- hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html (original) +++ hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html Tue Jan 29 03:37:03 2013 @@ -12,6 +12,21 @@ These release notes include new develope a name=changes/ h2Changes since Hadoop 0.23.5/h2 ul +li a href=https://issues.apache.org/jira/browse/YARN-354;YARN-354/a. + Blocker bug reported by Liang Xie and fixed by Liang Xie br + bWebAppProxyServer exits immediately after startup/bbr + blockquotePlease see HDFS-4426 for detail, i found the yarn WebAppProxyServer is broken by HADOOP-9181 as well, here's the hot fix, and i verified manually in our test cluster. + +I'm really applogized for bring about such trouble.../blockquote/li +li a href=https://issues.apache.org/jira/browse/YARN-334;YARN-334/a. + Critical bug reported by Thomas Graves and fixed by Thomas Graves br + bMaven RAT plugin is not checking all source files/bbr + blockquoteyarn side of HADOOP-9097 + + + +Running 'mvn apache-rat:check' passes, but running RAT by hand (by downloading the JAR) produces some warnings for Java files, amongst others. +/blockquote/li li a href=https://issues.apache.org/jira/browse/YARN-325;YARN-325/a. Blocker bug reported by Jason Lowe and fixed by Arun C Murthy (capacityscheduler)br bRM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing/bbr @@ -221,6 +236,10 @@ For NMs which come up after an unclean s Major bug reported by Rahul Jain and fixed by Devaraj K (jobtracker)br bgetClusterStatus() fails with null pointer exception when running jobs in local mode/bbr blockquote/blockquote/li +li a href=https://issues.apache.org/jira/browse/HDFS-4426;HDFS-4426/a. + Blocker bug reported by Jason Lowe and fixed by Arpit Agarwal (namenode)br + bSecondary namenode shuts down immediately after startup/bbr + blockquote/blockquote/li li a href=https://issues.apache.org/jira/browse/HDFS-4385;HDFS-4385/a. Critical bug reported by Thomas Graves and fixed by Thomas Graves (build)br bMaven RAT plugin is not checking all source files/bbr @@ -265,12 +284,16 @@ For NMs which come up after an unclean s Major bug reported by Jean-Daniel Cryans and fixed by Jean-Daniel Cryans br bCannot read a local block that's being written to when using the local read short circuit/bbr blockquote/blockquote/li +li a href=https://issues.apache.org/jira/browse/HADOOP-9255;HADOOP-9255/a. + Critical bug reported by Thomas Graves and fixed by Thomas Graves (scripts)br + brelnotes.py missing last jira/bbr + blockquote/blockquote/li li a href=https://issues.apache.org/jira/browse/HADOOP-9217;HADOOP-9217/a. Major test reported by Andrey Klochkov and fixed by Andrey Klochkov (test)br bPrint thread dumps when hadoop-common tests fail/bbr blockquote/blockquote/li li a href=https://issues.apache.org/jira/browse/HADOOP-9181;HADOOP-9181/a. - Major bug reported by liang xie and fixed by liang xie br + Major bug reported by Liang Xie and fixed by Liang Xie br bSet daemon flag for HttpServer's QueuedThreadPool/bbr blockquote/blockquote/li li a href=https://issues.apache.org/jira/browse/HADOOP-9169;HADOOP-9169/a. @@ -315,7 +338,7 @@ For NMs which come up after an unclean s blockquote/blockquote/li li a href=https://issues.apache.org/jira/browse/HADOOP-8931;HADOOP-8931/a. Trivial improvement reported by Eli Collins and fixed by Eli Collins br - bAdd Java version to startup message /bbr + bAdd Java version to startup message/bbr blockquote/blockquote/li li a href=https://issues.apache.org/jira/browse/HADOOP-8561;HADOOP-8561/a. Major improvement reported by Luke Lu and fixed by Yu Gao (security)br
svn commit: r1439739 - in /hadoop/common/tags: release-0.23.6-rc1-old/ release-0.23.6-rc1/
Author: tgraves Date: Tue Jan 29 03:44:45 2013 New Revision: 1439739 URL: http://svn.apache.org/viewvc?rev=1439739view=rev Log: rc1 without correct releasenotes.html Added: hadoop/common/tags/release-0.23.6-rc1-old/ (props changed) - copied from r1439738, hadoop/common/tags/release-0.23.6-rc1/ Removed: hadoop/common/tags/release-0.23.6-rc1/ Propchange: hadoop/common/tags/release-0.23.6-rc1-old/ -- --- svn:ignore (added) +++ svn:ignore Tue Jan 29 03:44:45 2013 @@ -0,0 +1,5 @@ +.classpath +.git +.project +.settings +target Propchange: hadoop/common/tags/release-0.23.6-rc1-old/ -- --- svn:mergeinfo (added) +++ svn:mergeinfo Tue Jan 29 03:44:45 2013 @@ -0,0 +1 @@ +/hadoop/common/trunk:1161777,1161781,1162188,1162421,1162491,1162499,1162613,1162928,1162954,1162979,1163050,1163069,1163490,1163768,1163852,1163858,1163981,1164255,1164301,1164339,1166009,1166402,1167001,1167383,1167662,1170085,1170379,1170459,1171297,1172916,1173402,1176550,1177487,1177531,1177859,1177864,1182189,1182205,1182214,1189613,1189932,1189982,1195575,1196113,1196129,1204114,1204117,1204122,1204124,1204129,1204131,1204177,1204370,1204376,1204388,1205260,1205697,1206786,1206830,1207694,1208153,1208313,1212021,1212062,1212073,1212084,1213537,1213586,1213592-1213593,1213954,1214046,1220510,1221348,1225114,1225192,1225456,1225489,1225591,1226211,1226239,1226350,1227091,1227165,1227423,1227964,1229347,1230398,1231569,1231572,1231627,1231640,1233605,1234555,1235135,1235137,1235956,1236456,1239752,1240897,1240928,1243065,1243104,1244766,1245751,1245762,1293419,1304099,1351818,1373683,1382409
svn commit: r1439740 - /hadoop/common/tags/release-0.23.6-rc1/
Author: tgraves Date: Tue Jan 29 03:45:21 2013 New Revision: 1439740 URL: http://svn.apache.org/viewvc?rev=1439740view=rev Log: Hadoop 0.23.6-rc1 release Added: hadoop/common/tags/release-0.23.6-rc1/ (props changed) - copied from r1439739, hadoop/common/branches/branch-0.23.6/ Propchange: hadoop/common/tags/release-0.23.6-rc1/ -- --- svn:ignore (added) +++ svn:ignore Tue Jan 29 03:45:21 2013 @@ -0,0 +1,5 @@ +.classpath +.git +.project +.settings +target Propchange: hadoop/common/tags/release-0.23.6-rc1/ -- --- svn:mergeinfo (added) +++ svn:mergeinfo Tue Jan 29 03:45:21 2013 @@ -0,0 +1 @@ +/hadoop/common/trunk:1161777,1161781,1162188,1162421,1162491,1162499,1162613,1162928,1162954,1162979,1163050,1163069,1163490,1163768,1163852,1163858,1163981,1164255,1164301,1164339,1166009,1166402,1167001,1167383,1167662,1170085,1170379,1170459,1171297,1172916,1173402,1176550,1177487,1177531,1177859,1177864,1182189,1182205,1182214,1189613,1189932,1189982,1195575,1196113,1196129,1204114,1204117,1204122,1204124,1204129,1204131,1204177,1204370,1204376,1204388,1205260,1205697,1206786,1206830,1207694,1208153,1208313,1212021,1212062,1212073,1212084,1213537,1213586,1213592-1213593,1213954,1214046,1220510,1221348,1225114,1225192,1225456,1225489,1225591,1226211,1226239,1226350,1227091,1227165,1227423,1227964,1229347,1230398,1231569,1231572,1231627,1231640,1233605,1234555,1235135,1235137,1235956,1236456,1239752,1240897,1240928,1243065,1243104,1244766,1245751,1245762,1293419,1304099,1351818,1373683,1382409
svn commit: r1439750 - /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
Author: harsh Date: Tue Jan 29 05:36:45 2013 New Revision: 1439750 URL: http://svn.apache.org/viewvc?rev=1439750view=rev Log: Revert HADOOP-9241 properly this time. Left the core-default.xml in previous commit. Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml?rev=1439750r1=1439749r2=1439750view=diff == --- hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml (original) +++ hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml Tue Jan 29 05:36:45 2013 @@ -440,18 +440,6 @@ /property property - namefs.du.interval/name - value6/value - descriptionFile space usage statistics refresh interval in msec./description -/property - -property - namefs.du.interval/name - value6/value - descriptionFile space usage statistics refresh interval in msec./description -/property - -property namefs.s3.block.size/name value67108864/value descriptionBlock size to use when writing files to S3./description