svn commit: r1439293 - /hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html

2013-01-28 Thread mattf
Author: mattf
Date: Mon Jan 28 08:07:15 2013
New Revision: 1439293

URL: http://svn.apache.org/viewvc?rev=1439293view=rev
Log:
Hadoop 1.1.2-rc3 release candidate, with corrected release notes

Modified:
hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html

Modified: hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html
URL: 
http://svn.apache.org/viewvc/hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html?rev=1439293r1=1439292r2=1439293view=diff
==
--- hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html (original)
+++ hadoop/common/tags/release-1.1.2-rc3/src/docs/releasenotes.html Mon Jan 28 
08:07:15 2013
@@ -54,11 +54,26 @@
 h3Other Jiras (describe bug fixes and minor changes)/h3
 ul
 
+li a 
href=https://issues.apache.org/jira/browse/HADOOP-8418;HADOOP-8418/a.
+ Major bug reported by vicaya and fixed by crystal_gaoyu (security)br
+ bFix UGI for IBM JDK running on Windows/bbr
+ blockquoteThe login module and user principal classes are different for 
32 and 64-bit Windows in IBM J9 JDK 6 SR10. Hadoop 1.0.3 does not run on either 
because it uses the 32 bit login module and the 64-bit user principal 
class./blockquote/li
+
+li a 
href=https://issues.apache.org/jira/browse/HADOOP-8561;HADOOP-8561/a.
+ Major improvement reported by vicaya and fixed by crystal_gaoyu 
(security)br
+ bIntroduce HADOOP_PROXY_USER for secure impersonation in child hadoop 
client processes/bbr
+ blockquoteTo solve the problem for an authenticated user to type hadoop 
shell commands in a web console, we can introduce an HADOOP_PROXY_USER 
environment variable to allow proper impersonation in the child hadoop client 
processes./blockquote/li
+
 li a 
href=https://issues.apache.org/jira/browse/HADOOP-8880;HADOOP-8880/a.
  Major bug reported by gkesavan and fixed by gkesavan br
  bMissing jersey jars as dependency in the pom causes hive tests to 
fail/bbr
  blockquoteivy.xml has the dependency included where as the same 
dependency is not updated in the pom template./blockquote/li
 
+li a 
href=https://issues.apache.org/jira/browse/HADOOP-9051;HADOOP-9051/a.
+ Minor test reported by mg...@vmware.com and fixed by vicaya (test)br
+ bÒant testÓ will build failed for  trying to delete a file/bbr
+ blockquoteRun quot;ant testquot; on branch-1 of 
hadoop-common.brWhen the test process reach 
quot;test-core-excluding-commit-and-smokequot;brbrIt will invoke the 
quot;macro-test-runnerquot; to clear and rebuild the test 
environment.brThen the ant task command  lt;delete 
dir=quot;@{test.dir}/logsquot; /gt;brfailed for trying to delete an 
non-existent file.brbrfollowing is the test result 
logs:brtest-core-excluding-commit-and-smoke:br   [delete] Deleting: 
/home/jdu/bdc/hadoop-topology-branch1-new/hadoop-common/build/test/testsfailedbr
   [delete] Dele.../blockquote/li
+
 li a 
href=https://issues.apache.org/jira/browse/HADOOP-9111;HADOOP-9111/a.
  Minor improvement reported by jingzhao and fixed by jingzhao (test)br
  bFix failed testcases with @ignore annotation In branch-1/bbr
@@ -84,6 +99,21 @@
  bquot;Text File Busyquot; errors launching MR tasks/bbr
  blockquoteSome very small percentage of tasks fail with a quot;Text 
file busyquot; error.brbrThe following was the original 
diagnosis:br{quote}brOur use of PrintWriter in TaskController.writeCommand 
is unsafe, since that class swallows all IO exceptions. Weapos;re not 
currently checking for errors, which Iapos;m seeing result in occasional task 
failures with the message quot;Text file busyquot; - assumedly because the 
close() call is failing silently for some reason.br{quote}br.. but turned 
out to be another issue as well (see below)/blockquote/li
 
+li a 
href=https://issues.apache.org/jira/browse/MAPREDUCE-4272;MAPREDUCE-4272/a.
+ Major bug reported by vicaya and fixed by crystal_gaoyu (task)br
+ bSortedRanges.Range#compareTo is not spec compliant/bbr
+ blockquoteSortedRanges.Range#compareTo does not satisfy the requirement 
of Comparable#compareTo, where quot;the implementor must ensure 
{noformat}sgn(x.compareTo(y)) == -sgn(y.compareTo(x)){noformat} for all x and 
y.quot;brbrThis is manifested as TestStreamingBadRecords failures in 
alternative JDKs./blockquote/li
+
+li a 
href=https://issues.apache.org/jira/browse/MAPREDUCE-4396;MAPREDUCE-4396/a.
+ Minor bug reported by vicaya and fixed by crystal_gaoyu (client)br
+ bMake LocalJobRunner work with private distributed cache/bbr
+ blockquoteSome LocalJobRunner related unit tests fails if user 
directory permission and/or umask is too restrictive./blockquote/li
+
+li a 
href=https://issues.apache.org/jira/browse/MAPREDUCE-4397;MAPREDUCE-4397/a.
+ Major improvement reported by vicaya and fixed by crystal_gaoyu 
(task-controller)br
+ bIntroduce HADOOP_SECURITY_CONF_DIR for task-controller/bbr
+ blockquoteThe 

svn commit: r1439481 - /hadoop/common/branches/branch-1.1/CHANGES.txt

2013-01-28 Thread mattf
Author: mattf
Date: Mon Jan 28 16:33:19 2013
New Revision: 1439481

URL: http://svn.apache.org/viewvc?rev=1439481view=rev
Log:
update release date in CHANGES.txt for release candidate 1.1.2-rc4

Modified:
hadoop/common/branches/branch-1.1/CHANGES.txt

Modified: hadoop/common/branches/branch-1.1/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-1.1/CHANGES.txt?rev=1439481r1=1439480r2=1439481view=diff
==
--- hadoop/common/branches/branch-1.1/CHANGES.txt (original)
+++ hadoop/common/branches/branch-1.1/CHANGES.txt Mon Jan 28 16:33:19 2013
@@ -1,6 +1,6 @@
 Hadoop Change Log
 
-Release 1.1.2 - 2012.12.07
+Release 1.1.2 - 2013.01.27
 
   INCOMPATIBLE CHANGES
 




svn commit: r1439531 - /hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt

2013-01-28 Thread suresh
Author: suresh
Date: Mon Jan 28 17:59:12 2013
New Revision: 1439531

URL: http://svn.apache.org/viewvc?rev=1439531view=rev
Log:
HADOOP-9247. Merge r1438698 from trunk

Modified:

hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt

Modified: 
hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439531r1=1439530r2=1439531view=diff
==
--- 
hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt 
(original)
+++ 
hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt 
Mon Jan 28 17:59:12 2013
@@ -134,6 +134,9 @@ Release 2.0.3-alpha - Unreleased 
 
 HADOOP-9241. DU refresh interval is not configurable (harsh)
 
+HADOOP-9247. Parametrize Clover generateXxx properties to make them
+re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh)
+
   OPTIMIZATIONS
 
 HADOOP-8866. SampleQuantiles#query is O(N^2) instead of O(N). (Andrew Wang




svn commit: r1439531 - /hadoop/common/branches/branch-2/pom.xml

2013-01-28 Thread suresh
Author: suresh
Date: Mon Jan 28 17:59:12 2013
New Revision: 1439531

URL: http://svn.apache.org/viewvc?rev=1439531view=rev
Log:
HADOOP-9247. Merge r1438698 from trunk

Modified:
hadoop/common/branches/branch-2/pom.xml

Modified: hadoop/common/branches/branch-2/pom.xml
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/pom.xml?rev=1439531r1=1439530r2=1439531view=diff
==
--- hadoop/common/branches/branch-2/pom.xml (original)
+++ hadoop/common/branches/branch-2/pom.xml Mon Jan 28 17:59:12 2013
@@ -409,6 +409,18 @@ xsi:schemaLocation=http://maven.apache.
   properties
 
cloverLicenseLocation${user.home}/.clover.license/cloverLicenseLocation
 
cloverDatabase${project.build.directory}/clover/hadoop-coverage.db/cloverDatabase
+!-- NB: This additional parametrization is made in order 
+ to be able to re-define these properties with -Dk=v maven 
options.
+ By some reason the expressions declared in clover 
+ docs like ${maven.clover.generateHtml} do not work in that way. 
+ However, the below properties are confirmed to work: e.g. 
+ -DcloverGenHtml=false switches off the Html generation.  
+ The default values provided here exactly correspond to Clover 
defaults, so
+ the behavior is 100% backwards compatible. --
+cloverAlwaysReporttrue/cloverAlwaysReport
+cloverGenHtmltrue/cloverGenHtml
+cloverGenXmltrue/cloverGenXml
+cloverGenHistoricalfalse/cloverGenHistorical
   /properties
   build
 plugins
@@ -422,8 +434,10 @@ xsi:schemaLocation=http://maven.apache.
   cloverDatabase${cloverDatabase}/cloverDatabase
   targetPercentage50%/targetPercentage
   
outputDirectory${project.build.directory}/clover/outputDirectory
-  generateHtmltrue/generateHtml
-  generateXmltrue/generateXml
+  alwaysReport${cloverAlwaysReport}/alwaysReport
+  generateHtml${cloverGenHtml}/generateHtml
+  generateXml${cloverGenXml}/generateXml
+  generateHistorical${cloverGenHistorical}/generateHistorical
 /configuration
 executions
   execution




svn commit: r1439533 - /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt

2013-01-28 Thread suresh
Author: suresh
Date: Mon Jan 28 17:59:37 2013
New Revision: 1439533

URL: http://svn.apache.org/viewvc?rev=1439533view=rev
Log:
HADOOP-9247. Merge r1438698 from trunk

Modified:

hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt

Modified: 
hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439533r1=1439532r2=1439533view=diff
==
--- 
hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
 (original)
+++ 
hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
 Mon Jan 28 17:59:37 2013
@@ -54,6 +54,9 @@ Release 0.23.6 - UNRELEASED
 HADOOP-9217. Print thread dumps when hadoop-common tests fail.
 (Andrey Klochkov via suresh)
 
+HADOOP-9247. Parametrize Clover generateXxx properties to make them
+re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh)
+
   OPTIMIZATIONS
 
   BUG FIXES




svn commit: r1439533 - /hadoop/common/branches/branch-0.23/pom.xml

2013-01-28 Thread suresh
Author: suresh
Date: Mon Jan 28 17:59:37 2013
New Revision: 1439533

URL: http://svn.apache.org/viewvc?rev=1439533view=rev
Log:
HADOOP-9247. Merge r1438698 from trunk

Modified:
hadoop/common/branches/branch-0.23/pom.xml

Modified: hadoop/common/branches/branch-0.23/pom.xml
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/pom.xml?rev=1439533r1=1439532r2=1439533view=diff
==
--- hadoop/common/branches/branch-0.23/pom.xml (original)
+++ hadoop/common/branches/branch-0.23/pom.xml Mon Jan 28 17:59:37 2013
@@ -392,6 +392,18 @@
   properties
 
cloverLicenseLocation${user.home}/.clover.license/cloverLicenseLocation
 
cloverDatabase${project.build.directory}/clover/hadoop-coverage.db/cloverDatabase
+!-- NB: This additional parametrization is made in order 
+ to be able to re-define these properties with -Dk=v maven 
options.
+ By some reason the expressions declared in clover 
+ docs like ${maven.clover.generateHtml} do not work in that way. 
+ However, the below properties are confirmed to work: e.g. 
+ -DcloverGenHtml=false switches off the Html generation.  
+ The default values provided here exactly correspond to Clover 
defaults, so
+ the behavior is 100% backwards compatible. --
+cloverAlwaysReporttrue/cloverAlwaysReport
+cloverGenHtmltrue/cloverGenHtml
+cloverGenXmltrue/cloverGenXml
+cloverGenHistoricalfalse/cloverGenHistorical
   /properties
   build
 plugins
@@ -405,8 +417,10 @@
   cloverDatabase${cloverDatabase}/cloverDatabase
   targetPercentage50%/targetPercentage
   
outputDirectory${project.build.directory}/clover/outputDirectory
-  generateHtmltrue/generateHtml
-  generateXmltrue/generateXml
+  alwaysReport${cloverAlwaysReport}/alwaysReport
+  generateHtml${cloverGenHtml}/generateHtml
+  generateXml${cloverGenXml}/generateXml
+  generateHistorical${cloverGenHistorical}/generateHistorical
 /configuration
 executions
   execution




svn commit: r1439539 - /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

2013-01-28 Thread suresh
Author: suresh
Date: Mon Jan 28 18:05:31 2013
New Revision: 1439539

URL: http://svn.apache.org/viewvc?rev=1439539view=rev
Log:
Move HADOOP-9247 to release 0.23.7 section in CHANGES.txt

Modified:
hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439539r1=1439538r2=1439539view=diff
==
--- hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt 
(original)
+++ hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 
28 18:05:31 2013
@@ -152,9 +152,6 @@ Trunk (Unreleased)
 HADOOP-9245. mvn clean without running mvn install before fails.
 (Karthik Kambatla via suresh)
 
-HADOOP-9247. Parametrize Clover generateXxx properties to make them
-re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh)
-
   BUG FIXES
 
 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang)
@@ -1301,6 +1298,10 @@ Release 0.23.6 - UNRELEASED
 HADOOP-9242. Duplicate surefire plugin config in hadoop-common.
 (Andrey Klochkov via suresh)
 
+HADOOP-9247. Parametrize Clover generateXxx properties to make them
+re-definable via -D in mvn calls. (Ivan A. Veselovsky via suresh)
+
+
   OPTIMIZATIONS
 
   BUG FIXES




svn commit: r1439588 - /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:18:10 2013
New Revision: 1439588

URL: http://svn.apache.org/viewvc?rev=1439588view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:
hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439588r1=1439587r2=1439588view=diff
==
--- hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt 
(original)
+++ hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 
28 19:18:10 2013
@@ -1319,6 +1319,8 @@ Release 0.23.6 - UNRELEASED
 
 HADOOP-9097. Maven RAT plugin is not checking all source files (tgraves)
 
+HADOOP-9255. relnotes.py missing last jira (tgraves)
+
 Release 0.23.5 - 2012-11-28
 
 




svn commit: r1439588 - /hadoop/common/trunk/dev-support/relnotes.py

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:18:10 2013
New Revision: 1439588

URL: http://svn.apache.org/viewvc?rev=1439588view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:
hadoop/common/trunk/dev-support/relnotes.py

Modified: hadoop/common/trunk/dev-support/relnotes.py
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/dev-support/relnotes.py?rev=1439588r1=1439587r2=1439588view=diff
==
--- hadoop/common/trunk/dev-support/relnotes.py (original)
+++ hadoop/common/trunk/dev-support/relnotes.py Mon Jan 28 19:18:10 2013
@@ -155,7 +155,7 @@ class JiraIter:
 end=1
 count=100
 while (at  end):
-  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at+1, 'maxResults':count})
+  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at, 'maxResults':count})
   resp = 
urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params)
   data = json.loads(resp.read())
   if (data.has_key('errorMessages')):




svn commit: r1439589 - /hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:18:14 2013
New Revision: 1439589

URL: http://svn.apache.org/viewvc?rev=1439589view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:
hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py

Modified: hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py?rev=1439589r1=1439588r2=1439589view=diff
==
--- hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py (original)
+++ hadoop/common/branches/branch-0.23.6/dev-support/relnotes.py Mon Jan 28 
19:18:14 2013
@@ -155,7 +155,7 @@ class JiraIter:
 end=1
 count=100
 while (at  end):
-  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at+1, 'maxResults':count})
+  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at, 'maxResults':count})
   resp = 
urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params)
   data = json.loads(resp.read())
   if (data.has_key('errorMessages')):




svn commit: r1439589 - /hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:18:14 2013
New Revision: 1439589

URL: http://svn.apache.org/viewvc?rev=1439589view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:

hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt

Modified: 
hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439589r1=1439588r2=1439589view=diff
==
--- 
hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt
 (original)
+++ 
hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/CHANGES.txt
 Mon Jan 28 19:18:14 2013
@@ -55,6 +55,8 @@ Release 0.23.6 - UNRELEASED
 HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool (Liang 
 Xie via tgraves)
 
+HADOOP-9255. relnotes.py missing last jira (tgraves)
+
 Release 0.23.5 - 2012-11-28
 
   INCOMPATIBLE CHANGES




svn commit: r1439601 - /hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:55:33 2013
New Revision: 1439601

URL: http://svn.apache.org/viewvc?rev=1439601view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:

hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt

Modified: 
hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439601r1=1439600r2=1439601view=diff
==
--- 
hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt 
(original)
+++ 
hadoop/common/branches/branch-2/hadoop-common-project/hadoop-common/CHANGES.txt 
Mon Jan 28 19:55:33 2013
@@ -1002,6 +1002,8 @@ Release 0.23.6 - UNRELEASED
 
 HADOOP-9097. Maven RAT plugin is not checking all source files (tgraves)
 
+HADOOP-9255. relnotes.py missing last jira (tgraves)
+
 Release 0.23.5 - 2012-11-28
 
   INCOMPATIBLE CHANGES




svn commit: r1439601 - /hadoop/common/branches/branch-2/dev-support/relnotes.py

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:55:33 2013
New Revision: 1439601

URL: http://svn.apache.org/viewvc?rev=1439601view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:
hadoop/common/branches/branch-2/dev-support/relnotes.py

Modified: hadoop/common/branches/branch-2/dev-support/relnotes.py
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/dev-support/relnotes.py?rev=1439601r1=1439600r2=1439601view=diff
==
--- hadoop/common/branches/branch-2/dev-support/relnotes.py (original)
+++ hadoop/common/branches/branch-2/dev-support/relnotes.py Mon Jan 28 19:55:33 
2013
@@ -155,7 +155,7 @@ class JiraIter:
 end=1
 count=100
 while (at  end):
-  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at+1, 'maxResults':count})
+  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at, 'maxResults':count})
   resp = 
urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params)
   data = json.loads(resp.read())
   if (data.has_key('errorMessages')):




svn commit: r1439604 - /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:58:26 2013
New Revision: 1439604

URL: http://svn.apache.org/viewvc?rev=1439604view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:

hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt

Modified: 
hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439604r1=1439603r2=1439604view=diff
==
--- 
hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
 (original)
+++ 
hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
 Mon Jan 28 19:58:26 2013
@@ -91,6 +91,8 @@ Release 0.23.6 - UNRELEASED
 HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool (Liang 
 Xie via tgraves)
 
+HADOOP-9255. relnotes.py missing last jira (tgraves)
+
 Release 0.23.5 - 2012-11-28
 
   INCOMPATIBLE CHANGES




svn commit: r1439604 - /hadoop/common/branches/branch-0.23/dev-support/relnotes.py

2013-01-28 Thread tgraves
Author: tgraves
Date: Mon Jan 28 19:58:26 2013
New Revision: 1439604

URL: http://svn.apache.org/viewvc?rev=1439604view=rev
Log:
HADOOP-9255. relnotes.py missing last jira (tgraves)

Modified:
hadoop/common/branches/branch-0.23/dev-support/relnotes.py

Modified: hadoop/common/branches/branch-0.23/dev-support/relnotes.py
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/dev-support/relnotes.py?rev=1439604r1=1439603r2=1439604view=diff
==
--- hadoop/common/branches/branch-0.23/dev-support/relnotes.py (original)
+++ hadoop/common/branches/branch-0.23/dev-support/relnotes.py Mon Jan 28 
19:58:26 2013
@@ -155,7 +155,7 @@ class JiraIter:
 end=1
 count=100
 while (at  end):
-  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at+1, 'maxResults':count})
+  params = urllib.urlencode({'jql': project in 
(HADOOP,HDFS,MAPREDUCE,YARN) and fixVersion in ('+' , '.join(versions)+') 
and resolution = Fixed, 'startAt':at, 'maxResults':count})
   resp = 
urllib.urlopen(https://issues.apache.org/jira/rest/api/2/search?%s%params)
   data = json.loads(resp.read())
   if (data.has_key('errorMessages')):




svn commit: r1439605 - /hadoop/common/tags/release-1.1.2-rc4/

2013-01-28 Thread mattf
Author: mattf
Date: Mon Jan 28 20:06:54 2013
New Revision: 1439605

URL: http://svn.apache.org/viewvc?rev=1439605view=rev
Log:
Hadoop 1.1.2-rc4 release candidate.

Added:
hadoop/common/tags/release-1.1.2-rc4/   (props changed)
  - copied from r1439604, hadoop/common/branches/branch-1.1/

Propchange: hadoop/common/tags/release-1.1.2-rc4/
--
--- svn:ignore (added)
+++ svn:ignore Mon Jan 28 20:06:54 2013
@@ -0,0 +1,9 @@
+build
+build.properties
+logs
+.classpath
+.git
+.project
+.settings
+.launches
+.externalToolBuilders

Propchange: hadoop/common/tags/release-1.1.2-rc4/
--
--- svn:mergeinfo (added)
+++ svn:mergeinfo Mon Jan 28 20:06:54 2013
@@ -0,0 +1,9 @@
+/hadoop/common/branches/branch-0.20:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225
+/hadoop/common/branches/branch-0.20-append:955380,955398,955448,956329
+/hadoop/common/branches/branch-0.20-security-203:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115
+/hadoop/common/branches/branch-0.20-security-204:1128390,1147228,1148069,1149316,1154413
+/hadoop/common/branches/branch-0.20-security-205:1174370,1174917,1176042,1176248,1176638,1176645,1202378
+/hadoop/common/branches/branch-1:1343738,1343992,1346167,1353893,1353928,1354390,1354773,1354798,1357994,1360011,1360940,1360944,1366295,1374605,1379653,1384742,1392637,1399786,1402728,1407625,1408450,1417238
+/hadoop/common/branches/branch-1.0:1214410,1291091,1330040,1334877
+/hadoop/core/branches/branch-0.19:713112
+/hadoop/core/trunk:727001,727117,727191,727212,727217,727228,727255,727869,728187,729052,729987,732385,732572,732613,732777,732838,732869,733887,734870,734916,736426,738328,738697,740077,740157,741703,741762,743745,743816,743892,744894,745180,746010,746206,746227,746233,746274,746338,746902-746903,746925,746944,746968,746970,747279,747289,747802,748084,748090,748783,749262,749318,749863,750533,752073,752609,752834,752836,752913,752932,753112-753113,753346,754645,754847,754927,755035,755226,755348,755370,755418,755426,755790,755905,755938,755960,755986,755998,756352,757448,757624,757849,758156,758180,759398,759932,760502,760783,761046,761482,761632,762216,762879,763107,763502,764967,765016,765809,765951,771607,771661,772844,772876,772884,772920,773889,776638,778962,778966,779893,781720,784661,785046,785569




svn commit: r1439620 - /hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java

2013-01-28 Thread jlowe
Author: jlowe
Date: Mon Jan 28 20:52:14 2013
New Revision: 1439620

URL: http://svn.apache.org/viewvc?rev=1439620view=rev
Log:
HADOOP-9246. Execution phase for hadoop-maven-plugin should be 
process-resources. Contributed by Karthik Kambatla and Chris Nauroth

Modified:

hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java

Modified: 
hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java?rev=1439620r1=1439619r2=1439620view=diff
==
--- 
hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java
 (original)
+++ 
hadoop/common/trunk/hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java
 Mon Jan 28 20:52:14 2013
@@ -46,7 +46,7 @@ import java.util.TimeZone;
  * build.  The version information includes build time, SCM URI, SCM branch, 
SCM
  * commit, and an MD5 checksum of the contents of the files in the codebase.
  */
-@Mojo(name=version-info, defaultPhase=LifecyclePhase.INITIALIZE)
+@Mojo(name=version-info)
 public class VersionInfoMojo extends AbstractMojo {
 
   @Parameter(defaultValue=${project})




svn commit: r1439620 - in /hadoop/common/trunk/hadoop-common-project/hadoop-common: CHANGES.txt pom.xml

2013-01-28 Thread jlowe
Author: jlowe
Date: Mon Jan 28 20:52:14 2013
New Revision: 1439620

URL: http://svn.apache.org/viewvc?rev=1439620view=rev
Log:
HADOOP-9246. Execution phase for hadoop-maven-plugin should be 
process-resources. Contributed by Karthik Kambatla and Chris Nauroth

Modified:
hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml

Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1439620r1=1439619r2=1439620view=diff
==
--- hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt 
(original)
+++ hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Mon Jan 
28 20:52:14 2013
@@ -328,6 +328,9 @@ Trunk (Unreleased)
 
 HADOOP-8589 ViewFs tests fail when tests and home dirs are nested (sanjay 
Radia)
 
+HADOOP-9246 Execution phase for hadoop-maven-plugin should be
+process-resources (Karthik Kambatla and Chris Nauroth via jlowe)
+
 Release 2.0.3-alpha - Unreleased 
 
   INCOMPATIBLE CHANGES

Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml?rev=1439620r1=1439619r2=1439620view=diff
==
--- hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml (original)
+++ hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml Mon Jan 28 
20:52:14 2013
@@ -274,7 +274,7 @@
 executions
   execution
 idversion-info/id
-phasecompile/phase
+phasegenerate-resources/phase
 goals
   goalversion-info/goal
 /goals




[Hadoop Wiki] Update of AmazonS3 by SteveLoughran

2013-01-28 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Hadoop Wiki for change 
notification.

The AmazonS3 page has been changed by SteveLoughran:
http://wiki.apache.org/hadoop/AmazonS3?action=diffrev1=13rev2=14

Comment:
remind people to keep their access key safe and out of SCM  logs

  
   S3 Native FileSystem (URI scheme: s3n)::
   A native filesystem for reading and writing regular files on S3. The 
advantage of this filesystem is that you can access files on S3 that were 
written with other tools. Conversely, other tools can access files written 
using Hadoop. The disadvantage is the 5GB limit on file size imposed by S3. For 
this reason it is not suitable as a replacement for HDFS (which has support for 
very large files).
-  
+ 
   S3 Block FileSystem (URI scheme: s3)::
   A block-based filesystem backed by S3. Files are stored as blocks, just like 
they are in HDFS. This permits efficient implementation of renames. This 
filesystem requires you to dedicate a bucket for the filesystem - you should 
not use an existing bucket containing files, or write other files to the same 
bucket. The files stored by this filesystem can be larger than 5GB, but they 
are not interoperable with other S3 tools.
  
  There are two ways that S3 can be used with Hadoop's Map/Reduce, either as a 
replacement for HDFS using the S3 block filesystem
  (i.e. using it as a reliable distributed filesystem with support for very 
large files)
  or as a convenient repository for data input to and output from MapReduce, 
using either S3 filesystem. In the second case
- HDFS is still used for the Map/Reduce phase. Note also, that by using S3 as 
an input to MapReduce you lose the data locality optimization, which may be 
significant. 
+ HDFS is still used for the Map/Reduce phase. Note also, that by using S3 as 
an input to MapReduce you lose the data locality optimization, which may be 
significant.
  
  = History =
   * The S3 block filesystem was introduced in Hadoop 0.10.0 
([[http://issues.apache.org/jira/browse/HADOOP-574|HADOOP-574]]), but this had 
a few bugs so you should use Hadoop 0.10.1 or later.
@@ -79, +79 @@

  bin/start-mapred.sh
  }}}
  
+ = Security =
+ 
+ Your Amazon Secret Access Key is that: secret. If it gets known you have to 
go to the [[https://portal.aws.amazon.com/gp/aws/securityCredentials|Security 
Credentials]] page and revoke it. Try and avoid printing it in logs, or 
checking the XML configuration files into revision control.
  
  = Running bulk copies in and out of S3 =
  
@@ -105, +108 @@

  put: Input stream is not repeatable as 1048576 bytes have been written, 
exceeding the available buffer size of 131072
  }}}
  
- See [[https://issues.apache.org/jira/browse/HADOOP-882|HADOOP-882]] for 
discussion of the above issues and workarounds/fixes.   
+ See [[https://issues.apache.org/jira/browse/HADOOP-882|HADOOP-882]] for 
discussion of the above issues and workarounds/fixes.
  
  = S3 Block FileSystem Version Numbers =
  From release 0.13.0 the S3 block filesystem stores a version number in the 
file metadata. This table lists the first Hadoop release for each version 
number.


svn commit: r1439714 - in /hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen: Hadoop20JHParser.java Job20LineHistoryEventEmitter.java TaskAttempt20LineEventEmit

2013-01-28 Thread sseth
Author: sseth
Date: Tue Jan 29 00:21:58 2013
New Revision: 1439714

URL: http://svn.apache.org/viewvc?rev=1439714view=rev
Log:
MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory 
logs. Contributed by Zhijie Shen

Modified:

hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java

hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java

hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java

Modified: 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java?rev=1439714r1=1439713r2=1439714view=diff
==
--- 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java
 (original)
+++ 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java
 Tue Jan 29 00:21:58 2013
@@ -67,6 +67,11 @@ public class Hadoop20JHParser implements
 reader = new LineReader(input);
   }
 
+  public Hadoop20JHParser(LineReader reader) throws IOException {
+super();
+this.reader = reader;
+  }
+
   MapString, HistoryEventEmitter liveEmitters =
   new HashMapString, HistoryEventEmitter();
   QueueHistoryEvent remainingEvents = new LinkedListHistoryEvent();

Modified: 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java?rev=1439714r1=1439713r2=1439714view=diff
==
--- 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java
 (original)
+++ 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java
 Tue Jan 29 00:21:58 2013
@@ -76,6 +76,23 @@ public class Job20LineHistoryEventEmitte
   }
   String jobName = line.get(JOBNAME);
   String jobQueueName = line.get(JOB_QUEUE);// could be null
+  String workflowId = line.get(WORKFLOW_ID);
+  if (workflowId == null) {
+workflowId = ;
+  }
+  String workflowName = line.get(WORKFLOW_NAME);
+  if (workflowName == null) {
+workflowName = ;
+  }
+  String workflowNodeName = line.get(WORKFLOW_NODE_NAME);
+  if (workflowNodeName == null) {
+workflowNodeName = ;
+  }
+  String workflowAdjacencies = line.get(WORKFLOW_ADJACENCIES);
+  if (workflowAdjacencies == null) {
+workflowAdjacencies = ;
+  }
+  
 
   if (submitTime != null) {
 Job20LineHistoryEventEmitter that =
@@ -86,7 +103,8 @@ public class Job20LineHistoryEventEmitte
 MapJobACL, AccessControlList jobACLs =
   new HashMapJobACL, AccessControlList();
 return new JobSubmittedEvent(jobID, jobName, user,
-that.originalSubmitTime, jobConf, jobACLs, jobQueueName);
+that.originalSubmitTime, jobConf, jobACLs, jobQueueName,
+workflowId, workflowName, workflowNodeName, workflowAdjacencies);
   }
 
   return null;

Modified: 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java?rev=1439714r1=1439713r2=1439714view=diff
==
--- 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java
 (original)
+++ 
hadoop/common/trunk/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java
 Tue Jan 29 00:21:58 2013
@@ -65,6 +65,14 @@ public abstract class TaskAttempt20LineE
   String taskType = line.get(TASK_TYPE);
   String trackerName = line.get(TRACKER_NAME);
   String httpPort = line.get(HTTP_PORT);
+  String locality = line.get(LOCALITY);
+  if (locality == null) {
+locality = ;
+  }
+  String avataar = line.get(AVATAAR);
+  if (avataar == null) {
+avataar = ;
+  }
 
   if (startTime != null  taskType != null) {
 TaskAttempt20LineEventEmitter that =
@@ -79,7 +87,8 @@ public abstract class TaskAttempt20LineE
 .parseInt(httpPort);
 
 return 

svn commit: r1439715 - in /hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen: Hadoop20JHParser.java Job20LineHistoryEventEmitter.java TaskAttempt20L

2013-01-28 Thread sseth
Author: sseth
Date: Tue Jan 29 00:23:27 2013
New Revision: 1439715

URL: http://svn.apache.org/viewvc?rev=1439715view=rev
Log:
merge MAPREDUCE-4838 from trunk. Add additional fields like Locality, Avataar 
to the JobHistory logs. Contributed by Zhijie Shen

Modified:

hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java

hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java

hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java

Modified: 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java?rev=1439715r1=1439714r2=1439715view=diff
==
--- 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java
 (original)
+++ 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Hadoop20JHParser.java
 Tue Jan 29 00:23:27 2013
@@ -67,6 +67,11 @@ public class Hadoop20JHParser implements
 reader = new LineReader(input);
   }
 
+  public Hadoop20JHParser(LineReader reader) throws IOException {
+super();
+this.reader = reader;
+  }
+
   MapString, HistoryEventEmitter liveEmitters =
   new HashMapString, HistoryEventEmitter();
   QueueHistoryEvent remainingEvents = new LinkedListHistoryEvent();

Modified: 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java?rev=1439715r1=1439714r2=1439715view=diff
==
--- 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java
 (original)
+++ 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/Job20LineHistoryEventEmitter.java
 Tue Jan 29 00:23:27 2013
@@ -76,6 +76,23 @@ public class Job20LineHistoryEventEmitte
   }
   String jobName = line.get(JOBNAME);
   String jobQueueName = line.get(JOB_QUEUE);// could be null
+  String workflowId = line.get(WORKFLOW_ID);
+  if (workflowId == null) {
+workflowId = ;
+  }
+  String workflowName = line.get(WORKFLOW_NAME);
+  if (workflowName == null) {
+workflowName = ;
+  }
+  String workflowNodeName = line.get(WORKFLOW_NODE_NAME);
+  if (workflowNodeName == null) {
+workflowNodeName = ;
+  }
+  String workflowAdjacencies = line.get(WORKFLOW_ADJACENCIES);
+  if (workflowAdjacencies == null) {
+workflowAdjacencies = ;
+  }
+  
 
   if (submitTime != null) {
 Job20LineHistoryEventEmitter that =
@@ -86,7 +103,8 @@ public class Job20LineHistoryEventEmitte
 MapJobACL, AccessControlList jobACLs =
   new HashMapJobACL, AccessControlList();
 return new JobSubmittedEvent(jobID, jobName, user,
-that.originalSubmitTime, jobConf, jobACLs, jobQueueName);
+that.originalSubmitTime, jobConf, jobACLs, jobQueueName,
+workflowId, workflowName, workflowNodeName, workflowAdjacencies);
   }
 
   return null;

Modified: 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java?rev=1439715r1=1439714r2=1439715view=diff
==
--- 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java
 (original)
+++ 
hadoop/common/branches/branch-2/hadoop-tools/hadoop-rumen/src/main/java/org/apache/hadoop/tools/rumen/TaskAttempt20LineEventEmitter.java
 Tue Jan 29 00:23:27 2013
@@ -65,6 +65,14 @@ public abstract class TaskAttempt20LineE
   String taskType = line.get(TASK_TYPE);
   String trackerName = line.get(TRACKER_NAME);
   String httpPort = line.get(HTTP_PORT);
+  String locality = line.get(LOCALITY);
+  if (locality == null) {
+locality = ;
+  }
+  String avataar = line.get(AVATAAR);
+  if (avataar == null) {
+avataar = ;
+  }
 
   if 

svn commit: r1439737 - /hadoop/common/tags/release-0.23.6-rc1/

2013-01-28 Thread tgraves
Author: tgraves
Date: Tue Jan 29 03:35:19 2013
New Revision: 1439737

URL: http://svn.apache.org/viewvc?rev=1439737view=rev
Log:
Hadoop 0.23.6-rc1 release

Added:
hadoop/common/tags/release-0.23.6-rc1/   (props changed)
  - copied from r1439736, hadoop/common/branches/branch-0.23.6/

Propchange: hadoop/common/tags/release-0.23.6-rc1/
--
--- svn:ignore (added)
+++ svn:ignore Tue Jan 29 03:35:19 2013
@@ -0,0 +1,5 @@
+.classpath
+.git
+.project
+.settings
+target

Propchange: hadoop/common/tags/release-0.23.6-rc1/
--
--- svn:mergeinfo (added)
+++ svn:mergeinfo Tue Jan 29 03:35:19 2013
@@ -0,0 +1 @@
+/hadoop/common/trunk:1161777,1161781,1162188,1162421,1162491,1162499,1162613,1162928,1162954,1162979,1163050,1163069,1163490,1163768,1163852,1163858,1163981,1164255,1164301,1164339,1166009,1166402,1167001,1167383,1167662,1170085,1170379,1170459,1171297,1172916,1173402,1176550,1177487,1177531,1177859,1177864,1182189,1182205,1182214,1189613,1189932,1189982,1195575,1196113,1196129,1204114,1204117,1204122,1204124,1204129,1204131,1204177,1204370,1204376,1204388,1205260,1205697,1206786,1206830,1207694,1208153,1208313,1212021,1212062,1212073,1212084,1213537,1213586,1213592-1213593,1213954,1214046,1220510,1221348,1225114,1225192,1225456,1225489,1225591,1226211,1226239,1226350,1227091,1227165,1227423,1227964,1229347,1230398,1231569,1231572,1231627,1231640,1233605,1234555,1235135,1235137,1235956,1236456,1239752,1240897,1240928,1243065,1243104,1244766,1245751,1245762,1293419,1304099,1351818,1373683,1382409




svn commit: r1439738 - /hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html

2013-01-28 Thread tgraves
Author: tgraves
Date: Tue Jan 29 03:37:03 2013
New Revision: 1439738

URL: http://svn.apache.org/viewvc?rev=1439738view=rev
Log:
Preparing for release 0.23.6 rc1

Modified:

hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html

Modified: 
hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
URL: 
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html?rev=1439738r1=1439737r2=1439738view=diff
==
--- 
hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
 (original)
+++ 
hadoop/common/branches/branch-0.23.6/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
 Tue Jan 29 03:37:03 2013
@@ -12,6 +12,21 @@ These release notes include new develope
 a name=changes/
 h2Changes since Hadoop 0.23.5/h2
 ul
+li a href=https://issues.apache.org/jira/browse/YARN-354;YARN-354/a.
+ Blocker bug reported by Liang Xie and fixed by Liang Xie br
+ bWebAppProxyServer exits immediately after startup/bbr
+ blockquotePlease see HDFS-4426 for detail, i found the yarn 
WebAppProxyServer is broken by HADOOP-9181 as well, here's the hot fix, and i 
verified manually in our test cluster.
+
+I'm really applogized for bring about such trouble.../blockquote/li
+li a href=https://issues.apache.org/jira/browse/YARN-334;YARN-334/a.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves br
+ bMaven RAT plugin is not checking all source files/bbr
+ blockquoteyarn side of HADOOP-9097
+
+
+
+Running 'mvn apache-rat:check' passes, but running RAT by hand (by downloading 
the JAR) produces some warnings for Java files, amongst others.
+/blockquote/li
 li a href=https://issues.apache.org/jira/browse/YARN-325;YARN-325/a.
  Blocker bug reported by Jason Lowe and fixed by Arun C Murthy 
(capacityscheduler)br
  bRM CapacityScheduler can deadlock when getQueueInfo() is called and a 
container is completing/bbr
@@ -221,6 +236,10 @@ For NMs which come up after an unclean s
  Major bug reported by Rahul Jain and fixed by Devaraj K (jobtracker)br
  bgetClusterStatus() fails with null pointer exception when running jobs 
in local mode/bbr
  blockquote/blockquote/li
+li a href=https://issues.apache.org/jira/browse/HDFS-4426;HDFS-4426/a.
+ Blocker bug reported by Jason Lowe and fixed by Arpit Agarwal 
(namenode)br
+ bSecondary namenode shuts down immediately after startup/bbr
+ blockquote/blockquote/li
 li a href=https://issues.apache.org/jira/browse/HDFS-4385;HDFS-4385/a.
  Critical bug reported by Thomas Graves and fixed by Thomas Graves 
(build)br
  bMaven RAT plugin is not checking all source files/bbr
@@ -265,12 +284,16 @@ For NMs which come up after an unclean s
  Major bug reported by Jean-Daniel Cryans and fixed by Jean-Daniel Cryans 
br
  bCannot read a local block that's being written to when using the local 
read short circuit/bbr
  blockquote/blockquote/li
+li a 
href=https://issues.apache.org/jira/browse/HADOOP-9255;HADOOP-9255/a.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves 
(scripts)br
+ brelnotes.py missing last jira/bbr
+ blockquote/blockquote/li
 li a 
href=https://issues.apache.org/jira/browse/HADOOP-9217;HADOOP-9217/a.
  Major test reported by Andrey Klochkov and fixed by Andrey Klochkov 
(test)br
  bPrint thread dumps when hadoop-common tests fail/bbr
  blockquote/blockquote/li
 li a 
href=https://issues.apache.org/jira/browse/HADOOP-9181;HADOOP-9181/a.
- Major bug reported by liang xie and fixed by liang xie br
+ Major bug reported by Liang Xie and fixed by Liang Xie br
  bSet daemon flag for HttpServer's QueuedThreadPool/bbr
  blockquote/blockquote/li
 li a 
href=https://issues.apache.org/jira/browse/HADOOP-9169;HADOOP-9169/a.
@@ -315,7 +338,7 @@ For NMs which come up after an unclean s
  blockquote/blockquote/li
 li a 
href=https://issues.apache.org/jira/browse/HADOOP-8931;HADOOP-8931/a.
  Trivial improvement reported by Eli Collins and fixed by Eli Collins br
- bAdd Java version to startup message /bbr
+ bAdd Java version to startup message/bbr
  blockquote/blockquote/li
 li a 
href=https://issues.apache.org/jira/browse/HADOOP-8561;HADOOP-8561/a.
  Major improvement reported by Luke Lu and fixed by Yu Gao (security)br




svn commit: r1439739 - in /hadoop/common/tags: release-0.23.6-rc1-old/ release-0.23.6-rc1/

2013-01-28 Thread tgraves
Author: tgraves
Date: Tue Jan 29 03:44:45 2013
New Revision: 1439739

URL: http://svn.apache.org/viewvc?rev=1439739view=rev
Log:
rc1 without correct releasenotes.html

Added:
hadoop/common/tags/release-0.23.6-rc1-old/   (props changed)
  - copied from r1439738, hadoop/common/tags/release-0.23.6-rc1/
Removed:
hadoop/common/tags/release-0.23.6-rc1/

Propchange: hadoop/common/tags/release-0.23.6-rc1-old/
--
--- svn:ignore (added)
+++ svn:ignore Tue Jan 29 03:44:45 2013
@@ -0,0 +1,5 @@
+.classpath
+.git
+.project
+.settings
+target

Propchange: hadoop/common/tags/release-0.23.6-rc1-old/
--
--- svn:mergeinfo (added)
+++ svn:mergeinfo Tue Jan 29 03:44:45 2013
@@ -0,0 +1 @@
+/hadoop/common/trunk:1161777,1161781,1162188,1162421,1162491,1162499,1162613,1162928,1162954,1162979,1163050,1163069,1163490,1163768,1163852,1163858,1163981,1164255,1164301,1164339,1166009,1166402,1167001,1167383,1167662,1170085,1170379,1170459,1171297,1172916,1173402,1176550,1177487,1177531,1177859,1177864,1182189,1182205,1182214,1189613,1189932,1189982,1195575,1196113,1196129,1204114,1204117,1204122,1204124,1204129,1204131,1204177,1204370,1204376,1204388,1205260,1205697,1206786,1206830,1207694,1208153,1208313,1212021,1212062,1212073,1212084,1213537,1213586,1213592-1213593,1213954,1214046,1220510,1221348,1225114,1225192,1225456,1225489,1225591,1226211,1226239,1226350,1227091,1227165,1227423,1227964,1229347,1230398,1231569,1231572,1231627,1231640,1233605,1234555,1235135,1235137,1235956,1236456,1239752,1240897,1240928,1243065,1243104,1244766,1245751,1245762,1293419,1304099,1351818,1373683,1382409




svn commit: r1439740 - /hadoop/common/tags/release-0.23.6-rc1/

2013-01-28 Thread tgraves
Author: tgraves
Date: Tue Jan 29 03:45:21 2013
New Revision: 1439740

URL: http://svn.apache.org/viewvc?rev=1439740view=rev
Log:
Hadoop 0.23.6-rc1 release

Added:
hadoop/common/tags/release-0.23.6-rc1/   (props changed)
  - copied from r1439739, hadoop/common/branches/branch-0.23.6/

Propchange: hadoop/common/tags/release-0.23.6-rc1/
--
--- svn:ignore (added)
+++ svn:ignore Tue Jan 29 03:45:21 2013
@@ -0,0 +1,5 @@
+.classpath
+.git
+.project
+.settings
+target

Propchange: hadoop/common/tags/release-0.23.6-rc1/
--
--- svn:mergeinfo (added)
+++ svn:mergeinfo Tue Jan 29 03:45:21 2013
@@ -0,0 +1 @@
+/hadoop/common/trunk:1161777,1161781,1162188,1162421,1162491,1162499,1162613,1162928,1162954,1162979,1163050,1163069,1163490,1163768,1163852,1163858,1163981,1164255,1164301,1164339,1166009,1166402,1167001,1167383,1167662,1170085,1170379,1170459,1171297,1172916,1173402,1176550,1177487,1177531,1177859,1177864,1182189,1182205,1182214,1189613,1189932,1189982,1195575,1196113,1196129,1204114,1204117,1204122,1204124,1204129,1204131,1204177,1204370,1204376,1204388,1205260,1205697,1206786,1206830,1207694,1208153,1208313,1212021,1212062,1212073,1212084,1213537,1213586,1213592-1213593,1213954,1214046,1220510,1221348,1225114,1225192,1225456,1225489,1225591,1226211,1226239,1226350,1227091,1227165,1227423,1227964,1229347,1230398,1231569,1231572,1231627,1231640,1233605,1234555,1235135,1235137,1235956,1236456,1239752,1240897,1240928,1243065,1243104,1244766,1245751,1245762,1293419,1304099,1351818,1373683,1382409




svn commit: r1439750 - /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml

2013-01-28 Thread harsh
Author: harsh
Date: Tue Jan 29 05:36:45 2013
New Revision: 1439750

URL: http://svn.apache.org/viewvc?rev=1439750view=rev
Log:
Revert HADOOP-9241 properly this time. Left the core-default.xml in previous 
commit.

Modified:

hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml

Modified: 
hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
URL: 
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml?rev=1439750r1=1439749r2=1439750view=diff
==
--- 
hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
 (original)
+++ 
hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
 Tue Jan 29 05:36:45 2013
@@ -440,18 +440,6 @@
 /property
 
 property
-  namefs.du.interval/name
-  value6/value
-  descriptionFile space usage statistics refresh interval in 
msec./description
-/property
-
-property
-  namefs.du.interval/name
-  value6/value
-  descriptionFile space usage statistics refresh interval in 
msec./description
-/property
-
-property
   namefs.s3.block.size/name
   value67108864/value
   descriptionBlock size to use when writing files to S3./description