[Hadoop Wiki] Trivial Update of SupportingProjects by sonalgoyal
Dear Wiki user, You have subscribed to a wiki page or wiki category on Hadoop Wiki for change notification. The SupportingProjects page has been changed by sonalgoyal: http://wiki.apache.org/hadoop/SupportingProjects?action=diffrev1=39rev2=40 * [[http://github.com/amitrathore/capjure|capjure]] - capjure is a persistence helper for HBase. It is written in the Clojure language, and supports persisting of native hash-maps. * [[http://github.com/sematext/HBaseHUT|HBaseHUT]] - (high updates throughput for HBase) It focuses on write performance during records update (by avoiding doing Get on every Put to update record). * [[http://code.google.com/p/hbase-jdo/|HBase UI Tool Util]] - Hbase UI client simple util module -- it can handle hbase more easily like jdo(not persistence api) + * [[https://github.com/sonalgoyal/crux/|Crux]] - HBase Reporting and Analysis with support for simple and composite keys, get and range scans, column based filtering, charting. Example HBase Applications
svn commit: r1160341 - /hadoop/common/trunk/hadoop-common/CHANGES.txt
Author: tomwhite Date: Mon Aug 22 17:19:46 2011 New Revision: 1160341 URL: http://svn.apache.org/viewvc?rev=1160341view=rev Log: HADOOP-7498. Remove legacy TAR layout creation. Contributed by Alejandro Abdelnur. Modified: hadoop/common/trunk/hadoop-common/CHANGES.txt Modified: hadoop/common/trunk/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common/CHANGES.txt?rev=1160341r1=1160340r2=1160341view=diff == --- hadoop/common/trunk/hadoop-common/CHANGES.txt (original) +++ hadoop/common/trunk/hadoop-common/CHANGES.txt Mon Aug 22 17:19:46 2011 @@ -334,6 +334,9 @@ Trunk (unreleased changes) HADOOP-7264. Bump avro version to at least 1.4.1. (Alejandro Abdelnur via tomwhite) +HADOOP-7498. Remove legacy TAR layout creation. (Alejandro Abdelnur via +tomwhite) + OPTIMIZATIONS HADOOP-7333. Performance improvement in PureJavaCrc32. (Eric Caspole
svn commit: r1160341 - in /hadoop/common/trunk: BUILDING.txt hadoop-assemblies/src/main/resources/assemblies/hadoop-bintar.xml hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml hadoop-pro
Author: tomwhite
Date: Mon Aug 22 17:19:46 2011
New Revision: 1160341
URL: http://svn.apache.org/viewvc?rev=1160341view=rev
Log:
HADOOP-7498. Remove legacy TAR layout creation. Contributed by Alejandro
Abdelnur.
Removed:
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-bintar.xml
Modified:
hadoop/common/trunk/BUILDING.txt
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml
hadoop/common/trunk/hadoop-project-distro/pom.xml
Modified: hadoop/common/trunk/BUILDING.txt
URL:
http://svn.apache.org/viewvc/hadoop/common/trunk/BUILDING.txt?rev=1160341r1=1160340r2=1160341view=diff
==
--- hadoop/common/trunk/BUILDING.txt (original)
+++ hadoop/common/trunk/BUILDING.txt Mon Aug 22 17:19:46 2011
@@ -43,7 +43,7 @@ Maven build goals:
* Run clover: mvn test -Pclover
[-DcloverLicenseLocation=${user.name}/.clover.license]
* Run Rat : mvn apache-rat:check
* Build javadocs: mvn javadoc:javadoc
- * Build TAR : mvn package
[-Ptar][-Pbintar][-Pdocs][-Psrc][-Pnative]
+ * Build TAR : mvn package [-Ptar][-Pdocs][-Psrc][-Pnative]
Build options:
Modified:
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml?rev=1160341r1=1160340r2=1160341view=diff
==
---
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml
(original)
+++
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml
Mon Aug 22 17:19:46 2011
@@ -15,79 +15,105 @@
limitations under the License.
--
assembly
- idhadoop-tar/id
+ idhadoop-bintar/id
formats
formatdir/format
/formats
includeBaseDirectoryfalse/includeBaseDirectory
fileSets
fileSet
- directory${basedir}/directory
- outputDirectory//outputDirectory
- includes
-include*.txt/include
- /includes
+ directory${basedir}/src/main/bin/directory
+ outputDirectory/bin/outputDirectory
+ excludes
+exclude*.sh/exclude
+ /excludes
+ fileMode0755/fileMode
+/fileSet
+fileSet
+ directory${basedir}/src/main/conf/directory
+ outputDirectory/etc/hadoop/outputDirectory
/fileSet
fileSet
directory${basedir}/src/main/bin/directory
- outputDirectory/bin/outputDirectory
+ outputDirectory/libexec/outputDirectory
includes
-include*/include
+include*-config.sh/include
/includes
fileMode0755/fileMode
/fileSet
fileSet
directory${basedir}/src/main/bin/directory
- outputDirectory/libexec/outputDirectory
+ outputDirectory/sbin/outputDirectory
includes
-include*-config.sh/include
+include*.sh/include
/includes
+ excludes
+excludehadoop-config.sh/exclude
+ /excludes
fileMode0755/fileMode
/fileSet
fileSet
- directory${basedir}/src/main/conf/directory
- outputDirectory/conf/outputDirectory
+ directory${basedir}/src/main/packages/directory
+ outputDirectory/sbin/outputDirectory
+ includes
+include*.sh/include
+ /includes
+ fileMode0755/fileMode
/fileSet
fileSet
- directory${basedir}/src/main/webapps/directory
- outputDirectory/webapps/outputDirectory
- excludes
-excludeproto-*-web.xml/exclude
- /excludes
+ directory${basedir}/directory
+ outputDirectory/share/doc/hadoop/${hadoop.component}/outputDirectory
+ includes
+include*.txt/include
+ /includes
/fileSet
fileSet
directory${project.build.directory}/webapps/directory
- outputDirectory/webapps/outputDirectory
- excludes
-excludeproto-*-web.xml/exclude
- /excludes
+
outputDirectory/share/hadoop/${hadoop.component}/webapps/outputDirectory
/fileSet
fileSet
- directory${project.build.directory}/site/directory
- outputDirectory/docs/outputDirectory
+ directory${basedir}/src/main/conf/directory
+
outputDirectory/share/hadoop/${hadoop.component}/templates/outputDirectory
+ includes
+include*-site.xml/include
+ /includes
/fileSet
fileSet
directory${project.build.directory}/directory
- outputDirectory//outputDirectory
+ outputDirectory/share/hadoop/${hadoop.component}/outputDirectory
includes
include${project.artifactId}-${project.version}.jar/include
include${project.artifactId}-${project.version}-tests.jar/include
+include${project.artifactId}-${project.version}-sources.jar/include
+
include${project.artifactId}-${project.version}-test-sources.jar/include
svn commit: r1160344 - in /hadoop/common/trunk/hadoop-common: CHANGES.txt pom.xml
Author: tomwhite Date: Mon Aug 22 17:40:58 2011 New Revision: 1160344 URL: http://svn.apache.org/viewvc?rev=1160344view=rev Log: HADOOP-7496. Break Maven TAR bintar profiles into just LAYOUT TAR proper. Contributed by Alejandro Abdelnur. Modified: hadoop/common/trunk/hadoop-common/CHANGES.txt hadoop/common/trunk/hadoop-common/pom.xml Modified: hadoop/common/trunk/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common/CHANGES.txt?rev=1160344r1=1160343r2=1160344view=diff == --- hadoop/common/trunk/hadoop-common/CHANGES.txt (original) +++ hadoop/common/trunk/hadoop-common/CHANGES.txt Mon Aug 22 17:40:58 2011 @@ -337,6 +337,9 @@ Trunk (unreleased changes) HADOOP-7498. Remove legacy TAR layout creation. (Alejandro Abdelnur via tomwhite) +HADOOP-7496. Break Maven TAR bintar profiles into just LAYOUT TAR proper. +(Alejandro Abdelnur via tomwhite) + OPTIMIZATIONS HADOOP-7333. Performance improvement in PureJavaCrc32. (Eric Caspole Modified: hadoop/common/trunk/hadoop-common/pom.xml URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common/pom.xml?rev=1160344r1=1160343r2=1160344view=diff == --- hadoop/common/trunk/hadoop-common/pom.xml (original) +++ hadoop/common/trunk/hadoop-common/pom.xml Mon Aug 22 17:40:58 2011 @@ -16,9 +16,9 @@ modelVersion4.0.0/modelVersion parent groupIdorg.apache.hadoop/groupId -artifactIdhadoop-project-distro/artifactId +artifactIdhadoop-project-dist/artifactId version0.23.0-SNAPSHOT/version -relativePath../hadoop-project-distro/relativePath +relativePath../hadoop-project-dist/relativePath /parent groupIdorg.apache.hadoop/groupId artifactIdhadoop-common/artifactId
svn commit: r1160344 - in /hadoop/common/trunk: ./ hadoop-assemblies/src/main/resources/assemblies/ hadoop-project-dist/ hadoop-project-distro/
Author: tomwhite
Date: Mon Aug 22 17:40:58 2011
New Revision: 1160344
URL: http://svn.apache.org/viewvc?rev=1160344view=rev
Log:
HADOOP-7496. Break Maven TAR bintar profiles into just LAYOUT TAR proper.
Contributed by Alejandro Abdelnur.
Added:
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-dist.xml
(with props)
hadoop/common/trunk/hadoop-project-dist/
hadoop/common/trunk/hadoop-project-dist/README.txt (with props)
hadoop/common/trunk/hadoop-project-dist/pom.xml (with props)
Removed:
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml
hadoop/common/trunk/hadoop-project-distro/
Modified:
hadoop/common/trunk/BUILDING.txt
hadoop/common/trunk/pom.xml
Modified: hadoop/common/trunk/BUILDING.txt
URL:
http://svn.apache.org/viewvc/hadoop/common/trunk/BUILDING.txt?rev=1160344r1=1160343r2=1160344view=diff
==
--- hadoop/common/trunk/BUILDING.txt (original)
+++ hadoop/common/trunk/BUILDING.txt Mon Aug 22 17:40:58 2011
@@ -15,12 +15,13 @@ Requirements:
--
Maven modules:
- hadoop (Main Hadoop project)
- - hadoop-project (Parent POM for all Hadoop Maven modules.
)
- (All plugins dependencies versions are defined
here.)
- - hadoop-annotations (Generates the Hadoop doclet used to generated
the Javadocs)
- - hadoop-common (Hadoop Common)
- - hadoop-hdfs(Hadoop HDFS)
+ hadoop (Main Hadoop project)
+ - hadoop-project (Parent POM for all Hadoop Maven modules.
)
+ (All plugins dependencies versions are
defined here.)
+ - hadoop-project-dist (Parent POM for modules that generate
distributions.)
+ - hadoop-annotations (Generates the Hadoop doclet used to generated
the Javadocs)
+ - hadoop-common (Hadoop Common)
+ - hadoop-hdfs (Hadoop HDFS)
--
Where to run Maven from?
@@ -43,15 +44,16 @@ Maven build goals:
* Run clover: mvn test -Pclover
[-DcloverLicenseLocation=${user.name}/.clover.license]
* Run Rat : mvn apache-rat:check
* Build javadocs: mvn javadoc:javadoc
- * Build TAR : mvn package [-Ptar][-Pdocs][-Psrc][-Pnative]
+ * Build distribution: mvn package
[-Pdist][-Pdocs][-Psrc][-Pnative][-Dtar]
Build options:
* Use -Pnative to compile/bundle native code
* Use -Dsnappy.prefix=(/usr/local) -Dbundle.snappy=(false) to compile
Snappy JNI bindings and to bundle Snappy SO files
- * Use -Pdocs to generate bundle the documentation in the TAR (using -Ptar)
- * Use -Psrc to bundle the source in the TAR (using -Ptar)
+ * Use -Pdocs to generate bundle the documentation in the distribution
(using -Pdist)
+ * Use -Psrc to bundle the source in the distribution (using -Pdist)
+ * Use -Dtar to create a TAR with the distribution (using -Pdist)
Tests options:
Added:
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-dist.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-dist.xml?rev=1160344view=auto
==
---
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-dist.xml
(added)
+++
hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-dist.xml
Mon Aug 22 17:40:58 2011
@@ -0,0 +1,121 @@
+!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the License); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an AS IS BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+--
+assembly
+ idhadoop-distro/id
+ formats
+formatdir/format
+ /formats
+ includeBaseDirectoryfalse/includeBaseDirectory
+ fileSets
+fileSet
+ directory${basedir}/src/main/bin/directory
+ outputDirectory/bin/outputDirectory
+ excludes
+exclude*.sh/exclude
+ /excludes
+ fileMode0755/fileMode
+/fileSet
+fileSet
+
svn commit: r1160358 - in /hadoop/common/branches/branch-0.22/hdfs: build.xml ivy/hadoop-hdfs-instrumented-template.xml ivy/hadoop-hdfs-template.xml
Author: shv
Date: Mon Aug 22 18:24:35 2011
New Revision: 1160358
URL: http://svn.apache.org/viewvc?rev=1160358view=rev
Log:
HDFS-2214. Revert last patch.
Modified:
hadoop/common/branches/branch-0.22/hdfs/build.xml
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml
Modified: hadoop/common/branches/branch-0.22/hdfs/build.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/hdfs/build.xml?rev=1160358r1=1160357r2=1160358view=diff
==
--- hadoop/common/branches/branch-0.22/hdfs/build.xml (original)
+++ hadoop/common/branches/branch-0.22/hdfs/build.xml Mon Aug 22 18:24:35 2011
@@ -1724,14 +1724,6 @@
include name=hadoop-hdfs-${herriot.suffix}-test.xml/
/fileset
/replaceregexp
-replaceregexp byline=true
- regexp pattern=@hadoop-common.version/
- substitution expression=${hadoop-common.version}/
- fileset dir=${basedir}/ivy
-include name=hadoop-hdfs.xml/
-include name=hadoop-hdfs-${herriot.suffix}.xml/
- /fileset
-/replaceregexp
/target
!--
Modified:
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml?rev=1160358r1=1160357r2=1160358view=diff
==
---
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
(original)
+++
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
Mon Aug 22 18:24:35 2011
@@ -33,7 +33,7 @@
dependency
groupIdorg.apache.hadoop/groupId
artifactIdhadoop-common-instrumented/artifactId
- version@hadoop-common.version/version
+ version0.22.0-SNAPSHOT/version
/dependency
/dependencies
/project
Modified: hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml?rev=1160358r1=1160357r2=1160358view=diff
==
--- hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml
(original)
+++ hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml Mon
Aug 22 18:24:35 2011
@@ -33,7 +33,12 @@
dependency
groupIdorg.apache.hadoop/groupId
artifactIdhadoop-common/artifactId
- version@hadoop-common.version/version
+ version0.22.0-SNAPSHOT/version
+/dependency
+dependency
+ groupIdcom.google.guava/groupId
+ artifactIdguava/artifactId
+ versionr09/version
/dependency
/dependencies
/project
svn commit: r1160361 - in /hadoop/common/branches/branch-0.22/hdfs: build.xml ivy/hadoop-hdfs-instrumented-template.xml ivy/hadoop-hdfs-template.xml
Author: shv
Date: Mon Aug 22 18:28:06 2011
New Revision: 1160361
URL: http://svn.apache.org/viewvc?rev=1160361view=rev
Log:
HDFS-2214. Generated POMs hardcode dependency on hadoop-common version
0.22.0-SNAPSHOT. Contributed by Joep Rottinghuis.
Modified:
hadoop/common/branches/branch-0.22/hdfs/build.xml
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml
Modified: hadoop/common/branches/branch-0.22/hdfs/build.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/hdfs/build.xml?rev=1160361r1=1160360r2=1160361view=diff
==
--- hadoop/common/branches/branch-0.22/hdfs/build.xml (original)
+++ hadoop/common/branches/branch-0.22/hdfs/build.xml Mon Aug 22 18:28:06 2011
@@ -1724,6 +1724,14 @@
include name=hadoop-hdfs-${herriot.suffix}-test.xml/
/fileset
/replaceregexp
+replaceregexp byline=true
+ regexp pattern=@hadoop-common.version/
+ substitution expression=${hadoop-common.version}/
+ fileset dir=${basedir}/ivy
+include name=hadoop-hdfs.xml/
+include name=hadoop-hdfs-${herriot.suffix}.xml/
+ /fileset
+/replaceregexp
/target
!--
Modified:
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml?rev=1160361r1=1160360r2=1160361view=diff
==
---
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
(original)
+++
hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-instrumented-template.xml
Mon Aug 22 18:28:06 2011
@@ -33,7 +33,7 @@
dependency
groupIdorg.apache.hadoop/groupId
artifactIdhadoop-common-instrumented/artifactId
- version0.22.0-SNAPSHOT/version
+ version@hadoop-common.version/version
/dependency
/dependencies
/project
Modified: hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml?rev=1160361r1=1160360r2=1160361view=diff
==
--- hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml
(original)
+++ hadoop/common/branches/branch-0.22/hdfs/ivy/hadoop-hdfs-template.xml Mon
Aug 22 18:28:06 2011
@@ -33,7 +33,7 @@
dependency
groupIdorg.apache.hadoop/groupId
artifactIdhadoop-common/artifactId
- version0.22.0-SNAPSHOT/version
+ version@hadoop-common.version/version
/dependency
dependency
groupIdcom.google.guava/groupId
[Hadoop Wiki] Update of HowToContribute by TomWhite
Dear Wiki user,
You have subscribed to a wiki page or wiki category on Hadoop Wiki for change
notification.
The HowToContribute page has been changed by TomWhite:
http://wiki.apache.org/hadoop/HowToContribute?action=diffrev1=58rev2=59
Comment:
Updated with latest Maven changes
* You can run all the Common unit tests with {{{mvn test}}}, or a specific
unit test with {{{mvn -Dtest=class name without package prefix test}}}. Run
these commands from the {{{hadoop-trunk}}} directory.
* For HDFS and MapReduce, you can run all the unit tests with the command
{{{ant test}}}, or you can run a specific unit test with the command {{{ant
-Dtestcase=class name without package prefix test}}} (for example {{{ant
-Dtestcase=TestFileSystem test}}})
- Using Ant
- Hadoop HDFS and MapReduce are built by Ant, a Java building tool. (Common is
build using Maven, see below.) This section will eventually describe how Ant is
used within Hadoop. To start, simply read a good Ant tutorial. The following
is a good tutorial, though keep in mind that Hadoop isn't structured according
to the ways outlined in the tutorial. Use the tutorial to get a basic
understand of Ant but not to understand how Ant is used for Hadoop:
-
- * Good Ant tutorial: http://i-proving.ca/space/Technologies/Ant+Tutorial
-
- Although most Java IDEs ship with a version of Ant, having a command line
version installed is invaluable. You can download a version from
http://ant.apache.org/.
-
- After installing Ant, you must make sure that its networking support is
configured for any proxy you have. Without that the build will not work, as the
Hadoop builds will not be able to download their dependencies using
[[http://ant.apache.org/ivy/|Ivy]].
-
- Tip: to see how Ant is set up, run
-
- {{{
- ant -diagnostics
- }}}
-
Using Maven
- Hadoop Common is built using Maven. You need to use version 3 or later.
+ Hadoop built using [[http://maven.apache.org/|Apache Maven]], version 3 or
later. (Parts of MapReduce are still built using Ant, see the instructions in
the {{{INSTALL}}} file in {{{hadoop-mapreduce}}} for details.)
=== Generating a patch ===
Unit Tests
Please make sure that all unit tests succeed before constructing your patch
and that no new javac compiler warnings are introduced by your patch.
+ For building Hadoop with Maven, use the following to run all unit tests and
build a distribution. The {{{-Ptest-patch}}} profile will check that no new
compiler warnings have been introduced by your patch.
- {{{
- cd hadoop-common-trunk
- ant -Djavac.args=-Xlint -Xmaxwarns 1000 clean test tar
- }}}
- After a while, if you see
{{{
- BUILD SUCCESSFUL
+ mvn clean install -Pdist -Dtar -Ptest-patch
}}}
- all is ok, but if you see
+ Any test failures can be found in the {{{target/surefire-reports}}} directory
of the relevant module. You can also run this command in one of the
{{{hadoop-common}}}, {{{hadoop-hdfs}}}, or {{{hadoop-mapreduce}}} directories
to just test a particular subproject.
- {{{
- BUILD FAILED
- }}}
- then please examine error messages in {{{build/test}}} and fix things before
proceeding.
Unit tests development guidelines HowToDevelopUnitTests
-
- For building Hadoop Common with Maven, use the following to run all unit
tests and build a distribution. The {{{-Ptest-patch}}} profile will check that
no new compiler warnings have been introduced by your patch.
-
- {{{
- mvn clean install -Ptar -Ptest-patch
- }}}
-
- Any test failures can be found in {{{hadoop-common/target/surefire-reports}}}.
Javadoc
Please also check the javadoc.
{{{
- ant javadoc
- firefox build/docs/api/index.html
+ mvn javadoc:javadoc
+ firefox target/site/api/index.html
}}}
Examine all public classes you've changed to see that documentation is
complete, informative, and properly formatted. Your patch must not generate
any javadoc warnings.
-
- For Common, use Maven to build the javadoc as follows:
- {{{
- mvn javadoc:javadoc
- firefox hadoop-common/target/site/api/index.html
- }}}
Creating a patch
Check to see what files you have modified with:
@@ -150, +113 @@
This way other developers can preview your change by running the script and
then applying the patch.
Testing your patch
- Before submitting your patch, you are encouraged to run the same tools that
the automated Hudson patch test system will run on your patch. This enables
you to fix problems with your patch before you submit it. The {{{test-patch}}}
Ant target will run your patch through the same checks that Hudson currently
does ''except'' for executing the core and contrib unit tests.
+ Before submitting your patch, you are encouraged to run the same tools that
the automated Jenkins patch test system will run on your patch. This enables
you to fix problems with your patch before you submit it. The
{{{dev-support/test-patch.sh}}} script in the
svn commit: r1160420 - in /hadoop/common/branches/branch-0.22/common: CHANGES.txt src/saveVersion.sh
Author: shv Date: Mon Aug 22 20:38:50 2011 New Revision: 1160420 URL: http://svn.apache.org/viewvc?rev=1160420view=rev Log: HADOOP-7390. VersionInfo not generated properly in git after unsplit. Contributed by Todd Lipcon. (todd Modified: hadoop/common/branches/branch-0.22/common/CHANGES.txt hadoop/common/branches/branch-0.22/common/src/saveVersion.sh Modified: hadoop/common/branches/branch-0.22/common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/common/CHANGES.txt?rev=1160420r1=1160419r2=1160420view=diff == --- hadoop/common/branches/branch-0.22/common/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.22/common/CHANGES.txt Mon Aug 22 20:38:50 2011 @@ -530,6 +530,9 @@ Release 0.22.0 - Unreleased HADOOP-7514. Build fails with ClassCastException when running both mvn-install and mvn-deploy targets (Joep Rottinghuis via cos) +HADOOP-7390. VersionInfo not generated properly in git after unsplit. +(todd via shv) + Release 0.21.1 - Unreleased IMPROVEMENTS Modified: hadoop/common/branches/branch-0.22/common/src/saveVersion.sh URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.22/common/src/saveVersion.sh?rev=1160420r1=1160419r2=1160420view=diff == --- hadoop/common/branches/branch-0.22/common/src/saveVersion.sh (original) +++ hadoop/common/branches/branch-0.22/common/src/saveVersion.sh Mon Aug 22 20:38:50 2011 @@ -26,7 +26,7 @@ build_dir=$2 user=`whoami | tr '\n\r' '\n'` date=`date` cwd=`pwd` -if [ -d .git ]; then +if git rev-parse HEAD 2/dev/null /dev/null ; then revision=`git log -1 --pretty=format:%H` hostname=`hostname` branch=`git branch | sed -n -e 's/^* //p'`
svn commit: r1160424 - /hadoop/common/trunk/hadoop-common/CHANGES.txt
Author: shv Date: Mon Aug 22 20:44:20 2011 New Revision: 1160424 URL: http://svn.apache.org/viewvc?rev=1160424view=rev Log: HADOOP-7390. Move changes under 0.22 branch. Modified: hadoop/common/trunk/hadoop-common/CHANGES.txt Modified: hadoop/common/trunk/hadoop-common/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common/CHANGES.txt?rev=1160424r1=1160423r2=1160424view=diff == --- hadoop/common/trunk/hadoop-common/CHANGES.txt (original) +++ hadoop/common/trunk/hadoop-common/CHANGES.txt Mon Aug 22 20:44:20 2011 @@ -437,9 +437,6 @@ Trunk (unreleased changes) HADOOP-7389. Use of TestingGroups by tests causes subsequent tests to fail. (atm via tomwhite) -HADOOP-7390. VersionInfo not generated properly in git after unsplit. (todd -via atm) - HADOOP-7377. Fix command name handling affecting DFSAdmin. (Daryn Sharp via mattf) @@ -1026,6 +1023,9 @@ Release 0.22.0 - Unreleased HADOOP-7349. HADOOP-7121 accidentally disabled some tests in TestIPC. (todd) +HADOOP-7390. VersionInfo not generated properly in git after unsplit. (todd +via atm) + Release 0.21.1 - Unreleased IMPROVEMENTS
svn commit: r1160426 - in /hadoop/common/branches/branch-0.20-security: ./ src/core/org/apache/hadoop/fs/ src/hdfs/org/apache/hadoop/hdfs/ src/hdfs/org/apache/hadoop/hdfs/server/common/ src/hdfs/org/a
Author: suresh Date: Mon Aug 22 20:51:29 2011 New Revision: 1160426 URL: http://svn.apache.org/viewvc?rev=1160426view=rev Log: Merging change r955380 for HDFS-561 from 0.20-append branch to 0.20-security Modified: hadoop/common/branches/branch-0.20-security/ (props changed) hadoop/common/branches/branch-0.20-security/CHANGES.txt (contents, props changed) hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/common/HdfsConstants.java hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java hadoop/common/branches/branch-0.20-security/src/mapred/ (props changed) hadoop/common/branches/branch-0.20-security/src/test/org/apache/hadoop/fs/TestHarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/tools/org/apache/hadoop/tools/HadoopArchives.java (props changed) Propchange: hadoop/common/branches/branch-0.20-security/ -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 20:51:29 2011 @@ -1,4 +1,5 @@ /hadoop/common/branches/branch-0.20:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 +/hadoop/common/branches/branch-0.20-append:955380 /hadoop/common/branches/branch-0.20-security-203:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204:1128390,1147228,1148069,1149316,1154413 /hadoop/core/branches/branch-0.19:713112 Modified: hadoop/common/branches/branch-0.20-security/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/CHANGES.txt?rev=1160426r1=1160425r2=1160426view=diff == --- hadoop/common/branches/branch-0.20-security/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.20-security/CHANGES.txt Mon Aug 22 20:51:29 2011 @@ -39,6 +39,9 @@ Release 0.20.205.0 - unreleased HDFS-2259. DN web-UI doesn't work with paths that contain html. (eli) +HDFS-561. Fix write pipeline READ_TIMEOUT. +(Todd Lipcon via dhruba) + IMPROVEMENTS MAPREDUCE-2187. Reporter sends progress during sort/merge. (Anupam Seth via Propchange: hadoop/common/branches/branch-0.20-security/CHANGES.txt -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 20:51:29 2011 @@ -1,4 +1,5 @@ /hadoop/common/branches/branch-0.20/CHANGES.txt:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 +/hadoop/common/branches/branch-0.20-append/CHANGES.txt:955380 /hadoop/common/branches/branch-0.20-security-203/CHANGES.txt:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204/CHANGES.txt:1128390,1147228,1148069,1149316,1154413,1159730 /hadoop/core/branches/branch-0.18/CHANGES.txt:727226 Propchange: hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 20:51:29 2011 @@ -1,4 +1,5 @@ /hadoop/common/branches/branch-0.20/src/core/org/apache/hadoop/fs/HarFileSystem.java:990003 +/hadoop/common/branches/branch-0.20-append/src/core/org/apache/hadoop/fs/HarFileSystem.java:955380 /hadoop/common/branches/branch-0.20-security-203/src/core/org/apache/hadoop/fs/HarFileSystem.java:1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1128115 /hadoop/common/branches/branch-0.20-security-204/src/core/org/apache/hadoop/fs/HarFileSystem.java:1128390 /hadoop/common/trunk/src/core/org/apache/hadoop/fs/HarFileSystem.java:910709 Modified: hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java?rev=1160426r1=1160425r2=1160426view=diff == --- hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java (original) +++ hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java Mon Aug 22 20:51:29 2011 @@ -719,7 +719,9 @@ public class DFSClient implements FSCons
svn commit: r1160441 - in /hadoop/common/branches/branch-0.20-security: ./ src/core/org/apache/hadoop/fs/ src/hdfs/org/apache/hadoop/hdfs/server/namenode/ src/mapred/ src/test/org/apache/hadoop/fs/ sr
Author: suresh Date: Mon Aug 22 21:19:38 2011 New Revision: 1160441 URL: http://svn.apache.org/viewvc?rev=1160441view=rev Log: Merging HDFS-606 change r955398 from 0.20-append to 0.20-security Modified: hadoop/common/branches/branch-0.20-security/ (props changed) hadoop/common/branches/branch-0.20-security/CHANGES.txt (contents, props changed) hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop/common/branches/branch-0.20-security/src/mapred/ (props changed) hadoop/common/branches/branch-0.20-security/src/test/org/apache/hadoop/fs/TestHarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/tools/org/apache/hadoop/tools/HadoopArchives.java (props changed) Propchange: hadoop/common/branches/branch-0.20-security/ -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:19:38 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 -/hadoop/common/branches/branch-0.20-append:955380 +/hadoop/common/branches/branch-0.20-append:955380,955398 /hadoop/common/branches/branch-0.20-security-203:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204:1128390,1147228,1148069,1149316,1154413 /hadoop/core/branches/branch-0.19:713112 Modified: hadoop/common/branches/branch-0.20-security/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/CHANGES.txt?rev=1160441r1=1160440r2=1160441view=diff == --- hadoop/common/branches/branch-0.20-security/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.20-security/CHANGES.txt Mon Aug 22 21:19:38 2011 @@ -42,6 +42,9 @@ Release 0.20.205.0 - unreleased HDFS-561. Fix write pipeline READ_TIMEOUT. (Todd Lipcon via dhruba) +HDFS-606. Fix ConcurrentModificationException in invalidateCorruptReplicas. +(Todd Lipcon via dhruba) + IMPROVEMENTS MAPREDUCE-2187. Reporter sends progress during sort/merge. (Anupam Seth via Propchange: hadoop/common/branches/branch-0.20-security/CHANGES.txt -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:19:38 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20/CHANGES.txt:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 -/hadoop/common/branches/branch-0.20-append/CHANGES.txt:955380 +/hadoop/common/branches/branch-0.20-append/CHANGES.txt:955380,955398 /hadoop/common/branches/branch-0.20-security-203/CHANGES.txt:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204/CHANGES.txt:1128390,1147228,1148069,1149316,1154413,1159730 /hadoop/core/branches/branch-0.18/CHANGES.txt:727226 Propchange: hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:19:38 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20/src/core/org/apache/hadoop/fs/HarFileSystem.java:990003 -/hadoop/common/branches/branch-0.20-append/src/core/org/apache/hadoop/fs/HarFileSystem.java:955380 +/hadoop/common/branches/branch-0.20-append/src/core/org/apache/hadoop/fs/HarFileSystem.java:955380,955398 /hadoop/common/branches/branch-0.20-security-203/src/core/org/apache/hadoop/fs/HarFileSystem.java:1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1128115 /hadoop/common/branches/branch-0.20-security-204/src/core/org/apache/hadoop/fs/HarFileSystem.java:1128390 /hadoop/common/trunk/src/core/org/apache/hadoop/fs/HarFileSystem.java:910709 Modified: hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java?rev=1160441r1=1160440r2=1160441view=diff == --- hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java (original) +++
svn commit: r1160443 - in /hadoop/common/branches/branch-0.20-security: ./ src/core/org/apache/hadoop/fs/ src/hdfs/org/apache/hadoop/hdfs/ src/mapred/ src/test/org/apache/hadoop/fs/ src/tools/org/apac
Author: suresh Date: Mon Aug 22 21:23:43 2011 New Revision: 1160443 URL: http://svn.apache.org/viewvc?rev=1160443view=rev Log: Merging HDFS-1210 change r955448 from 0.20-append to 0.20-security Modified: hadoop/common/branches/branch-0.20-security/ (props changed) hadoop/common/branches/branch-0.20-security/CHANGES.txt (contents, props changed) hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java hadoop/common/branches/branch-0.20-security/src/mapred/ (props changed) hadoop/common/branches/branch-0.20-security/src/test/org/apache/hadoop/fs/TestHarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/tools/org/apache/hadoop/tools/HadoopArchives.java (props changed) Propchange: hadoop/common/branches/branch-0.20-security/ -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:23:43 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 -/hadoop/common/branches/branch-0.20-append:955380,955398 +/hadoop/common/branches/branch-0.20-append:955380,955398,955448 /hadoop/common/branches/branch-0.20-security-203:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204:1128390,1147228,1148069,1149316,1154413 /hadoop/core/branches/branch-0.19:713112 Modified: hadoop/common/branches/branch-0.20-security/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/CHANGES.txt?rev=1160443r1=1160442r2=1160443view=diff == --- hadoop/common/branches/branch-0.20-security/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.20-security/CHANGES.txt Mon Aug 22 21:23:43 2011 @@ -82,6 +82,9 @@ Release 0.20.205.0 - unreleased MAPREDUCE-2852. Jira for YDH bug 2854624. (Kihwal Lee via eli) +HDFS-1210. DFSClient should log exception when block recovery fails. +(Todd Lipcon via dhruba) + Release 0.20.204.0 - unreleased NEW FEATURES Propchange: hadoop/common/branches/branch-0.20-security/CHANGES.txt -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:23:43 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20/CHANGES.txt:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 -/hadoop/common/branches/branch-0.20-append/CHANGES.txt:955380,955398 +/hadoop/common/branches/branch-0.20-append/CHANGES.txt:955380,955398,955448 /hadoop/common/branches/branch-0.20-security-203/CHANGES.txt:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204/CHANGES.txt:1128390,1147228,1148069,1149316,1154413,1159730 /hadoop/core/branches/branch-0.18/CHANGES.txt:727226 Propchange: hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:23:43 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20/src/core/org/apache/hadoop/fs/HarFileSystem.java:990003 -/hadoop/common/branches/branch-0.20-append/src/core/org/apache/hadoop/fs/HarFileSystem.java:955380,955398 +/hadoop/common/branches/branch-0.20-append/src/core/org/apache/hadoop/fs/HarFileSystem.java:955380,955398,955448 /hadoop/common/branches/branch-0.20-security-203/src/core/org/apache/hadoop/fs/HarFileSystem.java:1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1128115 /hadoop/common/branches/branch-0.20-security-204/src/core/org/apache/hadoop/fs/HarFileSystem.java:1128390 /hadoop/common/trunk/src/core/org/apache/hadoop/fs/HarFileSystem.java:910709 Modified: hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java?rev=1160443r1=1160442r2=1160443view=diff == --- hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java (original) +++ hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java Mon Aug 22 21:23:43 2011 @@ -2746,6 +2746,8 @@ public class DFSClient
svn commit: r1160447 - in /hadoop/common/branches/branch-0.20-security: ./ src/core/org/apache/hadoop/fs/ src/hdfs/org/apache/hadoop/hdfs/ src/mapred/ src/test/org/apache/hadoop/fs/ src/tools/org/apac
Author: suresh Date: Mon Aug 22 21:34:09 2011 New Revision: 1160447 URL: http://svn.apache.org/viewvc?rev=1160447view=rev Log: Merging HDFS-1118 change r956329 from 0.20-append to 0.20-security Modified: hadoop/common/branches/branch-0.20-security/ (props changed) hadoop/common/branches/branch-0.20-security/CHANGES.txt (contents, props changed) hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java hadoop/common/branches/branch-0.20-security/src/mapred/ (props changed) hadoop/common/branches/branch-0.20-security/src/test/org/apache/hadoop/fs/TestHarFileSystem.java (props changed) hadoop/common/branches/branch-0.20-security/src/tools/org/apache/hadoop/tools/HadoopArchives.java (props changed) Propchange: hadoop/common/branches/branch-0.20-security/ -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:34:09 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 -/hadoop/common/branches/branch-0.20-append:955380,955398,955448 +/hadoop/common/branches/branch-0.20-append:955380,955398,955448,956329 /hadoop/common/branches/branch-0.20-security-203:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204:1128390,1147228,1148069,1149316,1154413 /hadoop/core/branches/branch-0.19:713112 Modified: hadoop/common/branches/branch-0.20-security/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/CHANGES.txt?rev=1160447r1=1160446r2=1160447view=diff == --- hadoop/common/branches/branch-0.20-security/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.20-security/CHANGES.txt Mon Aug 22 21:34:09 2011 @@ -45,6 +45,9 @@ Release 0.20.205.0 - unreleased HDFS-606. Fix ConcurrentModificationException in invalidateCorruptReplicas. (Todd Lipcon via dhruba) +HDFS-1118. Fix socketleak on DFSClient. +(Zheng Shao via dhruba) + IMPROVEMENTS MAPREDUCE-2187. Reporter sends progress during sort/merge. (Anupam Seth via Propchange: hadoop/common/branches/branch-0.20-security/CHANGES.txt -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:34:09 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20/CHANGES.txt:826138,826568,829987,831184,833001,880632,898713,909245,909723,960946,990003,1044225 -/hadoop/common/branches/branch-0.20-append/CHANGES.txt:955380,955398,955448 +/hadoop/common/branches/branch-0.20-append/CHANGES.txt:955380,955398,955448,956329 /hadoop/common/branches/branch-0.20-security-203/CHANGES.txt:1096071,1097011,1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1102071,1128115 /hadoop/common/branches/branch-0.20-security-204/CHANGES.txt:1128390,1147228,1148069,1149316,1154413,1159730 /hadoop/core/branches/branch-0.18/CHANGES.txt:727226 Propchange: hadoop/common/branches/branch-0.20-security/src/core/org/apache/hadoop/fs/HarFileSystem.java -- --- svn:mergeinfo (original) +++ svn:mergeinfo Mon Aug 22 21:34:09 2011 @@ -1,5 +1,5 @@ /hadoop/common/branches/branch-0.20/src/core/org/apache/hadoop/fs/HarFileSystem.java:990003 -/hadoop/common/branches/branch-0.20-append/src/core/org/apache/hadoop/fs/HarFileSystem.java:955380,955398,955448 +/hadoop/common/branches/branch-0.20-append/src/core/org/apache/hadoop/fs/HarFileSystem.java:955380,955398,955448,956329 /hadoop/common/branches/branch-0.20-security-203/src/core/org/apache/hadoop/fs/HarFileSystem.java:1097249,1097269,1097281,1097966,1098816,1098819,1098823,1098827,1098832,1098839,1098854,1098863,1099088,1099191,1099324,1099330,1099333,1128115 /hadoop/common/branches/branch-0.20-security-204/src/core/org/apache/hadoop/fs/HarFileSystem.java:1128390 /hadoop/common/trunk/src/core/org/apache/hadoop/fs/HarFileSystem.java:910709 Modified: hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java?rev=1160447r1=1160446r2=1160447view=diff == --- hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java (original) +++
svn commit: r1160448 - in /hadoop/common/branches/branch-0.20-security: CHANGES.txt src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java
Author: jitendra
Date: Mon Aug 22 21:34:55 2011
New Revision: 1160448
URL: http://svn.apache.org/viewvc?rev=1160448view=rev
Log:
HDFS-1211. Block receiver should not log rewind packets at INFO level.
Contributed by Todd Lipcon.
Modified:
hadoop/common/branches/branch-0.20-security/CHANGES.txt
hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java
Modified: hadoop/common/branches/branch-0.20-security/CHANGES.txt
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/CHANGES.txt?rev=1160448r1=1160447r2=1160448view=diff
==
--- hadoop/common/branches/branch-0.20-security/CHANGES.txt (original)
+++ hadoop/common/branches/branch-0.20-security/CHANGES.txt Mon Aug 22 21:34:55
2011
@@ -87,6 +87,9 @@ Release 0.20.205.0 - unreleased
HDFS-1210. DFSClient should log exception when block recovery fails.
(Todd Lipcon via dhruba)
+
+HDFS-1211. Block receiver should not log rewind packets at INFO level.
+(Todd Lipcon)
Release 0.20.204.0 - unreleased
Modified:
hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java?rev=1160448r1=1160447r2=1160448view=diff
==
---
hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java
(original)
+++
hadoop/common/branches/branch-0.20-security/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java
Mon Aug 22 21:34:55 2011
@@ -627,10 +627,12 @@ class BlockReceiver implements java.io.C
computePartialChunkCrc(offsetInBlock, offsetInChecksum,
bytesPerChecksum);
}
-LOG.info(Changing block file offset of block + block + from +
+if (LOG.isDebugEnabled()) {
+ LOG.debug(Changing block file offset of block + block + from +
datanode.data.getChannelPosition(block, streams) +
to + offsetInBlock +
meta file offset to + offsetInChecksum);
+}
// set the position of the block file
datanode.data.setChannelPosition(block, streams, offsetInBlock,
offsetInChecksum);
svn commit: r1160473 - /hadoop/common/trunk/hadoop-project-dist/pom.xml
Author: mahadev Date: Mon Aug 22 22:24:00 2011 New Revision: 1160473 URL: http://svn.apache.org/viewvc?rev=1160473view=rev Log: HADOOP-7566. MR tests are failing webapps/hdfs not found in CLASSPATH. (Alejandro Abdelnur via mahadev) Modified: hadoop/common/trunk/hadoop-project-dist/pom.xml Modified: hadoop/common/trunk/hadoop-project-dist/pom.xml URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-project-dist/pom.xml?rev=1160473r1=1160472r2=1160473view=diff == --- hadoop/common/trunk/hadoop-project-dist/pom.xml (original) +++ hadoop/common/trunk/hadoop-project-dist/pom.xml Mon Aug 22 22:24:00 2011 @@ -69,6 +69,7 @@ configuration includes include**/*.class/include +includewebapps/**/include /includes /configuration /execution
[Hadoop Wiki] Update of Hbase/EclipseEnvironment by DougMeil
Dear Wiki user, You have subscribed to a wiki page or wiki category on Hadoop Wiki for change notification. The Hbase/EclipseEnvironment page has been changed by DougMeil: http://wiki.apache.org/hadoop/Hbase/EclipseEnvironment?action=diffrev1=14rev2=15 + This page is OBSOLETE. See the Developer section in the HBase book (http://hbase.apache.org/book.html#developer) + = Working with HBase under Eclipse = Here are the instructions for setting up the HBase development environment in Eclipse (Ganymede) . This is similar to the EclipseEnvironment guide but with some changes that are specific to HBase.
