See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/542/changes
Changes:
[cdouglas] HADOOP-3716. Prevent listStatus in KosmosFileSystem from returning
null for valid, empty directories. Contributed by Sriram Rao.
[acmurthy] HADOOP-3647. Add debug logs to help track down a very occassional,
hard-to-reproduce, bug in shuffle/merge on the reducer.
[ddas] HADOOP-3478. Improves the handling of map output fetching. Now the
randomization is by the hosts (and not the map outputs themselves). Contributed
by Jothi Padmanabhan.
[cdouglas] HADOOP-3721. Refactor CompositeRecordReader and related mapred.join
classes
to make them clearer.
[cdouglas] HADOOP-3684. Add a cloning function to the contrib/data_join
framework
permitting users to define a more efficient method for cloning values from
the reduce than serialization/deserialization. Contributed by Runping Qi.
[cdouglas] HADOOP-3718. Fix KFSOutputStream::write(int) to output a byte
instead of
an int, per the OutputStream contract. Contributed by Sriram Rao.
[cdouglas] HADOOP-3726. Throw exceptions from TestCLI setup and teardown
instead of
swallowing them. Contributed by Steve Loughran.
[cdouglas] HADOOP-3725. Prevent TestMiniMRMapDebugScript from swallowing
exceptions.
Contributed by Steve Loughran.
[ddas] HADOOP-3149. Adds a way in which map/reducetasks can create multiple
outputs. Contributed by Alejandro Abdelnur.
[ddas] HADOOP-3711. Fixes the Streaming input parsing to properly find the
separator. Contributed by Amareshwari Sriramadasu.
[rangadi] HADOOP-3328. When client is writing data to DFS, only the last
datanode in the pipeline needs to verify the checksum. Saves around
30% CPU on intermediate datanodes. (rangadi)
[yhemanth] HADOOP-3695. Provide an ability to start multiple workers per node.
Contributed by Vinod Kumar Vavilapalli
[cdouglas] HADOOP-3706. Fix a ClassLoader issue in the mapred.join Parser that
prevents it from loading user-specified InputFormats.
Contributed by Jingkei Ly.
[cdouglas] HADOOP-3630. Fix NullPointerException in CompositeRecordReader from
empty
sources.
[hairong] HADOOP-3685. Unbalanced replication target. Contributed by Hairong
Kuang.
[shv] HADOOP-3002. Hold off block removal while in safe mode. Contributed by
Konstantin Shvachko.
[rangadi] HADOOP-3681. DFSClient can get into an infinite loop while closing
a file if there are some errors. (Lohit Vijayarenu via rangadi)
[cdouglas] HADOOP-3660. Add replication factor for injecting blocks in simulated
datanodes. Contributed by Sanjay Radia.
[rangadi] HADOOP-3673. Avoid deadlock caused by DataNode RPC receoverBlock().
(Tsz Wo (Nicholas), SZE via rangadi)
------------------------------------------
[...truncated 2753 lines...]
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/contrib/hod
[copy] Copying 67 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/contrib/hod
check-contrib:
init:
[echo] contrib: index
init-contrib:
compile:
[echo] contrib: index
jar:
[echo] contrib: index
[jar] Building jar:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/contrib/index/hadoop-2008-07-12_11-17-58-index.jar
compile-examples:
jar-examples:
package:
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/contrib/index
[copy] Copying 1 file to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/contrib/index
check-contrib:
init:
[echo] contrib: streaming
init-contrib:
compile:
[echo] contrib: streaming
jar:
[jar] Building jar:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/contrib/streaming/hadoop-2008-07-12_11-17-58-streaming.jar
compile-examples:
jar-examples:
package:
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/contrib/streaming
[copy] Copying 1 file to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/contrib/streaming
[copy] Copying 10 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/webapps
[copy] Copied 12 empty directories to 1 empty directory under
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/webapps
[copy] Copying 4 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58
[copy] Copying 14 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/bin
[copy] Copying 11 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/conf
[copy] Copying 1642 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/docs
[copy] Copied 130 empty directories to 3 empty directories under
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/docs
[copy] Copying 4 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58
[copy] Copying 1419 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/src
[copy] Copied 283 empty directories to 1 empty directory under
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58/src
[copy] Copying 1 file to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58
tar:
[tar] Building tar:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/hadoop-2008-07-12_11-17-58.tar.gz
findbugs:
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/findbugs
[findbugs] Executing findbugs from ant task
[findbugs] Running FindBugs...
[findbugs] The following classes needed for analysis were missing:
[findbugs] org.apache.tools.ant.Task
[findbugs] org.apache.tools.ant.Project
[findbugs] org.apache.tools.ant.BuildException
[findbugs] org.apache.tools.ant.types.FileSet
[findbugs] org.apache.tools.ant.DirectoryScanner
[findbugs] org.apache.hadoop.mapred.join.CompositeRecordReader.JoinCollector
[findbugs] org.apache.hadoop.mapred.ReduceTask$ReduceCopier.MapOutputLocation
[findbugs] Warnings generated: 160
[findbugs] Missing classes: 8
[findbugs] Classes needed for analysis were missing
[findbugs] Output saved to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/findbugs/hadoop-findbugs-report.xml
[xslt] Processing
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/findbugs/hadoop-findbugs-report.xml
to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/findbugs/hadoop-findbugs-report.html
[xslt] Loading stylesheet
/export/home/nigel/tools/findbugs/latest/src/xsl/default.xsl
BUILD SUCCESSFUL
Total time: 3 minutes 33 seconds
Buildfile: build.xml
clean-contrib:
clean:
clean:
[echo] contrib: datajoin
[delete] Deleting directory
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/contrib/datajoin
clean:
[echo] contrib: eclipse-plugin
[delete] Deleting directory
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/contrib/eclipse-plugin
check-libhdfs-fuse:
clean:
clean:
[echo] contrib: hod
[delete] Deleting directory
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/contrib/hod
clean:
[echo] contrib: index
[delete] Deleting directory
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/contrib/index
clean:
[echo] contrib: streaming
[delete] Deleting directory
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/contrib/streaming
clean:
[delete] Deleting directory
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build
[delete] Deleting directory
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/src/docs/build
BUILD SUCCESSFUL
Total time: 1 second
Buildfile: build.xml
check-for-checkstyle:
checkstyle:
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test
[checkstyle] Running Checkstyle 4.3 on 522 files
[xslt] Processing
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/checkstyle-errors.xml
to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/checkstyle-errors.html
[xslt] Loading stylesheet
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/src/test/checkstyle-noframes-sorted.xsl
init:
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/classes
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/tools
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/src
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/webapps/task/WEB-INF
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/webapps/job/WEB-INF
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/webapps/dfs/WEB-INF
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/webapps/datanode/WEB-INF
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/webapps/secondary/WEB-INF
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/examples
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/ant
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/c++
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/classes
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/testjar
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/testshell
[touch] Creating /var/tmp/null1247805550
[delete] Deleting: /var/tmp/null1247805550
[copy] Copying 6 files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/webapps
create-c++-configure:
[exec] /opt/sfw/share/aclocal/progtest.m4:13: warning: underquoted
definition of AM_PATH_PROG_WITH_TEST
[exec] run info '(automake)Extending aclocal'
[exec] or see
http://sources.redhat.com/automake/automake.html#Extending%20aclocal
[exec] /opt/sfw/share/aclocal/lcmessage.m4:11: warning: underquoted
definition of AM_LC_MESSAGES
[exec] /opt/sfw/share/aclocal/gettext.m4:11: warning: underquoted
definition of AM_WITH_NLS
[exec] /opt/sfw/share/aclocal/gettext.m4:196: warning: underquoted
definition of AM_GNU_GETTEXT
[exec] /usr/sfw/share/aclocal/gtk.m4:7: warning: underquoted definition of
AM_PATH_GTK
[exec] /usr/sfw/share/aclocal/glib.m4:8: warning: underquoted definition
of AM_PATH_GLIB
[exec] /usr/sfw/share/aclocal/gimpprint.m4:8: warning: underquoted
definition of AM_PATH_GIMPPRINT
[exec] /opt/sfw/share/aclocal/progtest.m4:13: warning: underquoted
definition of AM_PATH_PROG_WITH_TEST
[exec] run info '(automake)Extending aclocal'
[exec] or see
http://sources.redhat.com/automake/automake.html#Extending%20aclocal
[exec] /opt/sfw/share/aclocal/lcmessage.m4:11: warning: underquoted
definition of AM_LC_MESSAGES
[exec] /opt/sfw/share/aclocal/gettext.m4:11: warning: underquoted
definition of AM_WITH_NLS
[exec] /opt/sfw/share/aclocal/gettext.m4:196: warning: underquoted
definition of AM_GNU_GETTEXT
[exec] /usr/sfw/share/aclocal/gtk.m4:7: warning: underquoted definition of
AM_PATH_GTK
[exec] /usr/sfw/share/aclocal/glib.m4:8: warning: underquoted definition
of AM_PATH_GLIB
[exec] /usr/sfw/share/aclocal/gimpprint.m4:8: warning: underquoted
definition of AM_PATH_GIMPPRINT
[exec] /opt/sfw/share/aclocal/progtest.m4:13: warning: underquoted
definition of AM_PATH_PROG_WITH_TEST
[exec] run info '(automake)Extending aclocal'
[exec] or see
http://sources.redhat.com/automake/automake.html#Extending%20aclocal
[exec] /opt/sfw/share/aclocal/lcmessage.m4:11: warning: underquoted
definition of AM_LC_MESSAGES
[exec] /opt/sfw/share/aclocal/gettext.m4:11: warning: underquoted
definition of AM_WITH_NLS
[exec] /opt/sfw/share/aclocal/gettext.m4:196: warning: underquoted
definition of AM_GNU_GETTEXT
[exec] /usr/sfw/share/aclocal/gtk.m4:7: warning: underquoted definition of
AM_PATH_GTK
[exec] /usr/sfw/share/aclocal/glib.m4:8: warning: underquoted definition
of AM_PATH_GLIB
[exec] /usr/sfw/share/aclocal/gimpprint.m4:8: warning: underquoted
definition of AM_PATH_GIMPPRINT
[exec] /opt/sfw/share/aclocal/progtest.m4:13: warning: underquoted
definition of AM_PATH_PROG_WITH_TEST
[exec] run info '(automake)Extending aclocal'
[exec] or see
http://sources.redhat.com/automake/automake.html#Extending%20aclocal
[exec] /opt/sfw/share/aclocal/lcmessage.m4:11: warning: underquoted
definition of AM_LC_MESSAGES
[exec] /opt/sfw/share/aclocal/gettext.m4:11: warning: underquoted
definition of AM_WITH_NLS
[exec] /opt/sfw/share/aclocal/gettext.m4:196: warning: underquoted
definition of AM_GNU_GETTEXT
[exec] /usr/sfw/share/aclocal/gtk.m4:7: warning: underquoted definition of
AM_PATH_GTK
[exec] /usr/sfw/share/aclocal/glib.m4:8: warning: underquoted definition
of AM_PATH_GLIB
[exec] /usr/sfw/share/aclocal/gimpprint.m4:8: warning: underquoted
definition of AM_PATH_GIMPPRINT
[exec] /opt/sfw/share/aclocal/progtest.m4:13: warning: underquoted
definition of AM_PATH_PROG_WITH_TEST
[exec] run info '(automake)Extending aclocal'
[exec] or see
http://sources.redhat.com/automake/automake.html#Extending%20aclocal
[exec] /opt/sfw/share/aclocal/lcmessage.m4:11: warning: underquoted
definition of AM_LC_MESSAGES
[exec] /opt/sfw/share/aclocal/gettext.m4:11: warning: underquoted
definition of AM_WITH_NLS
[exec] /opt/sfw/share/aclocal/gettext.m4:196: warning: underquoted
definition of AM_GNU_GETTEXT
[exec] /usr/sfw/share/aclocal/gtk.m4:7: warning: underquoted definition of
AM_PATH_GTK
[exec] /usr/sfw/share/aclocal/glib.m4:8: warning: underquoted definition
of AM_PATH_GLIB
[exec] /usr/sfw/share/aclocal/gimpprint.m4:8: warning: underquoted
definition of AM_PATH_GIMPPRINT
[exec] /opt/sfw/share/aclocal/progtest.m4:13: warning: underquoted
definition of AM_PATH_PROG_WITH_TEST
[exec] run info '(automake)Extending aclocal'
[exec] or see
http://sources.redhat.com/automake/automake.html#Extending%20aclocal
[exec] /opt/sfw/share/aclocal/lcmessage.m4:11: warning: underquoted
definition of AM_LC_MESSAGES
[exec] /opt/sfw/share/aclocal/gettext.m4:11: warning: underquoted
definition of AM_WITH_NLS
[exec] /opt/sfw/share/aclocal/gettext.m4:196: warning: underquoted
definition of AM_GNU_GETTEXT
[exec] /usr/sfw/share/aclocal/gtk.m4:7: warning: underquoted definition of
AM_PATH_GTK
[exec] /usr/sfw/share/aclocal/glib.m4:8: warning: underquoted definition
of AM_PATH_GLIB
[exec] /usr/sfw/share/aclocal/gimpprint.m4:8: warning: underquoted
definition of AM_PATH_GIMPPRINT
clover.setup:
[mkdir] Created dir:
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/clover/db
[clover-setup] Clover Version 1.3.13, built on September 04 2006
[clover-setup] loaded from:
/export/home/hudson/tools/clover/latest/lib/clover.jar
[clover-setup] Open Source License registered to the Apache Software
Foundation. This license of Clover is provided to support projects of the
Apache Software Foundation only.
[clover-setup]
[clover-setup] Clover is enabled with initstring
'/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/clover/db/hadoop_coverage.db'
clover.info:
clover:
init:
[touch] Creating /var/tmp/null1247805550
[delete] Deleting: /var/tmp/null1247805550
record-parser:
compile-rcc-compiler:
[javac] Compiling 29 source files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/classes
[clover] Clover Version 1.3.13, built on September 04 2006
[clover] loaded from: /export/home/hudson/tools/clover/latest/lib/clover.jar
[clover] Open Source License registered to the Apache Software Foundation.
This license of Clover is provided to support projects of the Apache Software
Foundation only.
[clover]
[clover] Processing files at 1.3 source level.
[clover] No coverage database
'/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/clover/db/hadoop_coverage.db'
found. Creating a fresh one.
[clover] Clover all over. Instrumented 29 files.
compile-core-classes:
[javac] Compiling 520 source files to
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/classes
[clover] Clover Version 1.3.13, built on September 04 2006
[clover] loaded from: /export/home/hudson/tools/clover/latest/lib/clover.jar
[clover] Open Source License registered to the Apache Software Foundation.
This license of Clover is provided to support projects of the Apache Software
Foundation only.
[clover]
[clover] Processing files at 1.3 source level.
[clover] Updating database at
'/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/clover/db/hadoop_coverage.db'
[clover]
/var/tmp/clover29414.tmp/src29415.tmp/org/apache/hadoop/fs/FileUtil.java.tmp:508:10:unexpected
token: OSType
[clover] line 508: unexpected token: OSType
[clover] ** Error(s) occurred and the instrumentation process can't continue.
BUILD FAILED
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build.xml:323:
line 508: unexpected token: OSType
Total time: 1 minute 21 seconds
Recording fingerprints
Publishing Javadoc
Recording test results
