The test fails because it expects 7 events, but receives 5. Looking in
the logs we see two of these stack traces showing an NPE way down in
datanucleus. Other than helping upgrade DN to a newer (and supported)
version it doesn't seem worth the time to try and fix this.
12/09/06 19:32:48 ERROR listener.NotificationListener: Failed to send
message on topic: hcat.mydb event: HCAT_DROP_TABLE
java.lang.NullPointerException
at
org.datanucleus.store.AbstractStoreManager.getConnection(AbstractStoreManager.java:301)
at
org.datanucleus.store.rdbms.scostore.RDBMSElementContainerStoreSpecialization.getSize(RDBMSElementContainerStoreSpecialization.java:261)
at
org.datanucleus.store.rdbms.scostore.RDBMSJoinListStoreSpecialization.getSize(RDBMSJoinListStoreSpecialization.java:46)
at
org.datanucleus.store.mapped.scostore.ElementContainerStore.size(ElementContainerStore.java:440)
at org.datanucleus.sco.backed.List.size(List.java:557)
at
org.apache.hadoop.hive.metastore.api.SkewedInfo.write(SkewedInfo.java:567)
at
org.apache.hadoop.hive.metastore.api.StorageDescriptor.write(StorageDescriptor.java:1290)
at org.apache.hadoop.hive.metastore.api.Table.write(Table.java:1338)
at
org.apache.hadoop.hive.metastore.api.Table.writeObject(Table.java:1500)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:945)
at
java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1469)
at
java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1400)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1158)
at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:330)
at
org.apache.activemq.command.ActiveMQObjectMessage.storeContent(ActiveMQObjectMessage.java:105)
at
org.apache.activemq.command.ActiveMQObjectMessage.setObject(ActiveMQObjectMessage.java:162)
at
org.apache.activemq.ActiveMQSession.createObjectMessage(ActiveMQSession.java:380)
at
org.apache.hcatalog.listener.NotificationListener.send(NotificationListener.java:295)
at
org.apache.hcatalog.listener.NotificationListener.onDropTable(NotificationListener.java:234)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table_core(HiveMetaStore.java:1069)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table(HiveMetaStore.java:1176)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.dropTable(HiveMetaStoreClient.java:566)
at org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:808)
at org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:775)
at org.apache.hadoop.hive.ql.exec.DDLTask.dropTable(DDLTask.java:3066)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:270)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:135)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1112)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:945)
at
org.apache.hcatalog.listener.TestNotificationListener.testAMQListener(TestNotificationListener.java:125)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
--travis
On Thu, Sep 6, 2012 at 12:46 PM, Travis Crawford
<[email protected]> wrote:
> The build guys were awesome and fixed the issue we had earlier, where
> CI failed due to a corrupt maven cache.
>
> This failure is due to TestNotificationListener. I see this failing
> sometimes locally too, but haven't looked into it yet. Guess its time
> to :)
>
> --travis
>
>
> On Thu, Sep 6, 2012 at 12:40 PM, Apache Jenkins Server
> <[email protected]> wrote:
>> See <https://builds.apache.org/job/Hcatalog-trunk-build/262/changes>
>>
>> Changes:
>>
>> [travis] HCATALOG-397 Removal of unused parameter
>> hadoop.clientside.fs.operations
>>
>> ------------------------------------------
>> [...truncated 5752 lines...]
>> mvn-dependencies:
>>
>> init:
>>
>> compile-src:
>>
>> jar:
>>
>> javadoc:
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/docs/api>
>> [javadoc] Generating Javadoc
>> [javadoc] Javadoc execution
>> [javadoc] Loading source files for package org.apache.hcatalog.hbase...
>> [javadoc] Loading source files for package
>> org.apache.hcatalog.hbase.snapshot...
>> [javadoc] Loading source files for package
>> org.apache.hcatalog.hbase.snapshot.lock...
>> [javadoc] Loading source files for package
>> org.apache.hcatalog.hbase.snapshot.transaction.thrift...
>> [javadoc] Constructing Javadoc information...
>> [javadoc] Standard Doclet version 1.6.0_27
>> [javadoc] Building tree for all the packages and classes...
>> [javadoc] Building index for all the packages and classes...
>> [javadoc] Building index for all classes...
>>
>> docs:
>>
>> package:
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/hbase-storage-handler-0.4.0-SNAPSTHOT/conf>
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/hbase-storage-handler-0.4.0-SNAPSTHOT/lib>
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/hbase-storage-handler-0.4.0-SNAPSTHOT/docs>
>> [copy] Copying 1 file to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/hbase-storage-handler-0.4.0-SNAPSTHOT/lib>
>> [copy] Copying 76 files to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/hbase-storage-handler-0.4.0-SNAPSTHOT/docs>
>> [copy] Copying 1 file to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/hbase-storage-handler-0.4.0-SNAPSTHOT/conf>
>>
>> package-to-handlers:
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/hcatalog-0.4.0-SNAPSTHOT/share/hcatalog/storage-handlers/hbase>
>> [copy] Copying 2 files to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/hcatalog-0.4.0-SNAPSTHOT/share/hcatalog/storage-handlers/hbase>
>> [copy] Copying 1 file to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/hcatalog-0.4.0-SNAPSTHOT/share/hcatalog/lib>
>>
>> tar:
>> [tar] Building tar:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/262/artifact/trunk/build/hcatalog-0.4.0-SNAPSTHOT.tar.gz>
>>
>> _check-ivy-retrieve:
>>
>> ivy-download:
>> [echo] hcatalog
>> [get] Destination already exists (skipping):
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/ivy/ivy-2.2.0.jar>
>>
>> _ivy-init:
>>
>> ivy-init:
>> [copy] Copying 1 file to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/ivy>
>> [copy] Copying 1 file to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/ivy>
>>
>> ivy-retrieve:
>>
>> checkstyle-init:
>> Trying to override old definition of task checkstyle
>>
>> checkstyle:
>> [checkstyle] Running Checkstyle 5.5 on 277 files
>>
>> mvn-init:
>>
>> init:
>>
>> compile-src:
>>
>> shims:
>>
>> _check-ivy-retrieve:
>>
>> _ivy-init:
>> [echo] shims
>> [ivy:configure] :: loading settings :: file =
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/ivy/ivysettings.xml>
>>
>> ivy-init:
>>
>> ivy-retrieve:
>>
>> compile:
>> [echo] Project: shims
>>
>> jar:
>>
>> clientjar:
>> [artifact:install] [INFO] Installing
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/hcatalog/hcatalog-core-0.4.0-SNAPSTHOT.jar>
>> to
>> /home/jenkins/.m2/repository/org/apache/hcatalog/hcatalog-core/0.4.0-SNAPSTHOT/hcatalog-core-0.4.0-SNAPSTHOT.jar
>>
>> server-extensions:
>> [artifact:install] [INFO] Installing
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/hcatalog/hcatalog-server-extensions-0.4.0-SNAPSTHOT.jar>
>> to
>> /home/jenkins/.m2/repository/org/apache/hcatalog/hcatalog-server-extensions/0.4.0-SNAPSTHOT/hcatalog-server-extensions-0.4.0-SNAPSTHOT.jar
>>
>> jar-storage-handlers:
>>
>> jar:
>> [echo] Generating all handlers
>>
>> template:
>> [echo] Executing storage-handler "jar" for hbase
>>
>> mvn-init:
>> [get] Destination already exists (skipping):
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/maven-ant-tasks-2.1.3.jar>
>>
>> mvn-dependencies:
>>
>> init:
>>
>> compile-src:
>>
>> jar:
>>
>> jar:
>>
>> _check-ivy-retrieve:
>>
>> _ivy-init:
>> [echo] hcatalog-pig-adapter
>> [ivy:configure] :: loading settings :: file =
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/ivy/ivysettings.xml>
>>
>> ivy-init:
>>
>> ivy-retrieve:
>>
>> compile:
>> [echo] hcatalog-pig-adapter
>>
>> mvn-init:
>> [get] Destination already exists (skipping):
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/maven-ant-tasks-2.1.3.jar>
>>
>> jar:
>> [echo] hcatalog-pig-adapter
>> [artifact:install] [INFO] Installing
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/hcatalog-pig-adapter/build/hcatalog-pig-adapter-0.4.0-SNAPSTHOT.jar>
>> to
>> /home/jenkins/.m2/repository/org/apache/hcatalog/hcatalog-pig-adapter/0.4.0-SNAPSTHOT/hcatalog-pig-adapter-0.4.0-SNAPSTHOT.jar
>>
>> _check-ivy-retrieve:
>>
>> _ivy-init:
>> [echo] webhcat
>> [ivy:configure] :: loading settings :: file =
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/ivy/ivysettings.xml>
>>
>> ivy-init:
>>
>> ivy-retrieve:
>>
>> compile:
>> [echo] webhcat
>>
>> mvn-init:
>> [get] Destination already exists (skipping):
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/maven-ant-tasks-2.1.3.jar>
>>
>> jar:
>> [echo] webhcat
>> [artifact:install] [INFO] Installing
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/webhcat/svr/build/webhcat-0.4.0-SNAPSTHOT.jar>
>> to
>> /home/jenkins/.m2/repository/org/apache/hcatalog/webhcat/0.4.0-SNAPSTHOT/webhcat-0.4.0-SNAPSTHOT.jar
>>
>> _check-ivy-retrieve:
>>
>> _ivy-init:
>> [echo] webhcat-java-client
>> [ivy:configure] :: loading settings :: file =
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/ivy/ivysettings.xml>
>>
>> ivy-init:
>>
>> ivy-retrieve:
>>
>> compile:
>> [echo] webhcat-java-client
>>
>> mvn-init:
>> [get] Destination already exists (skipping):
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/maven-ant-tasks-2.1.3.jar>
>>
>> jar:
>> [echo] webhcat-java-client
>> [artifact:install] [INFO] Installing
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/webhcat/java-client/build/webhcat-java-client-0.4.0-SNAPSTHOT.jar>
>> to
>> /home/jenkins/.m2/repository/org/apache/hcatalog/webhcat-java-client/0.4.0-SNAPSTHOT/webhcat-java-client-0.4.0-SNAPSTHOT.jar
>>
>> compile-test:
>> [javac] Compiling 35 source files to
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/test/classes>
>> [javac] Note: Some input files use or override a deprecated API.
>> [javac] Note: Recompile with -Xlint:deprecation for details.
>> [javac] Note:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/src/test/org/apache/hcatalog/data/TestJsonSerDe.java>
>> uses unchecked or unsafe operations.
>> [javac] Note: Recompile with -Xlint:unchecked for details.
>>
>> test:
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/test/logs>
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/test/hcat_junit_warehouse>
>> [junit] WARNING: multiple versions of ant detected in path for junit
>> [junit]
>> jar:file:/home/jenkins/tools/ant/apache-ant-1.8.2/lib/ant.jar!/org/apache/tools/ant/Project.class
>> [junit] and
>> jar:<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/ivy/lib/test/ant-ant-1.6.5.jar!/org/apache/tools/ant/Project.class>
>> [junit] Running org.apache.hcatalog.cli.TestPermsGrp
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 16.744 sec
>> [junit] Running org.apache.hcatalog.cli.TestSemanticAnalysis
>> [junit] Tests run: 22, Failures: 0, Errors: 0, Time elapsed: 25.398 sec
>> [junit] Running org.apache.hcatalog.cli.TestUseDatabase
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 12.759 sec
>> [junit] Running org.apache.hcatalog.common.TestHCatUtil
>> [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 1.338 sec
>> [junit] Running org.apache.hcatalog.common.TestHiveClientCache
>> [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 41.437 sec
>> [junit] Shutting down hive metastore.
>> [junit] Running org.apache.hcatalog.data.TestDefaultHCatRecord
>> [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.467 sec
>> [junit] Running org.apache.hcatalog.data.TestHCatRecordSerDe
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.283 sec
>> [junit] Running org.apache.hcatalog.data.TestJsonSerDe
>> [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.544 sec
>> [junit] Running org.apache.hcatalog.data.TestLazyHCatRecord
>> [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.389 sec
>> [junit] Running org.apache.hcatalog.data.TestReaderWriter
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 10.182 sec
>> [junit] Running org.apache.hcatalog.data.schema.TestHCatSchema
>> [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.098 sec
>> [junit] Running org.apache.hcatalog.data.schema.TestHCatSchemaUtils
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.149 sec
>> [junit] Running org.apache.hcatalog.listener.TestMsgBusConnection
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 12.495 sec
>> [junit] Running org.apache.hcatalog.listener.TestNotificationListener
>> [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 13.17 sec
>> [junit] Test org.apache.hcatalog.listener.TestNotificationListener FAILED
>> [junit] Running org.apache.hcatalog.mapreduce.TestHCatDynamicPartitioned
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 52.131 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestHCatHiveCompatibility
>> [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 42.838 sec
>> [junit] Running
>> org.apache.hcatalog.mapreduce.TestHCatHiveThriftCompatibility
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 17.882 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestHCatInputFormat
>> [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 17.565 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 37.311 sec
>> [junit] Shutting down hive metastore.
>> [junit] Running org.apache.hcatalog.mapreduce.TestHCatNonPartitioned
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 19.436 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestHCatOutputFormat
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 10.83 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestHCatPartitioned
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 77.295 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestMultiOutputFormat
>> [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 68.887 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestPassProperties
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 13.414 sec
>> [junit] Running org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite
>> [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 66.092 sec
>> [junit] Running org.apache.hcatalog.rcfile.TestRCFileMapReduceInputFormat
>> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.338 sec
>> [junit] Running
>> org.apache.hcatalog.security.TestHdfsAuthorizationProvider
>> [junit] Tests run: 34, Failures: 0, Errors: 0, Time elapsed: 35.52 sec
>>
>> BUILD FAILED
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build.xml>:247:
>> The following error occurred while executing this line:
>> <https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/ant/test.xml>:62:
>> Tests failed!
>>
>> Total time: 21 minutes 53 seconds
>> Build step 'Execute shell' marked build as failure
>> Archiving artifacts
>> Recording test results
