Re: @Test TestDatabaseOps.compact_prefixes_3 [Was Re: [] Release Apache Jena 3.5.0]

Wed, 25 Oct 2017 12:40:06 -0700 

Jena_Development_Test#2766 shows the same test failure. Ubuntu.

The changes for that run were unrelated to TDB2.
So we have an intermittent failure and it suggests it is the test harness (the test itself is entirely deterministic).
Jenkins is a bit unwell at the moment and things are very slow - there is a jena-core failure that occurs as well in an area that has changed in a long while. 

So Jenkins might trigger the intermittent test situation.

ajs6f - You ran tests for the version bump?
        TDB2 is in the -Pdev profile.

Rob - did you run -Pdev?

        Andy

On 25/10/17 18:26, Andy Seaborne wrote:

Bruno,
The absence of the Data-0001 is very strange. It is created for every test in the DatabaseMgr.connectDatasetGraph call and other tests work.
I don't have access to OSX or Windows for testing and compaction is playing around with directories and files on disk (java, portable, ...) but the code for compaction, and its tests, is quite recent. 

I did run a build+test with source-release zip file on Linux.

A few things to try:
1/ Could you try running the test in isolation? it should run in Eclipse by pointing at the test and running just that one @Test. 

Is there a stacktrace?
2/ Run with mvn -fn (--fail-never) which should make maven run the other modules and tests so showing if there are any other problems.
3/ I can see that parallel tests would mess it up the test setup. I've just read the surefire plugin docs and I'm still not sure what he default is - it might be thread per core.  Can you try forcing no parallel tests please? [*]
I can't see a NPE place in line 142, I'm guessing it comes in the Txn.executeRead that follows. 

g.getPrefixMapping().getNsURIPrefix(
and I'll guess that its the second object access (getPrefixMapping()) but it might be deeper - no stack trace? 

I can't see how that connects to the absence of Data-0001.


[*]
Module jena-tdb2 does not set up surefire and replies on defaults. It should run TC_TDB 

       <plugin>
         <groupId>org.apache.maven.plugins</groupId>
         <artifactId>maven-surefire-report-plugin</artifactId>
         <configuration>
           <includes>
             <include>**/TC_*.java</include>
           </includes>
         </configuration>
       </plugin>


     Andy


On 25/10/17 12:19, Bruno P. Kinoshita wrote:

I think one of the tests is failing when I run
`mvn clean test install`, and also when I run the same `mvn clean test -e -X -DforkMode=never` in debug mode in Eclipse.
The compact_prefixes_3 test method expects a directory like DB/Data-0001, but there is only a DB folder. The methods to create the Data-0001 switchable location was called, but for some reason nothing happened.
Didn't have much time to thoroughly investigate it, so will have to leave the error here for others to take a look. Will have more time to look into it tomorrow evening NZ time. 
Running org.apache.jena.tdb2.sys.TestDatabaseOps
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.028 sec <<< FAILURE! - in org.apache.jena.tdb2.sys.TestDatabaseOps compact_prefixes_3(org.apache.jena.tdb2.sys.TestDatabaseOps)  Time elapsed: 0.053 sec  <<< ERROR! 
java.lang.NullPointerException
at org.apache.jena.tdb2.sys.TestDatabaseOps.compact_prefixes_3(TestDatabaseOps.java:142) 

Running org.apache.jena.tdb2.sys.TestSys
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in org.apache.jena.tdb2.sys.TestSys 
Running org.apache.jena.tdb2.sys.TestDatabaseConnection
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.103 sec - in org.apache.jena.tdb2.sys.TestDatabaseConnection 
Running org.apache.jena.tdb2.assembler.TestTDBAssembler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.449 sec - in org.apache.jena.tdb2.assembler.TestTDBAssembler 
Running org.apache.jena.tdb2.TestDatabaseMgr
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.088 sec - in org.apache.jena.tdb2.TestDatabaseMgr 
Running org.apache.jena.tdb2.solver.TestSolverTDB
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 sec - in org.apache.jena.tdb2.solver.TestSolverTDB 
Running org.apache.jena.tdb2.solver.TestStats
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in org.apache.jena.tdb2.solver.TestStats 

Results :

Tests in error:
   TestDatabaseOps.compact_prefixes_3:142 » NullPointer

Tests run: 537, Failures: 0, Errors: 1, Skipped: 7
[INFO] ------------------------------------------------------------------------ 
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Jena - Project .............................. SUCCESS [ 1.902 s] [INFO] Apache Jena - Shadowed external libraries .......... SUCCESS [ 16.081 s] [INFO] Apache Jena - IRI .................................. SUCCESS [ 5.970 s] [INFO] Apache Jena - Base Common Environment .............. SUCCESS [ 16.289 s] [INFO] Apache Jena - Core ................................. SUCCESS [01:28 min] [INFO] Apache Jena - ARQ (SPARQL 1.1 Query Engine) ........ SUCCESS [01:30 min] [INFO] Apache Jena - RDF Connection ....................... SUCCESS [ 8.349 s] [INFO] Apache Jena - TDB (Native Triple Store) ............ SUCCESS [ 24.995 s] [INFO] Apache Jena - Database Operation Environment ....... SUCCESS [ 0.201 s] [INFO] Apache Jena - DBOE Base ............................ SUCCESS [ 9.072 s] [INFO] Apache Jena - DBOE Transactions .................... SUCCESS [ 7.257 s] [INFO] Apache Jena - DBOE Indexes ......................... SUCCESS [ 4.289 s] [INFO] Apache Jena - DBOE Index test suite ................ SUCCESS [ 4.663 s] [INFO] Apache Jena - DBOE Transactional Datastructures .... SUCCESS [ 11.756 s] [INFO] Apache Jena - TDB2 ................................. FAILURE [ 13.688 s] 
[INFO] Apache Jena - Libraries POM ........................ SKIPPED
[INFO] Apache Jena - Command line tools ................... SKIPPED
[INFO] Apache Jena - SPARQL Text Search ................... SKIPPED
[INFO] Apache Jena - SPARQL Text Search - Elasticsearch ... SKIPPED
[INFO] Apache Jena - SPARQL Spatial Search ................ SKIPPED
[INFO] Apache Jena - Fuseki - A SPARQL 1.1 Server ......... SKIPPED
[INFO] Apache Jena - Fuseki Server Engine ................. SKIPPED
[INFO] Apache Jena - Fuseki Embedded Server ............... SKIPPED
[INFO] Apache Jena - Fuseki WAR File ...................... SKIPPED
[INFO] Apache Jena - Fuseki Server Standalone Jar ......... SKIPPED
[INFO] Apache Jena - Fuseki Basic Server .................. SKIPPED
[INFO] Apache Jena - Fuseki Binary Distribution ........... SKIPPED
[INFO] Apache Jena - Integration Testing .................. SKIPPED
[INFO] Apache Jena - Distribution ......................... SKIPPED
[INFO] Apache Jena - Fuseki1 .............................. SKIPPED
[INFO] Apache Jena - Data Tables for RDF and SPARQL ....... SKIPPED
[INFO] Apache Jena - SDB (SQL based triple store) ......... SKIPPED
[INFO] Apache Jena - Maven Plugins, including schemagen ... SKIPPED
[INFO] Apache Jena - Security Permissions ................. SKIPPED
[INFO] Apache Jena - Extras ............................... SKIPPED
[INFO] Apache Jena - Extras - Query Builder ............... SKIPPED
[INFO] Apache Jena - JDBC Parent .......................... SKIPPED
[INFO] Apache Jena - JDBC Core API ........................ SKIPPED
[INFO] Apache Jena - JDBC Remote Endpoint Driver .......... SKIPPED
[INFO] Apache Jena - JDBC In-Memory Driver ................ SKIPPED
[INFO] Apache Jena - JDBC TDB Driver ...................... SKIPPED
[INFO] Apache Jena - JDBC Driver Bundle ................... SKIPPED
[INFO] Apache Jena - Elephas .............................. SKIPPED
[INFO] Apache Jena - Elephas - Common API ................. SKIPPED
[INFO] Apache Jena - Elephas - I/O ........................ SKIPPED
[INFO] Apache Jena - Elephas - Map/Reduce ................. SKIPPED
[INFO] Apache Jena - Elephas - Statistics Demo App ........ SKIPPED
[INFO] Apache Jena - OSGi ................................. SKIPPED
[INFO] Apache Jena - OSGi bundle .......................... SKIPPED
[INFO] Apache Jena - OSGi Karaf features .................. SKIPPED
[INFO] Apache Jena ........................................ SKIPPED
[INFO] ------------------------------------------------------------------------ 
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------ 
[INFO] Total time: 05:20 min
[INFO] Finished at: 2017-10-25T22:46:37+13:00
[INFO] Final Memory: 91M/1478M
[INFO] ------------------------------------------------------------------------ 

Bruno

________________________________
From: Andy Seaborne <a...@apache.org>
To: dev@jena.apache.org
Sent: Wednesday, 25 October 2017 5:47 AM
Subject: [VOTE] Release Apache Jena 3.5.0



Hi,


Here is a vote on a release of Jena 3.5.0.


This is the first proposed candidate for a 3.5.0 release.


Note - the deadline is 18:00 UTC on Friday - not midnight - if things go

well, I am be able to push bytes out Friday evening and have them sync

over night.



==== Release changes


Introducing TDB2:

http://jena.staging.apache.org/documentation/tdb2/


*TDB2 is not compatible with TDB1*


Compared to TDB1:

* No size limits on transactions : bulk uploads into a live Fuseki

    can be 100's of millions of triples.

* Models and Graphs can be passed across transactions

* No queue of delayed updates, no transaction backlog problems.

* "Writer pays" - readers don't

    All work for update is done on the writer thread.

* Datatypes of numerics preserved; xsd:doubles supported.


TDB2 is subject to change.


We solicit any and all feedback (good and bad!) about TDB2 to help

advance it to deployment-ready.



JENA-1390 : Add StmtIterator.toModel :


JENA-1392 : Add dynamic dataset support to SDB.


JENA-1395 : "--output RDF/XML" now prints using the basic block-oriented

writer, which uses less memory.  Use "--formatted" (same as "--pretty")

for pretty printed RDF/XML.


JENA-1398 :

Upgrade FOAF to add new spelling and deprecation of old for archaic FOAF

properties


== Dependency changes:


No license changes.


Upgrade jsonld-java to 0.11

    jackson to 2.9.0

    commons-fileuploader to 1.3.2->1.3.3

    commons-io 2.5 in jena-base

      (was pulled in anyway by jsonld-java)


==== Release Vote


Everyone, not just committers, is invited to test and vote.

Please download and test the proposed release.


Staging repository:

   https://repository.apache.org/content/repositories/orgapachejena-1019/


Proposed dist/ area:

     https://dist.apache.org/repos/dist/dev/jena/


Keys:

     https://svn.apache.org/repos/asf/jena/dist/KEYS


Git commit (browser URL):

     http://git-wip-us.apache.org/repos/asf/jena/commit/8235ee33


Git Commit Hash:

      8235ee335eea114aecffd55525ad36e408a2f39b


Git Commit Tag:

      jena-3.5.0-rc1


Please vote to approve this release:


        [ ] +1 Approve the release

        [ ]  0 Don't care

        [ ] -1 Don't release, because ...


This vote will be open to at least


        Friday, 2017-10-27, 18:00 UTC.


If you expect to check the release but the 72 hour limit does not work

for you, please email within the schedule above with an expected time

and we can extend the vote period.


Thanks,


      Andy


Checking needed:


+ does everything work on Linux?

+ does everything work on MS Windows?

+ does everything work on OS X?

+ are the GPG signatures fine?

+ are the checksums correct?

+ is there a source archive?


+ can the source archive really be built?

          (NB This requires a "mvn install" first time)

+ is there a correct LICENSE and NOTICE file in each artifact

          (both source and binary artifacts)?

+ does the NOTICE file contain all necessary attributions?

+ have any licenses of dependencies changed due to upgrades?

           if so have LICENSE and NOTICE been upgraded appropriately?

+ does the tag/commit in the SCM contain reproducible sources?

Reply via email to