I did notice one warning when running the tests, but most likely unrelated, and
expected for some test.
09:18:56 WARN TDB :: Location
/home/kinow/Development/java/jena/jena/jena-tdb/target/tdb-testing/DB/ was not
locked, if another JVM accessed this location simultaneously data corruption
may have occurred
Morning Andy,
I have access to a Windows machine at work where I can quickly start a build
later this week.
Thanks for looking into it. Decided to reply e-mails and provide more
information before leaving to the office, so that I had another chance at
running the tests in this environment where the bugs always happen - i.e. not
intermittent in my local workstation from what I can tell.
1/ Could you try running the test in isolation? it should run in Eclipse
by pointing at the test and running just that one @Test.
Sorry, I should have included this in the previous e-mail. Running the test in
isolation in Eclipse works. Running the test in isolation in Maven also works
(i.e. mvn clean test install -Dtest=TestDatabaseOps -DfailIfNoTests=no).
2/ Run with mvn -fn (--fail-never) which should make maven run the other
>modules and tests so showing if there are any other problems.
Managed to wait just until this run of `mvn clean test install
-Dmaven.javadoc.skip -fn` passed the TDB2 project. The issue happened, but I
couldn't wait for the other tests to run. Gotta rush to the office. I did
notice one warning when running the tests, but most likely unrelated, and
expected for some test.
09:18:56 WARN TDB :: Location
/home/kinow/Development/java/jena/jena/jena-tdb/target/tdb-testing/DB/ was not
locked, if another JVM accessed this location simultaneously data corruption
may have occurred
Going to build the project at work, and send a stack trace (didn't see one last
night, but was running the test just before calling a day).
CheersBruno
From: Andy Seaborne <a...@apache.org>
To: dev@jena.apache.org
Sent: Thursday, 26 October 2017 6:33 AM
Subject: @Test TestDatabaseOps.compact_prefixes_3 [Was Re: [] Release Apache
Jena 3.5.0]
Bruno,
The absence of the Data-0001 is very strange. It is created for every
test in the DatabaseMgr.connectDatasetGraph call and other tests work.
I don't have access to OSX or Windows for testing and compaction is
playing around with directories and files on disk (java, portable, ...)
but the code for compaction, and its tests, is quite recent.
I did run a build+test with source-release zip file on Linux.
A few things to try:
1/ Could you try running the test in isolation? it should run in Eclipse
by pointing at the test and running just that one @Test.
Is there a stacktrace?
2/ Run with mvn -fn (--fail-never) which should make maven run the other
modules and tests so showing if there are any other problems.
3/ I can see that parallel tests would mess it up the test setup. I've
just read the surefire plugin docs and I'm still not sure what he
default is - it might be thread per core. Can you try forcing no
parallel tests please? [*]
I can't see a NPE place in line 142, I'm guessing it comes in the
Txn.executeRead that follows.
g.getPrefixMapping().getNsURIPrefix(
and I'll guess that its the second object access (getPrefixMapping())
but it might be deeper - no stack trace?
I can't see how that connects to the absence of Data-0001.
[*]
Module jena-tdb2 does not set up surefire and replies on defaults. It
should run TC_TDB
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-surefire-report-plugin</artifactId>
<configuration>
<includes>
<include>**/TC_*.java</include>
</includes>
</configuration>
</plugin>
Andy
On 25/10/17 12:19, Bruno P. Kinoshita wrote:
I think one of the tests is failing when I run
`mvn clean test install`, and also when I run the same `mvn clean test -e -X
-DforkMode=never` in debug mode in Eclipse.
The compact_prefixes_3 test method expects a directory like DB/Data-0001, but
there is only a DB folder. The methods to create the Data-0001 switchable
location was called, but for some reason nothing happened.
Didn't have much time to thoroughly investigate it, so will have to leave the
error here for others to take a look. Will have more time to look into it
tomorrow evening NZ time.
Running org.apache.jena.tdb2.sys.TestDatabaseOps
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.028 sec <<<
FAILURE! - in org.apache.jena.tdb2.sys.TestDatabaseOps
compact_prefixes_3(org.apache.jena.tdb2.sys.TestDatabaseOps) Time elapsed: 0.053 sec
<<< ERROR!
java.lang.NullPointerException
at
org.apache.jena.tdb2.sys.TestDatabaseOps.compact_prefixes_3(TestDatabaseOps.java:142)
Running org.apache.jena.tdb2.sys.TestSys
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in
org.apache.jena.tdb2.sys.TestSys
Running org.apache.jena.tdb2.sys.TestDatabaseConnection
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.103 sec - in
org.apache.jena.tdb2.sys.TestDatabaseConnection
Running org.apache.jena.tdb2.assembler.TestTDBAssembler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.449 sec - in
org.apache.jena.tdb2.assembler.TestTDBAssembler
Running org.apache.jena.tdb2.TestDatabaseMgr
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.088 sec - in
org.apache.jena.tdb2.TestDatabaseMgr
Running org.apache.jena.tdb2.solver.TestSolverTDB
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 sec - in
org.apache.jena.tdb2.solver.TestSolverTDB
Running org.apache.jena.tdb2.solver.TestStats
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in
org.apache.jena.tdb2.solver.TestStats
Results :
Tests in error:
TestDatabaseOps.compact_prefixes_3:142 ยป NullPointer
Tests run: 537, Failures: 0, Errors: 1, Skipped: 7
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Jena - Project .............................. SUCCESS [ 1.902 s]
[INFO] Apache Jena - Shadowed external libraries .......... SUCCESS [ 16.081 s]
[INFO] Apache Jena - IRI .................................. SUCCESS [ 5.970 s]
[INFO] Apache Jena - Base Common Environment .............. SUCCESS [ 16.289 s]
[INFO] Apache Jena - Core ................................. SUCCESS [01:28 min]
[INFO] Apache Jena - ARQ (SPARQL 1.1 Query Engine) ........ SUCCESS [01:30 min]
[INFO] Apache Jena - RDF Connection ....................... SUCCESS [ 8.349 s]
[INFO] Apache Jena - TDB (Native Triple Store) ............ SUCCESS [ 24.995 s]
[INFO] Apache Jena - Database Operation Environment ....... SUCCESS [ 0.201 s]
[INFO] Apache Jena - DBOE Base ............................ SUCCESS [ 9.072 s]
[INFO] Apache Jena - DBOE Transactions .................... SUCCESS [ 7.257 s]
[INFO] Apache Jena - DBOE Indexes ......................... SUCCESS [ 4.289 s]
[INFO] Apache Jena - DBOE Index test suite ................ SUCCESS [ 4.663 s]
[INFO] Apache Jena - DBOE Transactional Datastructures .... SUCCESS [ 11.756 s]
[INFO] Apache Jena - TDB2 ................................. FAILURE [ 13.688 s]
[INFO] Apache Jena - Libraries POM ........................ SKIPPED
[INFO] Apache Jena - Command line tools ................... SKIPPED
[INFO] Apache Jena - SPARQL Text Search ................... SKIPPED
[INFO] Apache Jena - SPARQL Text Search - Elasticsearch ... SKIPPED
[INFO] Apache Jena - SPARQL Spatial Search ................ SKIPPED
[INFO] Apache Jena - Fuseki - A SPARQL 1.1 Server ......... SKIPPED
[INFO] Apache Jena - Fuseki Server Engine ................. SKIPPED
[INFO] Apache Jena - Fuseki Embedded Server ............... SKIPPED
[INFO] Apache Jena - Fuseki WAR File ...................... SKIPPED
[INFO] Apache Jena - Fuseki Server Standalone Jar ......... SKIPPED
[INFO] Apache Jena - Fuseki Basic Server .................. SKIPPED
[INFO] Apache Jena - Fuseki Binary Distribution ........... SKIPPED
[INFO] Apache Jena - Integration Testing .................. SKIPPED
[INFO] Apache Jena - Distribution ......................... SKIPPED
[INFO] Apache Jena - Fuseki1 .............................. SKIPPED
[INFO] Apache Jena - Data Tables for RDF and SPARQL ....... SKIPPED
[INFO] Apache Jena - SDB (SQL based triple store) ......... SKIPPED
[INFO] Apache Jena - Maven Plugins, including schemagen ... SKIPPED
[INFO] Apache Jena - Security Permissions ................. SKIPPED
[INFO] Apache Jena - Extras ............................... SKIPPED
[INFO] Apache Jena - Extras - Query Builder ............... SKIPPED
[INFO] Apache Jena - JDBC Parent .......................... SKIPPED
[INFO] Apache Jena - JDBC Core API ........................ SKIPPED
[INFO] Apache Jena - JDBC Remote Endpoint Driver .......... SKIPPED
[INFO] Apache Jena - JDBC In-Memory Driver ................ SKIPPED
[INFO] Apache Jena - JDBC TDB Driver ...................... SKIPPED
[INFO] Apache Jena - JDBC Driver Bundle ................... SKIPPED
[INFO] Apache Jena - Elephas .............................. SKIPPED
[INFO] Apache Jena - Elephas - Common API ................. SKIPPED
[INFO] Apache Jena - Elephas - I/O ........................ SKIPPED
[INFO] Apache Jena - Elephas - Map/Reduce ................. SKIPPED
[INFO] Apache Jena - Elephas - Statistics Demo App ........ SKIPPED
[INFO] Apache Jena - OSGi ................................. SKIPPED
[INFO] Apache Jena - OSGi bundle .......................... SKIPPED
[INFO] Apache Jena - OSGi Karaf features .................. SKIPPED
[INFO] Apache Jena ........................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:20 min
[INFO] Finished at: 2017-10-25T22:46:37+13:00
[INFO] Final Memory: 91M/1478M
[INFO] ------------------------------------------------------------------------
Bruno
________________________________
From: Andy Seaborne <a...@apache.org>
To: dev@jena.apache.org
Sent: Wednesday, 25 October 2017 5:47 AM
Subject: [VOTE] Release Apache Jena 3.5.0
Hi,
Here is a vote on a release of Jena 3.5.0.
This is the first proposed candidate for a 3.5.0 release.
Note - the deadline is 18:00 UTC on Friday - not midnight - if things go
well, I am be able to push bytes out Friday evening and have them sync
over night.
==== Release changes
Introducing TDB2:
http://jena.staging.apache.org/documentation/tdb2/
*TDB2 is not compatible with TDB1*
Compared to TDB1:
* No size limits on transactions : bulk uploads into a live Fuseki
can be 100's of millions of triples.
* Models and Graphs can be passed across transactions
* No queue of delayed updates, no transaction backlog problems.
* "Writer pays" - readers don't
All work for update is done on the writer thread.
* Datatypes of numerics preserved; xsd:doubles supported.
TDB2 is subject to change.
We solicit any and all feedback (good and bad!) about TDB2 to help
advance it to deployment-ready.
JENA-1390 : Add StmtIterator.toModel :
JENA-1392 : Add dynamic dataset support to SDB.
JENA-1395 : "--output RDF/XML" now prints using the basic block-oriented
writer, which uses less memory. Use "--formatted" (same as "--pretty")
for pretty printed RDF/XML.
JENA-1398 :
Upgrade FOAF to add new spelling and deprecation of old for archaic FOAF
properties
== Dependency changes:
No license changes.
Upgrade jsonld-java to 0.11
jackson to 2.9.0
commons-fileuploader to 1.3.2->1.3.3
commons-io 2.5 in jena-base
(was pulled in anyway by jsonld-java)
==== Release Vote
Everyone, not just committers, is invited to test and vote.
Please download and test the proposed release.
Staging repository:
https://repository.apache.org/content/repositories/orgapachejena-1019/
Proposed dist/ area:
https://dist.apache.org/repos/dist/dev/jena/
Keys:
https://svn.apache.org/repos/asf/jena/dist/KEYS
Git commit (browser URL):
http://git-wip-us.apache.org/repos/asf/jena/commit/8235ee33
Git Commit Hash:
8235ee335eea114aecffd55525ad36e408a2f39b
Git Commit Tag:
jena-3.5.0-rc1
Please vote to approve this release:
[ ] +1 Approve the release
[ ] 0 Don't care
[ ] -1 Don't release, because ...
This vote will be open to at least
Friday, 2017-10-27, 18:00 UTC.
If you expect to check the release but the 72 hour limit does not work
for you, please email within the schedule above with an expected time
and we can extend the vote period.
Thanks,
Andy
Checking needed:
+ does everything work on Linux?
+ does everything work on MS Windows?
+ does everything work on OS X?
+ are the GPG signatures fine?
+ are the checksums correct?
+ is there a source archive?
+ can the source archive really be built?
(NB This requires a "mvn install" first time)
+ is there a correct LICENSE and NOTICE file in each artifact
(both source and binary artifacts)?
+ does the NOTICE file contain all necessary attributions?
+ have any licenses of dependencies changed due to upgrades?
if so have LICENSE and NOTICE been upgraded appropriately?
+ does the tag/commit in the SCM contain reproducible sources?
