Hi Nipun,
Loading such a large dataset is not advisable with the RDF Providers
as this requires a non-transactional load which is exceeding the log
size limit due to its size.
We have documentation on how to load the Uniprot dataset which we and
other have used successfully as detailed at:
http://docs.openlinksw.com/virtuoso/
rdfperformancetuning.html#rdfperfloadingunitpro
I would suggest you use this method instead.
Note we are planning to release a pre-built Virtuoso Amazon EC2 AMI
for Uniprot as we have already done for DBpedia as detailed at:
http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/
VirtEC2AMIDBpediaInstall
So, look out for the announcement ...
Best Regards
Hugh Williams
Professional Services
OpenLink Software
Web: http://www.openlinksw.com
Support: http://support.openlinksw.com
Forums: http://boards.openlinksw.com/support
On 1 Dec 2008, at 22:54, Nipun Bhatia wrote:
Sorry for reposting, but I realized I wasn't a member when I posted
earlier.
Hi
I am using the virtuoso sesame adapter to load 10 Million triples of
Uniprot data into Virtuoso. However, after running for some time I get
the following error:
Exception in thread "main" org.openrdf.repository.RepositoryException:
Problem with rollback
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.rollback
(Unknown
Source)
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown
Source)
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown
Source)
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown
Source)
at Loader.main(Loader.java:27)
Caused by: virtuoso.jdbc3.VirtuosoException: SR325: Transaction
aborted
because it's log after image size went above the limit
at virtuoso.jdbc3.VirtuosoConnection.rollback(Unknown Source)
... 5 more
Code Snippet:
Repository myRepository = new
VirtuosoRepository("jdbc:virtuoso://localhost:1111","dba","dba");
myRepository.initialize();
File file = new File("C://Independent Study//uniprot_1M7.0.rdf");
long startSystemTime = System.currentTimeMillis();
RepositoryConnection con = myRepository.getConnection(); con.add(file,
null, RDFFormat.RDFXML);
long elapsedSystemTime = System.currentTimeMillis() - startSystemTime;
System.out .println("System Time to Load data using Sesame +
Virtuoso in
(in ms):"+ elapsedSystemTime);
con.close();
Virtuoso ini file:
[Database]
DatabaseFile = virtuoso.db
ErrorLogFile = virtuoso.log
LockFile = virtuoso.lck
TransactionFile = virtuoso.trx
xa_persistent_file = virtuoso.pxa
ErrorLogLevel = 7
FileExtend = 200
MaxCheckpointRemap = 2000
Striping = 0
TempStorage = TempDatabase
[TempDatabase]
DatabaseFile = virtuoso-temp.db
TransactionFile = virtuoso-temp.trx
MaxCheckpointRemap = 2000
Striping = 0
Any help would be appreciated
Cheers
----------------------------------------------------------------------
---
This SF.Net email is sponsored by the Moblin Your Move Developer's
challenge
Build the coolest Linux based applications with Moblin SDK & win
great prizes
Grand prize is a trip for two to an Open Source event anywhere in
the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Virtuoso-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/virtuoso-devel
