Hi Nipun,

Did you not post this same question on December 1st, to which we sent the response below, or are you still having problems:

Loading such a large dataset is not advisable with the RDF Providers as this requires a non-transactional load which is exceeding the log size limit due to its size.

We have documentation on how to load the Uniprot dataset which we and other have used successfully as detailed at:

http://docs.openlinksw.com/virtuoso/ rdfperformancetuning.html#rdfperfloadingunitpro

I would suggest you use this method instead.

Note we are planning to release a pre-built Virtuoso Amazon EC2 AMI for Uniprot as we have already done for DBpedia as detailed at:

http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/ VirtEC2AMIDBpediaInstall

So, look out for the announcement ...

Best Regards
Hugh Williams
Professional Services
OpenLink Software
Web: http://www.openlinksw.com
Support: http://support.openlinksw.com
Forums: http://boards.openlinksw.com/support



On 1 Dec 2008, at 21:35, Nipun Bhatia wrote:

Hi
I am using the virtuoso sesame adapter to load 10 Million triples of
Uniprot data into Virtuoso. However, after running for some time I get
the following error:

Exception in thread "main" org.openrdf.repository.RepositoryException:
Problem with rollback
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.rollback (Unknown
Source)
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown Source) at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown Source) at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown Source)
at Loader.main(Loader.java:27)
Caused by: virtuoso.jdbc3.VirtuosoException: SR325: Transaction aborted
because it's log after image size went above the limit
at virtuoso.jdbc3.VirtuosoConnection.rollback(Unknown Source)
... 5 more

Code Snippet:
Repository myRepository = new
VirtuosoRepository("jdbc:virtuoso://localhost:1111","dba","dba");
myRepository.initialize();
File file = new File("C://Independent Study//uniprot_1M7.0.rdf");
long startSystemTime = System.currentTimeMillis();
RepositoryConnection con = myRepository.getConnection(); con.add(file,
null, RDFFormat.RDFXML);
long elapsedSystemTime = System.currentTimeMillis() - startSystemTime;
System.out .println("System Time to Load data using Sesame + Virtuoso in
(in ms):"+ elapsedSystemTime);
con.close();

Virtuoso ini file:
[Database]
DatabaseFile = virtuoso.db
ErrorLogFile = virtuoso.log
LockFile = virtuoso.lck
TransactionFile = virtuoso.trx
xa_persistent_file = virtuoso.pxa
ErrorLogLevel = 7
FileExtend = 200
MaxCheckpointRemap = 2000
Striping = 0
TempStorage = TempDatabase


[TempDatabase]
DatabaseFile = virtuoso-temp.db
TransactionFile = virtuoso-temp.trx
MaxCheckpointRemap = 2000
Striping = 0

Any help would be appreciated

Cheers

---------------------------------------------------------------------- -------- SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. The future of the web can't happen without you. Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http:// 2009.visitmix.com/
_______________________________________________
Virtuoso-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/virtuoso-devel

Reply via email to