Hi,
I am trying to load a large dataset (~50GB) and bumped into:
*** Error 40001: [Virtuoso Driver][Virtuoso Server]SR325: Transaction
aborted due to a database checkpoint or database-wide atomic operation.
Please retry transaction
at line 10 of Top-Level:
ttlp_mt (file_to_string_output ('/usr/viaf/viaf_fixed.nt'), '',
'http://viaf.org/', 255)
I have 16GB memory in my box, and set:
NumberOfBuffers = 680000
MaxDirtyBuffers = 500000
and:
MaxCheckpointRemap = 2000
So i guess the MaxCheckpointRemap is the problem. At what value should I
set it?
Here [1] it says 1/4 of the database size in pages, 8K per page.
So when I calculate with a DB of 50GB that would be 1562500, is that
correct?
Am I missing something else I should check before kicking of another run?
Thanks,
Roland
[1] http://www.openlinksw.com/OdbcRails/main/Main/VirtRDFPerformanceTuning
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
Virtuoso-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/virtuoso-users