Hi Chris, How many triples are currently load “sparql select count(*) where{?s ?p ?o};” ?
What does the output of running the “status();” command from isql report ? How much of the Web Data Commons datasets are you seeking to load as [1] indicates this is some 20billion triples and you only have 32 GB RAM which is good for hosting about 3 billions triples, assuming average triple size of 10 bytes per Quad ? [1] http://webdatacommons.org/structureddata/#results-2014-1 Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog -- http://www.openlinksw.com/blogs/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- http://twitter.com/OpenLink Google+ -- http://plus.google.com/100570109519069333827/ Facebook -- http://www.facebook.com/OpenLinkSoftware Universal Data Access, Integration, and Management Technology Providers > On 18 Dec 2015, at 07:07, Chris Tei <c.davie...@gmail.com> wrote: > > Hi Hugh, > > The OS being used is Ubuntu Linux. The version of Virtuoso that I am using is > 07.20.3214-pthreads, and to start the server I use virtuoso-t -f. As for > loading the datasets I am using the RDF Loader from the ISQL interface. The > problem I'm having is that datasets smaller than 2GB load fine but anything > bigger will take a very long time or the server will suddenly stop running > with no error in the log file or the load list table that I can see. > > Thank you, > -Chris > > On Mon, Dec 7, 2015 at 8:52 PM, Hugh Williams <hwilli...@openlinksw.com > <mailto:hwilli...@openlinksw.com>> wrote: > Hi Chris, > > What are the details of the OS being used and what Virtuoso open source build > ie git stable or develop 7 ? > > Are you saying the same 2GB datasets loaded successfully with a previous > release, and if so what was the build/version of that release compared to > what you are running now ( virtuoso-t -? ) ? > > What method are you using to load the datasets, is the Virtuoso RDF loader > being used, in which case are any errors reported in the load_list table ? > > Also, the “virtuoso.log” file you provided is actually an INI file it seems > ??? > > Best Regards > Hugh Williams > Professional Services > OpenLink Software, Inc. // http://www.openlinksw.com/ > <http://www.openlinksw.com/> > Weblog -- http://www.openlinksw.com/blogs/ > <http://www.openlinksw.com/blogs/> > LinkedIn -- http://www.linkedin.com/company/openlink-software/ > <http://www.linkedin.com/company/openlink-software/> > Twitter -- http://twitter.com/OpenLink <http://twitter.com/OpenLink> > Google+ -- http://plus.google.com/100570109519069333827/ > <http://plus.google.com/100570109519069333827/> > Facebook -- http://www.facebook.com/OpenLinkSoftware > <http://www.facebook.com/OpenLinkSoftware> > Universal Data Access, Integration, and Management Technology Providers > >> On 7 Dec 2015, at 21:27, Chris Tei <c.davie...@gmail.com >> <mailto:c.davie...@gmail.com>> wrote: >> >> >> ---------- Forwarded message ---------- >> From: Chris Tei <c.davie...@gmail.com <mailto:c.davie...@gmail.com>> >> Date: Fri, Dec 4, 2015 at 11:38 PM >> Subject: Loading Large Datasets into Virtuoso >> To: technical.supp...@openlinksw.com >> <mailto:technical.supp...@openlinksw.com> >> >> >> Dear OpenLink Support, >> >> I'm currently using the Virtuoso Opensource 7 server to upload roughly 230GB >> of RDF quads from Web Data Commons split roughly into 30 datasets. Recently >> I've been unable to load the larger sets of 2GB and up without Virtuoso >> crashing. I've looked through the manual and the internet to solve my >> problem, but I still am unable to upload these sets. Attached are the >> virtuoso.ini file and the virtuoso.log file. The computer I'm using is a VM >> running lubuntu, 32 GB ram and 12 cores. >> >> Thank you, >> -Chris >> >> <virtuoso.ini><virtuoso.log>------------------------------------------------------------------------------ >> Go from Idea to Many App Stores Faster with Intel(R) XDK >> Give your users amazing mobile app experiences with Intel(R) XDK. >> Use one codebase in this all-in-one HTML5 development environment. >> Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs. >> http://pubads.g.doubleclick.net/gampad/clk?id=254741911&iu=/4140_______________________________________________ >> >> <http://pubads.g.doubleclick.net/gampad/clk?id=254741911&iu=/4140_______________________________________________> >> Virtuoso-users mailing list >> Virtuoso-users@lists.sourceforge.net >> <mailto:Virtuoso-users@lists.sourceforge.net> >> https://lists.sourceforge.net/lists/listinfo/virtuoso-users >> <https://lists.sourceforge.net/lists/listinfo/virtuoso-users> > > > <virtuoso.log>
smime.p7s
Description: S/MIME cryptographic signature
------------------------------------------------------------------------------
_______________________________________________ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users